OmniOpt2

Experiment overview

Setting	Value
Model for non-random steps	BOTORCH_MODULAR
Max. nr. evaluations	30
Number random steps	20
Nr. of workers (parameter)	20
Main process memory (GB)	8
Worker memory (GB)	4

Best RESULT, min (total: 25)

OO_Info_int…	OO_Info_int_…	OO_Info_flo…	OO_Info_choi…	OO_Info_SLU…	int_param	float_param	int_param_two	choice_param	RESULT
-100.0	-100.0	-100.0	16	2342196.0	-100	-100.0	-100	16	-331437.319…

Job Summary per Generation Node

Generation Node	Total	ABANDONED	COMPLETED
SOBOL	20	0	20
BOTORCH_MODULAR	26	21	5

Experiment parameters

Name	Type	Lower bound	Upper bound	Values	Type	Log Scale?
int_param	range	-100	10		int	No
float_param	range	-100	10		float	No
choice_param	choice			1, 2, 4, 8, 16, hallo
int_param_two	range	-100	10		int	No

Number of evaluations

Failed	Succeeded	Running	Total
0	25	0	46

Result names and types

name	min/max
RESULT	min

Git-Version

Commit: 2a79e74e93dd2309c46718edef1cc81ebc965b7e (10002-6-g2a79e74e9)

get_ax_client_trial: trial_index 47 failed

get_ax_client_trial: trial_index 48 failed

execute_evaluation: _trial was not in execute_evaluation for params [47, {'int_param': -100, 'float_param': -100.0, 'int_param_two': -100, 'choice_param': '8'}, 3, 'systematic']

execute_evaluation: _trial was not in execute_evaluation for params [48, {'int_param': -100, 'float_param': -100.0, 'int_param_two': -100, 'choice_param': '1'}, 4, 'systematic']

get_ax_client_trial: trial_index 46 failed

execute_evaluation: _trial was not in execute_evaluation for params [46, {'int_param': -100, 'float_param': -100.0, 'int_param_two': -100, 'choice_param': '2'}, 5, 'systematic']

It seems like the search space was exhausted. You were able to get 83% of the jobs you requested (got: 25, submitted: 25, failed: 0, requested: 30) after main ran

         Job submission durations          
┏━━━━━━━━━┳━━━━━━━━━┳━━━━━━┳━━━━━━━━━━━━━━┓
┃   Batch ┃ Seconds ┃ Jobs ┃ Time per job ┃
┡━━━━━━━━━╇━━━━━━━━━╇━━━━━━╇━━━━━━━━━━━━━━┩
│       1 │   6.610 │   20 │        0.331 │
│       2 │   0.601 │    1 │        0.601 │
│       3 │   1.709 │    1 │        1.709 │
│       4 │   0.619 │    1 │        0.619 │
│       5 │   2.295 │    5 │        0.459 │
├─────────┼─────────┼──────┼──────────────┤
│ Average │   2.367 │      │              │
│  Median │   1.709 │      │              │
│   Total │  11.834 │      │              │
│     Max │   6.610 │      │              │
│     Min │   0.601 │      │              │
└─────────┴─────────┴──────┴──────────────┘

           Model generation times            
┏━━━━━━━━━━━┳━━━━━━━━━┳━━━━━━┳━━━━━━━━━━━━━━┓
┃ Iteration ┃ Seconds ┃ Jobs ┃ Time per job ┃
┡━━━━━━━━━━━╇━━━━━━━━━╇━━━━━━╇━━━━━━━━━━━━━━┩
│         1 │   4.471 │   20 │        0.224 │
│         2 │  22.662 │    1 │       22.662 │
│         3 │  21.397 │    1 │       21.397 │
│         4 │  15.521 │    1 │       15.521 │
│         5 │  20.786 │    5 │        4.157 │
│         6 │  23.912 │    0 │        0.000 │
│         7 │  15.886 │    0 │        0.000 │
│         8 │  15.576 │    0 │        0.000 │
│         9 │  15.434 │    0 │        0.000 │
│        10 │  17.330 │    0 │        0.000 │
│        11 │  16.821 │    0 │        0.000 │
│        12 │  21.248 │    0 │        0.000 │
│        13 │  14.289 │    0 │        0.000 │
│        14 │  16.848 │    0 │        0.000 │
│        15 │  15.034 │    0 │        0.000 │
├───────────┼─────────┼──────┼──────────────┤
│   Average │  17.148 │      │              │
│    Median │  16.821 │      │              │
│     Total │ 257.215 │      │              │
│       Max │  23.912 │      │              │
│       Min │   4.471 │      │              │
└───────────┴─────────┴──────┴──────────────┘

Arguments Overview

Key	Value
install	False
config_yaml	None
config_toml	None
config_json	None
num_random_steps	20
max_eval	30
run_program	[['Li8udGVzdHMvb3B0aW1pemF0aW9uX2V4YW1wbGUgIC0taW50X3BhcmFtPSclKGludF9wYXJhbSknIC0tZmxvYXRfcGFyYW09Jy…
experiment_name	__main__tests__BOTORCH_MODULAR___nogridsearch
mem_gb	4
parameter	[['int_param', 'range', '-100', '10', 'int'], ['float_param', 'range', '-100', '10', 'float'],
	['choice_param', 'choice', '1,2,4,8,16,hallo'], ['int_param_two', 'range', '-100', '10', 'int']]
continue_previous_job	None
experiment_constraints	None
run_dir	runs
seed	None
verbose_tqdm	False
model	BOTORCH_MODULAR
gridsearch	False
occ	False
show_sixel_scatter	False
show_sixel_general	False
show_sixel_trial_index_result	False
follow	True
wait_until_ended	False
send_anonymized_usage_stats	True
ui_url	None
root_venv_dir	/home/s3811141
exclude	None
main_process_gb	8
max_nr_of_zero_results	10
abbreviate_job_names	False
orchestrator_file	None
checkout_to_latest_tested_version	False
live_share	True
disable_tqdm	False
local_cpu_monitor	False
disable_previous_job_constraint	False
workdir
occ_type	euclid
result_names	['RESULT=min']
minkowski_p	2
signed_weighted_euclidean_weights
generation_strategy	None
generate_all_jobs_at_once	True
revert_to_random_when_seemingly_exhausted	False
load_data_from_existing_jobs	[]
n_estimators_randomforest	100
max_attempts_for_generation	20
external_generator	None
optuna_sampler	None
optuna_pruner	none
optuna_n_startup_trials	10
optuna_multivariate	False
optuna_group	False
optuna_constraints	False
optuna_n_ei_candidates	0
optuna_storage	None
optuna_study_name	omniopt_study
optuna_no_load_if_exists	False
optuna_extra_iters	1
username	None
max_failed_jobs	None
num_cpus_main_job	None
calculate_pareto_front_of_job	[]
show_generate_time_table	True
force_choice_for_ranges	False
max_abandoned_retrial	20
share_password	None
dryrun	False
db_url	None
run_program_once	None
worker_generator_path	None
save_to_database	False
range_max_difference	1000000
skip_search	False
nr_evals_per_arm	1
dump_config	None
formula	None
formula_mode	auto
formula_python_path	/home/s3811141/.omniax_venvs/Python_3.10.4/x86_64/bin/python
dont_warm_start_refitting	False
refit_on_cv	False
fit_out_of_design	False
fit_abandoned	False
dont_jit_compile	False
num_restarts	20
raw_samples	1024
max_num_of_parallel_sruns	16
no_transform_inputs	False
no_normalize_y	False
transforms	[]
number_of_generators	1
num_parallel_jobs	20
worker_timeout	5
slurm_use_srun	False
time	60
partition	alpha
reservation	None
force_local_execution	False
slurm_signal_delay_s	0
nodes_per_job	1
cpus_per_task	1
account	None
gpus	1
dependency	None
run_mode	local
verbose	False
verbose_break_run_search_table	False
debug	False
flame_graph	False
memray	False
no_sleep	False
tests	False
show_worker_percentage_table_at_end	False
auto_exclude_defective_hosts	True
run_tests_that_fail_on_taurus	False
raise_in_eval	False
show_ram_every_n_seconds	0
show_generation_and_submission_sixel	False
just_return_defaults	False
prettyprint	False
runtime_debug	False
debug_stack_regex
debug_stack_trace_regex	None
show_func_name	False
beartype	False

1788984530.9235,20,0,0
1788984554.7671,20,0,0
1788984555.3025,20,3,15
1788984559.5942,20,3,15
1788984560.1517,20,20,100
1788984704.8285,20,20,100
1788984705.4432,20,19,95
1788984729.9702,20,19,95
1788984731.576,20,18,90
1788984749.6152,20,18,90
1788984750.1886,20,17,85
1788984764.9869,20,17,85
1788984765.5623,20,16,80
1788984789.6546,20,16,80
1788984790.233,20,15,75
1788984809.9599,20,15,75
1788984810.5748,20,14,70
1788984829.6709,20,14,70
1788984830.2512,20,13,65
1788984849.907,20,13,65
1788984850.4992,20,12,60
1788984859.5799,20,12,60
1788984860.1514,20,11,55
1788984869.5213,20,11,55
1788984870.1001,20,10,50
1788984889.991,20,10,50
1788984890.5645,20,8,40
1788984909.5288,20,8,40
1788984910.1022,20,6,30
1788984929.6232,20,6,30
1788984930.2009,20,4,20
1788984944.7064,20,4,20
1788984945.2835,20,3,15
1788984949.5598,20,3,15
1788984950.1315,20,2,10
1788984967.6637,20,2,10
1788984972.0719,20,0,0
1788984991.484,20,0,0
1788984991.8633,20,1,5
1788985126.7903,20,1,5
1788985131.1635,20,0,0
1788985150.0423,20,0,0
1788985150.4139,20,1,5
1788986037.3293,20,1,5
1788986041.426,20,0,0
1788986053.588,20,0,0
1788986053.9597,20,1,5
1788986562.4752,20,1,5
1788986566.0747,20,0,0
1788986586.0851,20,0,0
1788986586.5477,20,1,5
1788986590.6745,20,1,5
1788986591.2824,20,2,10
1788986755.8411,20,2,10
1788986756.4398,20,1,5
1788986769.9897,20,1,5
1788986773.2444,20,0,0
1788986964.306,20,0,0

This logs the CPU and RAM usage of the main worker process.

timestamp,ram_usage_mb,cpu_usage_percent
1788984530,787.28125,8.9
1788984590,828.4453125,10.1
1788984650,828.6328125,14
1788984710,829.17578125,14.2
1788984773,829.40625,14
1788984833,829.7265625,14.2
1788984893,829.8046875,14.3
1788984953,829.97265625,14.3
1788985013,849.55859375,14.6
1788985073,849.55859375,14.2
1788985133,849.859375,14.5
1788985193,851.5,14.2
1788985253,851.5,14.2
1788985313,851.5078125,14.2
1788985373,851.5234375,14.2
1788985433,851.5546875,14.2
1788985493,851.5703125,14.3
1788985553,851.6015625,14.2
1788985613,851.6328125,14.2
1788985673,851.6640625,14.2
1788985733,851.7109375,14.2
1788985793,851.75,14.3
1788985853,851.796875,14.3
1788985913,851.84375,14.3
1788985973,851.890625,14.3
1788986033,851.953125,14.2
1788986093,855.24609375,14.3
1788986154,855.24609375,14.3
1788986214,855.25,14.2
1788986274,855.265625,14.2
1788986334,855.296875,14.2
1788986397,855.328125,14.3
1788986457,855.34375,14.2
1788986517,855.375,14.3
1788986577,860.6953125,15.1
1788986637,862.28125,14.2
1788986697,862.28125,14.2
1788986757,862.3046875,13.9
1788986820,864.70703125,11.4
1788986884,869.62890625,11.6
1788986945,872.24609375,11.6

`RESULT` (goal: minimize)

Best value: -331437.32
Achieved at:
- OO_Info_int_param_two = -100 (r=0.83, strong positive correlation)
- OO_Info_float_param = -100 (r=0.794, strong positive correlation)
- OO_Info_int_param = -100 (r=0.736, strong positive correlation)
- run_time = 7 (r=-0.113, weak negative correlation)

Top-5 Best Results

Parameter Sensitivity Ranking

Parameters ranked by absolute Pearson correlation with each result. Stronger correlations (|r| ≥ 0.7) suggest the parameter has more influence on the outcome.

Convergence Analysis

Parameter statistics

Parameter	Min	Max	Mean	Std Dev	Count
run_time	6	7	6.24	0.4271	25
OO_Info_int_param	-100	9	-56	36.4944	25
OO_Info_int_param_two	-100	7	-56	35.5584	25
OO_Info_float_param	-100	8.0272	-55.9959	37.2014	25
OO_Info_choice_param	No numerical statistics available
RESULT	-331437.32	-2441.9537	-151440.4254	106703.2154	25
int_param	-100	9	-76.087	34.7011	46
float_param	-100	8.0272	-76.0848	35.108	46
int_param_two	-100	7	-76.087	34.1689	46
choice_param	No numerical statistics available