Experiment overview
Setting | Value |
---|
Model for non-random steps | BOTORCH_MODULAR |
Max. nr. evaluations | 2 |
Number random steps | 1 |
Nr. of workers (parameter) | 1 |
Best RESULT, min (total: 2)
OO_Info_int_param | OO_Info_int_param_two | OO_Info_float_param | OO_Info_choice_param | int_param | float_param | int_param_two | choice_param | RESULT |
---|
-18 | -52 | -88.26329551637171 | 2 | -18 | -88.26329551637173 | -52 | 2 | -124530.942905741 |
Job Summary per Generation Node
Generation Node | Total | COMPLETED |
SOBOL | 1 | 1 |
BOTORCH_MODULAR | 1 | 1 |
Experiment parameters
Name | Type | Lower bound | Upper bound | Values | Type | Log Scale? |
---|
int_param | range | -100 | 10 | | int | No |
float_param | range | -100 | 10 | | float | No |
choice_param | choice | | | 1, 2, 4, 8, 16, hallo | | |
int_param_two | range | -100 | 10 | | int | No |
Number of evaluations
Failed |
Succeeded |
Running |
Total |
0 |
2 |
0 |
2 |
Result names and types
Last progressbar status
2025-10-19 03:24:19 (50f8d432-baa8-4b44-8352-7a0d2d702b18): SOBOL, best RESULT: -124530.942905741, finishing jobs, finished 1 job
Git-Version
Commit: 9043d91dbe370183252bdf120ecb2c226402839d (8689)
trial_index,submit_time,queue_time,worker_generator_uuid,start_time,end_time,run_time,program_string,exit_code,signal,hostname,OO_Info_int_param,OO_Info_int_param_two,OO_Info_float_param,OO_Info_choice_param,arm_name,trial_status,generation_node,RESULT,int_param,float_param,int_param_two,choice_param
0,1760844235,3,50f8d432-baa8-4b44-8352-7a0d2d702b18,1760844238,1760844244,6,./.tests/optimization_example --int_param='-18' --float_param='-88.26329551637172698975' --choice_param='2' --int_param_two='-52' --nr_results=1,0,,runnervmzdgdc,-18,-52,-88.263295516371712778891378547996,2,0_0,COMPLETED,SOBOL,-124530.942905741001595743000507354736,-18,-88.26329551637172698974609375,-52,2
1,1760844247,2,50f8d432-baa8-4b44-8352-7a0d2d702b18,1760844249,1760844255,6,./.tests/optimization_example --int_param='-97' --float_param='8.76822478017858664145' --choice_param='4' --int_param_two='-35' --nr_results=1,0,,runnervmzdgdc,-97,-35,8.768224780178584865097946021706,4,1_0,COMPLETED,BOTORCH_MODULAR,-120235.715179940001689828932285308838,-97,8.768224780178586641454785421956,-35,4
========================================================================
Current git-hash: 9043d91dbe370183252bdf120ecb2c226402839d (version: 8689)
Using coverage run -p because $RUN_WITH_COVERAGE is set
[WARNING 10-19 03:23:53] ax.service.utils.with_db_settings_base: Ax currently requires a sqlalchemy version below 2.0. This will be addressed in a future release. Disabling SQL storage in Ax for now, if you would like to use SQL storage please install Ax with mysql extras via `pip install ax-platform[mysql]`.
Run-UUID: 2eaa7514-23cb-43a7-a250-4aed7bf6e711
_________________________________________________
/ \
| OmniOpt2 - Walking the fine line between overfit |
| and underfit like a tightrope artist. |
\ /
=================================================
\
\
\
\
.-=-==--==--.
..-==" ,'o`) `.
,' `"' \
: ( `.__...._
| ) / `-=-.
: ,vv.-._ / / `---==-._
\/\/\/VV ^ d88`;' / `.
`` ^/d88P!' / , `._
^/ !' ,. , / "-,,__,,--'""""-.
^/ !' ,' \ . .( ( _ ) ) ) ) ))_,-.\
^(__ ,!',"' ;:+.:%:a. \:.. . ,' ) ) ) ) ,"' '
',,,'',' /o:::":%:%a. \:.:.: . ) ) _,'
"""' ;':::'' `+%%%a._ \%:%| ;.). _,-""
,-='_.-' ``:%::) )%:| /:._,"
(/(/" ," ,'_,'%%%: (_,'
( (//(`.___; \
\ \ ` `
`. `. `. :
\. . .\ : . . . :
\. . .: `.. . .:
`..:.:\ \:...\
;:.:.; ::...:
):%:: :::::;
__,::%:( :::::
,;:%%%%%%%: ;:%::
;,--""-.`\ ,=--':%:%:\
/" "| /-".:%%%%%%%\
;,-"'`)%%)
/" "|
omniopt --live_share --send_anonymized_usage_stats --partition alpha --experiment_name=__main__tests__BOTORCH_MODULAR___nogridsearch --mem_gb=4 --time=60 --worker_timeout=5 --max_eval 2 --num_parallel_jobs 1 --gpus=0 --run_program Li8udGVzdHMvb3B0aW1pemF0aW9uX2V4YW1wbGUgIC0taW50X3BhcmFtPSclKGludF9wYXJhbSknIC0tZmxvYXRfcGFyYW09JyUoZmxvYXRfcGFyYW0pJyAtLWNob2ljZV9wYXJhbT0nJShjaG9pY2VfcGFyYW0pJyAtLWludF9wYXJhbV90d289JyUoaW50X3BhcmFtX3R3byknIC0tbnJfcmVzdWx0cz0x --parameter int_param range -100 10 int --parameter float_param range -100 10 float --parameter choice_param choice 1,2,4,8,16,hallo --parameter int_param_two range -100 10 int --num_random_steps 1 --model BOTORCH_MODULAR --auto_exclude_defective_hosts --generate_all_jobs_at_once --follow --show_generate_time_table
Run-folder: /home/runner/work/OmniOpt/OmniOpt/runs/__main__tests__BOTORCH_MODULAR___nogridsearch/0
See https://imageseg.scads.de/omniax/share?user_id=runner&experiment_name=__main__tests__BOTORCH_MODULAR___nogridsearch&run_nr=2 for live-results.
You have 4 CPUs available for the main process. No CUDA devices found.
Generation strategy: SOBOL for 1 step and then BOTORCH_MODULAR for 1 step.
Run-Program: ./.tests/optimization_example --int_param='%(int_param)' --float_param='%(float_param)' --choice_param='%(choice_param)' --int_param_two='%(int_param_two)' --nr_results=1
Experiment parameters
โโโโโโโโโโโโโโโโโณโโโโโโโโโณโโโโโโโโโโโโโโณโโโโโโโโโโโโโโณโโโโโโโโโโโโโโโโโโโโโโโโณโโโโโโโโณโโโโโโโโโโโโโ
โ Name โ Type โ Lower bound โ Upper bound โ Values โ Type โ Log Scale? โ
โกโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโฉ
โ int_param โ range โ -100 โ 10 โ โ int โ No โ
โ float_param โ range โ -100 โ 10 โ โ float โ No โ
โ choice_param โ choice โ โ โ 1, 2, 4, 8, 16, hallo โ โ โ
โ int_param_two โ range โ -100 โ 10 โ โ int โ No โ
โโโโโโโโโโโโโโโโโดโโโโโโโโโดโโโโโโโโโโโโโโดโโโโโโโโโโโโโโดโโโโโโโโโโโโโโโโโโโโโโโโดโโโโโโโโดโโโโโโโโโโโโโ
Result-Names
โโโโโโโโโโโโโโโณโโโโโโโโโโโโโโ
โ Result-Name โ Min or max? โ
โกโโโโโโโโโโโโโโโโโโโโโโโโโโโโฉ
โ RESULT โ min โ
โโโโโโโโโโโโโโโดโโโโโโโโโโโโโโ
Failed Jobs parameters
โโโโโโโโโโณโโโโโโโโโณโโโโโโโโโณโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
โ param1 โ param2 โ param3 โ error_description โ
โกโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโฉ
โ value1 โ value2 โ value3 โ Some error occurred during execution (this is not a real error!). โ
โโโโโโโโโโดโโโโโโโโโดโโโโโโโโโดโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
Best RESULT, min (total: 2)
โโโโโโโโโโโโโโโโโโโโโณโโโโโโโโโโโโโโโโโโโโโโโโณโโโโโโโโโโโโโโโโโโโโโโณโโโโโโโโโโโโโโโโโโโโโโโณโโโโโโโโโโโโณโโโโโโโโโโโโโโโโโโโโโณโโโโโโโโโโโโโโโโณโโโโโโโโโโโโโโโณโโโโโโโโโโโโโโโโโโโโ
โ OO_Info_int_param โ OO_Info_int_param_two โ OO_Info_float_param โ OO_Info_choice_param โ int_param โ float_param โ int_param_two โ choice_param โ RESULT โ
โกโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโฉ
โ -18 โ -52 โ -88.26329551637171 โ 2 โ -18 โ -88.26329551637173 โ -52 โ 2 โ -124530.942905741 โ
โโโโโโโโโโโโโโโโโโโโโดโโโโโโโโโโโโโโโโโโโโโโโโดโโโโโโโโโโโโโโโโโโโโโโดโโโโโโโโโโโโโโโโโโโโโโโดโโโโโโโโโโโโดโโโโโโโโโโโโโโโโโโโโโดโโโโโโโโโโโโโโโโดโโโโโโโโโโโโโโโดโโโโโโโโโโโโโโโโโโโโ
Not printing sixel graphics in CI
Runtime Infos
โโโโโโโโโโโโโโโโโโโโโโโโโณโโโโโโโโโโโโณโโโโโโโโโโโโณโโโโโโโโโโโโโโโณโโโโโโโโโโโโโโ
โ Number of evaluations โ Min time โ Max time โ Average time โ Median time โ
โกโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโฉ
โ 2 โ 6.00 sec โ 6.00 sec โ 6.00 sec โ 6.00 sec โ
โโโโโโโโโโโโโโโโโโโโโโโโโดโโโโโโโโโโโโดโโโโโโโโโโโโดโโโโโโโโโโโโโโโดโโโโโโโโโโโโโโ
Model generation times
โโโโโโโโโโโโโณโโโโโโโโโโณโโโโโโโณโโโโโโโโโโโโโโโ
โ Iteration โ Seconds โ Jobs โ Time per job โ
โกโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโฉ
โ 1 โ 0.020 โ 1 โ 0.020 โ
โ 2 โ 0.534 โ 1 โ 0.534 โ
โโโโโโโโโโโโโผโโโโโโโโโโผโโโโโโโผโโโโโโโโโโโโโโโค
โ Average โ 0.277 โ โ โ
โ Median โ 0.277 โ โ โ
โ Total โ 0.554 โ โ โ
โ Max โ 0.534 โ โ โ
โ Min โ 0.020 โ โ โ
โโโโโโโโโโโโโดโโโโโโโโโโดโโโโโโโดโโโโโโโโโโโโโโโ
Job submission durations
โโโโโโโโโโโณโโโโโโโโโโณโโโโโโโณโโโโโโโโโโโโโโโ
โ Batch โ Seconds โ Jobs โ Time per job โ
โกโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโฉ
โ 1 โ 0.219 โ 1 โ 0.219 โ
โ 2 โ 0.081 โ 1 โ 0.081 โ
โโโโโโโโโโโผโโโโโโโโโโผโโโโโโโผโโโโโโโโโโโโโโโค
โ Average โ 0.150 โ โ โ
โ Median โ 0.150 โ โ โ
โ Total โ 0.300 โ โ โ
โ Max โ 0.219 โ โ โ
โ Min โ 0.081 โ โ โ
โโโโโโโโโโโดโโโโโโโโโโดโโโโโโโดโโโโโโโโโโโโโโโ
2025-10-19 03:23:55 (50f8d432-baa8-4b44-8352-7a0d2d702b18): SOBOL, Started OmniOpt2 run...
2025-10-19 03:23:55 (50f8d432-baa8-4b44-8352-7a0d2d702b18): SOBOL, getting new HP set (no sbatch)
2025-10-19 03:23:55 (50f8d432-baa8-4b44-8352-7a0d2d702b18): SOBOL, requested 1 jobs, got 1, 0.02 s/job
2025-10-19 03:23:55 (50f8d432-baa8-4b44-8352-7a0d2d702b18): SOBOL, eval #1/1 start
2025-10-19 03:23:55 (50f8d432-baa8-4b44-8352-7a0d2d702b18): SOBOL, starting new job
2025-10-19 03:23:56 (50f8d432-baa8-4b44-8352-7a0d2d702b18): SOBOL, started new job
2025-10-19 03:24:05 (50f8d432-baa8-4b44-8352-7a0d2d702b18): SOBOL, new result: -124530.942905741
2025-10-19 03:24:06 (50f8d432-baa8-4b44-8352-7a0d2d702b18): SOBOL, best RESULT: -124530.942905741, finishing jobs, finished 1 job
2025-10-19 03:24:07 (50f8d432-baa8-4b44-8352-7a0d2d702b18): SOBOL, best RESULT: -124530.942905741, getting new HP set (no sbatch)
2025-10-19 03:24:07 (50f8d432-baa8-4b44-8352-7a0d2d702b18): SOBOL, best RESULT: -124530.942905741, requested 1 jobs, got 1, 0.53 s/job
2025-10-19 03:24:07 (50f8d432-baa8-4b44-8352-7a0d2d702b18): SOBOL, best RESULT: -124530.942905741, eval #1/1 start
2025-10-19 03:24:07 (50f8d432-baa8-4b44-8352-7a0d2d702b18): SOBOL, best RESULT: -124530.942905741, starting new job
2025-10-19 03:24:07 (50f8d432-baa8-4b44-8352-7a0d2d702b18): SOBOL, best RESULT: -124530.942905741, started new job
2025-10-19 03:24:16 (50f8d432-baa8-4b44-8352-7a0d2d702b18): SOBOL, best RESULT: -124530.942905741, new result: -120235.71517994
2025-10-19 03:24:19 (50f8d432-baa8-4b44-8352-7a0d2d702b18): SOBOL, best RESULT: -124530.942905741, finishing jobs, finished 1 job
Job submission durations
โโโโโโโโโโโณโโโโโโโโโโณโโโโโโโณโโโโโโโโโโโโโโโ
โ Batch โ Seconds โ Jobs โ Time per job โ
โกโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโฉ
โ 1 โ 0.219 โ 1 โ 0.219 โ
โ 2 โ 0.081 โ 1 โ 0.081 โ
โโโโโโโโโโโผโโโโโโโโโโผโโโโโโโผโโโโโโโโโโโโโโโค
โ Average โ 0.150 โ โ โ
โ Median โ 0.150 โ โ โ
โ Total โ 0.300 โ โ โ
โ Max โ 0.219 โ โ โ
โ Min โ 0.081 โ โ โ
โโโโโโโโโโโดโโโโโโโโโโดโโโโโโโดโโโโโโโโโโโโโโโ
Model generation times
โโโโโโโโโโโโโณโโโโโโโโโโณโโโโโโโณโโโโโโโโโโโโโโโ
โ Iteration โ Seconds โ Jobs โ Time per job โ
โกโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโฉ
โ 1 โ 0.020 โ 1 โ 0.020 โ
โ 2 โ 0.534 โ 1 โ 0.534 โ
โโโโโโโโโโโโโผโโโโโโโโโโผโโโโโโโผโโโโโโโโโโโโโโโค
โ Average โ 0.277 โ โ โ
โ Median โ 0.277 โ โ โ
โ Total โ 0.554 โ โ โ
โ Max โ 0.534 โ โ โ
โ Min โ 0.020 โ โ โ
โโโโโโโโโโโโโดโโโโโโโโโโดโโโโโโโดโโโโโโโโโโโโโโโ
Arguments Overview
Key | Value |
---|
config_yaml | None |
config_toml | None |
config_json | None |
num_random_steps | 1 |
max_eval | 2 |
run_program | [['Li8udGVzdHMvb3B0aW1pemF0aW9uX2V4YW1wbGUgIC0taW50X3BhcmFtPSclKGludF9wYXJhbSknIC0tZmxvYXRfcGFyYW09JyUoZmxvYXRfcGFyYW0pJyAtLWNob2ljZV9wYXJhbT0nJShjaG9p… |
experiment_name | __main__tests__BOTORCH_MODULAR___nogridsearch |
mem_gb | 4 |
parameter | [['int_param', 'range', '-100', '10', 'int'], ['float_param', 'range', '-100', '10', 'float'], ['choice_param', 'choice', '1,2,4,8,16,hallo'], |
| ['int_param_two', 'range', '-100', '10', 'int']] |
continue_previous_job | None |
experiment_constraints | None |
run_dir | runs |
seed | None |
verbose_tqdm | False |
model | BOTORCH_MODULAR |
gridsearch | False |
occ | False |
show_sixel_scatter | False |
show_sixel_general | False |
show_sixel_trial_index_result | False |
follow | True |
send_anonymized_usage_stats | True |
ui_url | None |
root_venv_dir | /home/runner |
exclude | None |
main_process_gb | 8 |
max_nr_of_zero_results | 10 |
abbreviate_job_names | False |
orchestrator_file | None |
checkout_to_latest_tested_version | False |
live_share | True |
disable_tqdm | False |
disable_previous_job_constraint | False |
workdir | |
occ_type | euclid |
result_names | ['RESULT=min'] |
minkowski_p | 2 |
signed_weighted_euclidean_weights | |
generation_strategy | None |
generate_all_jobs_at_once | True |
revert_to_random_when_seemingly_exhausted | False |
load_data_from_existing_jobs | [] |
n_estimators_randomforest | 100 |
max_attempts_for_generation | 20 |
external_generator | None |
username | None |
max_failed_jobs | None |
num_cpus_main_job | None |
calculate_pareto_front_of_job | [] |
show_generate_time_table | True |
force_choice_for_ranges | False |
max_abandoned_retrial | 20 |
share_password | None |
dryrun | False |
db_url | None |
run_program_once | None |
worker_generator_path | None |
save_to_database | False |
range_max_difference | 1000000 |
skip_search | False |
dont_warm_start_refitting | False |
refit_on_cv | False |
fit_out_of_design | False |
fit_abandoned | False |
dont_jit_compile | False |
num_restarts | 20 |
raw_samples | 1024 |
max_num_of_parallel_sruns | 16 |
no_transform_inputs | False |
no_normalize_y | False |
transforms | [] |
number_of_generators | 1 |
num_parallel_jobs | 1 |
worker_timeout | 5 |
slurm_use_srun | False |
time | 60 |
partition | alpha |
reservation | None |
force_local_execution | False |
slurm_signal_delay_s | 0 |
nodes_per_job | 1 |
cpus_per_task | 1 |
account | None |
gpus | 0 |
dependency | None |
run_mode | local |
verbose | False |
verbose_break_run_search_table | False |
debug | False |
flame_graph | False |
memray | False |
no_sleep | False |
tests | False |
show_worker_percentage_table_at_end | False |
auto_exclude_defective_hosts | True |
run_tests_that_fail_on_taurus | False |
raise_in_eval | False |
show_ram_every_n_seconds | 0 |
show_generation_and_submission_sixel | False |
just_return_defaults | False |
prettyprint | False |
runtime_debug | False |
debug_stack_regex | |
debug_stack_trace_regex | None |
show_func_name | False |
beartype | False |
timestamp,ram_usage_mb,cpu_usage_percent
1760844235,779.01171875,23.7
Parameter statistics
Parameter | Min | Max | Mean | Std Dev | Count |
---|
run_time | 6 | 6 | 6 | 0 | 2 |
OO_Info_int_param | -97 | -18 | -57.5 | 39.5 | 2 |
OO_Info_int_param_two | -52 | -35 | -43.5 | 8.5 | 2 |
OO_Info_float_param | -88.2633 | 8.7682 | -39.7475 | 48.5158 | 2 |
OO_Info_choice_param | 2 | 4 | 3 | 1 | 2 |
RESULT | -124530.9429 | -120235.7152 | -122383.329 | 2147.6139 | 2 |
int_param | -97 | -18 | -57.5 | 39.5 | 2 |
float_param | -88.2633 | 8.7682 | -39.7475 | 48.5158 | 2 |
int_param_two | -52 | -35 | -43.5 | 8.5 | 2 |
choice_param | 2 | 4 | 3 | 1 | 2 |
Show SLURM-Job-ID (if it exists)
/home/runner/.omniax_venvs/Python_3.12.3/x86_64/lib/python3.12/site-packages/submitit/core/plugins.py:24: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
import pkg_resources
submitit INFO (2025-10-19 03:23:56,450) - Starting with JobEnvironment(job_id=87974, hostname=runnervmzdgdc, local_rank=0(1), node=0(1), global_rank=0(1))
submitit INFO (2025-10-19 03:23:56,451) - Loading pickle: /home/runner/work/OmniOpt/OmniOpt/runs/__main__tests__BOTORCH_MODULAR___nogridsearch/0/single_runs/87974/87974_submitted.pkl
Trial-Index: 0
Parameters: {"int_param": -18, "float_param": -88.26329551637173, "int_param_two": -52, "choice_param": 2}
Debug-Infos:
========
DEBUG INFOS START:
Program-Code: ./.tests/optimization_example --int_param='-18' --float_param='-88.26329551637172698975' --choice_param='2' --int_param_two='-52' --nr_results=1
pwd: /home/runner/work/OmniOpt/OmniOpt
File: ./.tests/optimization_example
UID: 1001
GID: 1001
Status-Change-Time: 1760843806.994459
Size: 5714 Bytes
Permissions: -rwxr-xr-x
Owner: runner
Last access: 1760844238.0156658
Last modification: 1760843806.994459
Hostname: runnervmzdgdc
========
DEBUG INFOS END
./.tests/optimization_example --int_param='-18' --float_param='-88.26329551637172698975' --choice_param='2' --int_param_two='-52' --nr_results=1
stdout:
OO-Info: int_param: -18
OO-Info: int_param_two: -52
OO-Info: float_param: -88.26329551637172698975
OO-Info: choice_param: 2
RESULT: -124530.942905741
stderr was empty
Result: {'RESULT': -124530.942905741}
Final-results: {'RESULT': -124530.942905741}
EXIT_CODE: 0
submitit INFO (2025-10-19 03:24:04,032) - Job completed successfully
submitit INFO (2025-10-19 03:24:04,033) - Exiting after successful completion