Experiment overview
| Setting | Value |
|---|
| Model for non-random steps | BOTORCH_MODULAR |
| Max. nr. evaluations | 2 |
| Number random steps | 1 |
| Nr. of workers (parameter) | 1 |
Best RESULT1, min (total: 2)
| RESULT2 | int_param | float_param | int_param_two | choice_param | RESULT1 |
|---|
| 2.43481903439121 | -61 | -31.89769413607484 | 4 | 16 | 1.112751290974305 |
Job Summary per Generation Node
| Generation Node | Total | COMPLETED |
|---|
| SOBOL | 1 | 1 |
| BOTORCH_MODULAR | 1 | 1 |
Experiment parameters
| Name | Type | Lower bound | Upper bound | Values | Type | Log Scale? |
|---|
| int_param | range | -100 | 10 | | int | No |
| float_param | range | -100 | 10 | | float | No |
| choice_param | choice | | | 1, 2, 4, 8, 16, hallo | | |
| int_param_two | range | -100 | 10 | | int | No |
Number of evaluations
| Failed |
Succeeded |
Running |
Total |
| 0 |
2 |
0 |
2 |
Result names and types
| name | min/max |
|---|
| RESULT1 |
min |
| RESULT2 |
max |
Last progressbar status
2026-05-10 00:42:59 (21c4651b-e4ec-4865-a08f-c5e68a9fdb6e): BOTORCH_MODULAR, 2 done, ▁█, finishing jobs, finished 1 job
Git-Version
Commit: 01b08d618b49d942e55420979b7925f87f54957e (9305-14-g01b08d618)
trial_index,submit_time,queue_time,worker_generator_uuid,start_time,end_time,run_time,program_string,exit_code,signal,hostname,arm_name,trial_status,generation_node,RESULT1,RESULT2,int_param,float_param,int_param_two,choice_param
0,1778373743,2,21c4651b-e4ec-4865-a08f-c5e68a9fdb6e,1778373745,1778373757,12,./.tests/optimization_example --int_param='-2' --float_param='-77.8562596440315246582' --choice_param='1' --int_param_two='-92' --nr_results=2,0,,runnervmeorf1,0_0,COMPLETED,SOBOL,1.854173631600000149433071783278,2.163609161900000188438752957154,-2,-77.856259644031524658203125,-92,1
1,1778373761,1,21c4651b-e4ec-4865-a08f-c5e68a9fdb6e,1778373762,1778373774,12,./.tests/optimization_example --int_param='-61' --float_param='-31.89769413607483983242' --choice_param='16' --int_param_two='4' --nr_results=2,0,,runnervmeorf1,1_0,COMPLETED,BOTORCH_MODULAR,1.112751290974304918535153774428,2.434819034391209946477374614915,-61,-31.897694136074839832417637808248,4,16
========================================================================
Current git-hash: 01b08d618b49d942e55420979b7925f87f54957e (last fully tested stable version 14 commits ago [5268678be516a64d8bfe1ff0d3bbd05a6f0bcdd2, 9305])
Using coverage run -p because $RUN_WITH_COVERAGE is set
[WARNING 05-10 00:42:19] ax.storage.sqa_store.with_db_settings_base: Ax currently requires a sqlalchemy version below 2.0. This will be addressed in a future release. Disabling SQL storage in Ax for now, if you would like to use SQL storage please install Ax with mysql extras via `pip install ax-platform[mysql]`.
Run-UUID: 3d8d7473-e8db-40a9-9550-bdf20f3ac95d
/home/runner/.omniax_venvs/Python_3.12.3/x86_64/lib/python3.12/site-packages/plyer/platforms/linux/notification.py:103: UserWarning: The Python dbus package is not installed.
Try installing it with your distribution's package manager, it is usually called python-dbus or python3-dbus, but you might have to try dbus-python instead, e.g. when using pip.
warnings.warn(msg)
/home/runner/.omniax_venvs/Python_3.12.3/x86_64/lib/python3.12/site-packages/plyer/platforms/linux/notification.py:107: UserWarning: notify-send not found.
warnings.warn("notify-send not found.")
_________________________________________________
/ \
| OmniOpt2 - The fractal of hyperparameters: The de |
| eper you go, the more you see. |
\ /
=================================================
\
\
\
\
__---__
_- /--______
__--( / \ )XXXXXXXXXXX\v.
.-XXX( O O )XXXXXXXXXXXXXXX-
/XXX( U ) XXXXXXX\
/XXXXX( )--_ XXXXXXXXXXX\
/XXXXX/ ( O ) XXXXXX \XXXXX\
XXXXX/ / XXXXXX \__ \XXXXX
XXXXXX__/ XXXXXX \__---->
---___ XXX__/ XXXXXX \__ /
\- --__/ ___/\ XXXXXX / ___--/=
\-\ ___/ XXXXXX '--- XXXXXX
\-\/XXX\ XXXXXX /XXXXX
\XXXXXXXXX \ /XXXXX/
\XXXXXX > _/XXXXX/
\XXXXX--__/ __-- XXXX/
-XXXXXXXX--------------- XXXXXX-
\XXXXXXXXXXXXXXXXXXXXXXXXXX/
""VXXXXXXXXXXXXXXXXXXV""
omniopt --live_share --send_anonymized_usage_stats --partition alpha --experiment_name=multiple_evals_per_arm --mem_gb=4 --time=1200 --worker_timeout=5 --max_eval 2 --num_parallel_jobs 1 --gpus=0 --run_program Li8udGVzdHMvb3B0aW1pemF0aW9uX2V4YW1wbGUgIC0taW50X3BhcmFtPSclKGludF9wYXJhbSknIC0tZmxvYXRfcGFyYW09JyUoZmxvYXRfcGFyYW0pJyAtLWNob2ljZV9wYXJhbT0nJShjaG9pY2VfcGFyYW0pJyAtLWludF9wYXJhbV90d289JyUoaW50X3BhcmFtX3R3byknIC0tbnJfcmVzdWx0cz0y --parameter int_param range -100 10 int --parameter float_param range -100 10 float --parameter choice_param choice 1,2,4,8,16,hallo --parameter int_param_two range -100 10 int --num_random_steps 1 --model BOTORCH_MODULAR --auto_exclude_defective_hosts --result_names RESULT1=min RESULT2=max --generate_all_jobs_at_once --revert_to_random_when_seemingly_exhausted --nr_evals_per_arm=2 --beartype --show_generate_time_table --disable_notifications
Run-folder: /home/runner/work/OmniOpt/OmniOpt/runs/multiple_evals_per_arm/0
See https://imageseg.scads.de/omniax/share?user_id=runner&experiment_name=multiple_evals_per_arm&run_nr=70 for live-results.
You have 4 CPUs available for the main process. No CUDA devices found.
Generation strategy: SOBOL for 1 step and then BOTORCH_MODULAR for 1 step.
Run-Program: ./.tests/optimization_example --int_param='%(int_param)' --float_param='%(float_param)' --choice_param='%(choice_param)' --int_param_two='%(int_param_two)' --nr_results=2
Experiment parameters
┏━━━━━━━━━━━━━━━┳━━━━━━━━┳━━━━━━━━━━━━━┳━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━┳━━━━━━━━━━━━┓
┃ Name ┃ Type ┃ Lower bound ┃ Upper bound ┃ Values ┃ Type ┃ Log Scale? ┃
┡━━━━━━━━━━━━━━━╇━━━━━━━━╇━━━━━━━━━━━━━╇━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━╇━━━━━━━━━━━━┩
│ int_param │ range │ -100 │ 10 │ │ int │ No │
│ float_param │ range │ -100 │ 10 │ │ float │ No │
│ choice_param │ choice │ │ │ 1, 2, 4, 8, 16, hallo │ │ │
│ int_param_two │ range │ -100 │ 10 │ │ int │ No │
└───────────────┴────────┴─────────────┴─────────────┴───────────────────────┴───────┴────────────┘
Result-Names
┏━━━━━━━━━━━━━┳━━━━━━━━━━━━━┓
┃ Result-Name ┃ Min or max? ┃
┡━━━━━━━━━━━━━╇━━━━━━━━━━━━━┩
│ RESULT1 │ min │
│ RESULT2 │ max │
└─────────────┴─────────────┘
Your console does not support sixel-images. Will not print Pareto-frontier as a
matplotlib-sixel-plot for RESULT1/RESULT2.
Pareto-Front for RESULT1/RESULT2:
┏━━━━━━━━━━━━━┳━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━┓
┃ trial_index ┃ int_param ┃ float_param ┃ int_param_two ┃ choice_param ┃ RESULT1 ┃ RESULT2 ┃
┡━━━━━━━━━━━━━╇━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━┩
│ 0 │ -2 │ -77.85625964403152 │ -92 │ 1 │ 1.8541736316000001 │ 2.1636091619 │
├─────────────┼───────────┼────────────────────┼───────────────┼──────────────┼────────────────────┼──────────────────┤
│ 1 │ -61 │ -31.89769413607484 │ 4 │ 16 │ 1.112751290974305 │ 2.43481903439121 │
└─────────────┴───────────┴────────────────────┴───────────────┴──────────────┴────────────────────┴──────────────────┘
Failed Jobs parameters
┏━━━━━━━━┳━━━━━━━━┳━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┓
┃ param1 ┃ param2 ┃ param3 ┃ error_description ┃
┡━━━━━━━━╇━━━━━━━━╇━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┩
│ value1 │ value2 │ value3 │ Some error occurred during execution (this is not a real error!). │
└────────┴────────┴────────┴───────────────────────────────────────────────────────────────────┘
Not printing sixel graphics in CI
Not printing sixel graphics in CI
Runtime Infos
┏━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━┳━━━━━━━━━━━━┳━━━━━━━━━━━━━━┳━━━━━━━━━━━━━┓
┃ Number of evaluations ┃ Min time ┃ Max time ┃ Average time ┃ Median time ┃
┡━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━╇━━━━━━━━━━━━╇━━━━━━━━━━━━━━╇━━━━━━━━━━━━━┩
│ 2 │ 12.00 sec │ 12.00 sec │ 12.00 sec │ 12.00 sec │
└───────────────────────┴────────────┴────────────┴──────────────┴─────────────┘
Model generation times
┏━━━━━━━━━━━┳━━━━━━━━━┳━━━━━━┳━━━━━━━━━━━━━━┓
┃ Iteration ┃ Seconds ┃ Jobs ┃ Time per job ┃
┡━━━━━━━━━━━╇━━━━━━━━━╇━━━━━━╇━━━━━━━━━━━━━━┩
│ 1 │ 0.049 │ 1 │ 0.049 │
│ 2 │ 0.767 │ 1 │ 0.767 │
├───────────┼─────────┼──────┼──────────────┤
│ Average │ 0.408 │ │ │
│ Median │ 0.408 │ │ │
│ Total │ 0.816 │ │ │
│ Max │ 0.767 │ │ │
│ Min │ 0.049 │ │ │
└───────────┴─────────┴──────┴──────────────┘
Job submission durations
┏━━━━━━━━━┳━━━━━━━━━┳━━━━━━┳━━━━━━━━━━━━━━┓
┃ Batch ┃ Seconds ┃ Jobs ┃ Time per job ┃
┡━━━━━━━━━╇━━━━━━━━━╇━━━━━━╇━━━━━━━━━━━━━━┩
│ 1 │ 0.256 │ 1 │ 0.256 │
│ 2 │ 0.106 │ 1 │ 0.106 │
├─────────┼─────────┼──────┼──────────────┤
│ Average │ 0.181 │ │ │
│ Median │ 0.181 │ │ │
│ Total │ 0.362 │ │ │
│ Max │ 0.256 │ │ │
│ Min │ 0.106 │ │ │
└─────────┴─────────┴──────┴──────────────┘
╭──────────────────────────────────────────────────────────────────────────────────────── OmniOpt2 Run Summary ────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ ✅ Optimization complete! │
│ │
│ 📊 Trials: 2 succeeded / 0 failed / 2 done / 2 submitted │
│ ⏱️ Duration: 51s │
│ 🏆 Best RESULT1: 1.112751290974305 │
│ 🏆 Best RESULT2: 2.43481903439121 │
│ 📁 Results: /home/runner/work/OmniOpt/OmniOpt/runs/multiple_evals_per_arm/0/results.csv │
│ 🧠 Model: BOTORCH_MODULAR │
│ │
╰──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
2026-05-10 00:42:23 (21c4651b-e4ec-4865-a08f-c5e68a9fdb6e): SOBOL, Started OmniOpt2 run...
2026-05-10 00:42:23 (21c4651b-e4ec-4865-a08f-c5e68a9fdb6e): SOBOL, getting new HP set (no sbatch)
2026-05-10 00:42:23 (21c4651b-e4ec-4865-a08f-c5e68a9fdb6e): SOBOL, requested 1 jobs, got 1, 0.05 s/job
2026-05-10 00:42:23 (21c4651b-e4ec-4865-a08f-c5e68a9fdb6e): SOBOL, eval #1/1 start
2026-05-10 00:42:23 (21c4651b-e4ec-4865-a08f-c5e68a9fdb6e): SOBOL, starting new job
2026-05-10 00:42:23 (21c4651b-e4ec-4865-a08f-c5e68a9fdb6e): SOBOL, started new job
2026-05-10 00:42:38 (21c4651b-e4ec-4865-a08f-c5e68a9fdb6e): SOBOL, new result: RESULT1: 1.854174 (SEM: 0.087741), RESULT2: 2.163609 (SEM: 0.130095)
2026-05-10 00:42:40 (21c4651b-e4ec-4865-a08f-c5e68a9fdb6e): SOBOL, 1 done, finishing jobs, finished 1 job
2026-05-10 00:42:41 (21c4651b-e4ec-4865-a08f-c5e68a9fdb6e): BOTORCH_MODULAR, 1 done, getting new HP set (no sbatch)
2026-05-10 00:42:41 (21c4651b-e4ec-4865-a08f-c5e68a9fdb6e): BOTORCH_MODULAR, 1 done, requested 1 jobs, got 1, 0.77 s/job
2026-05-10 00:42:41 (21c4651b-e4ec-4865-a08f-c5e68a9fdb6e): BOTORCH_MODULAR, 1 done, eval #1/1 start
2026-05-10 00:42:41 (21c4651b-e4ec-4865-a08f-c5e68a9fdb6e): BOTORCH_MODULAR, 1 done, starting new job
2026-05-10 00:42:41 (21c4651b-e4ec-4865-a08f-c5e68a9fdb6e): BOTORCH_MODULAR, 1 done, started new job
2026-05-10 00:42:56 (21c4651b-e4ec-4865-a08f-c5e68a9fdb6e): BOTORCH_MODULAR, 1 done, new result: RESULT1: 1.112751 (SEM: 0.078548), RESULT2: 2.434819 (SEM: 0.205827)
2026-05-10 00:42:59 (21c4651b-e4ec-4865-a08f-c5e68a9fdb6e): BOTORCH_MODULAR, 2 done, ▁█, finishing jobs, finished 1 job
Job submission durations
┏━━━━━━━━━┳━━━━━━━━━┳━━━━━━┳━━━━━━━━━━━━━━┓
┃ Batch ┃ Seconds ┃ Jobs ┃ Time per job ┃
┡━━━━━━━━━╇━━━━━━━━━╇━━━━━━╇━━━━━━━━━━━━━━┩
│ 1 │ 0.256 │ 1 │ 0.256 │
│ 2 │ 0.106 │ 1 │ 0.106 │
├─────────┼─────────┼──────┼──────────────┤
│ Average │ 0.181 │ │ │
│ Median │ 0.181 │ │ │
│ Total │ 0.362 │ │ │
│ Max │ 0.256 │ │ │
│ Min │ 0.106 │ │ │
└─────────┴─────────┴──────┴──────────────┘
Model generation times
┏━━━━━━━━━━━┳━━━━━━━━━┳━━━━━━┳━━━━━━━━━━━━━━┓
┃ Iteration ┃ Seconds ┃ Jobs ┃ Time per job ┃
┡━━━━━━━━━━━╇━━━━━━━━━╇━━━━━━╇━━━━━━━━━━━━━━┩
│ 1 │ 0.049 │ 1 │ 0.049 │
│ 2 │ 0.767 │ 1 │ 0.767 │
├───────────┼─────────┼──────┼──────────────┤
│ Average │ 0.408 │ │ │
│ Median │ 0.408 │ │ │
│ Total │ 0.816 │ │ │
│ Max │ 0.767 │ │ │
│ Min │ 0.049 │ │ │
└───────────┴─────────┴──────┴──────────────┘
Arguments Overview
| Key | Value |
|---|
| config_yaml | None |
| config_toml | None |
| config_json | None |
| num_random_steps | 1 |
| max_eval | 2 |
| run_program | [['Li8udGVzdHMvb3B0aW1pemF0aW9uX2V4YW1wbGUgIC0taW50X3BhcmFtPSclKGludF9wYXJhbSknIC0tZmxvYXRfcGFyYW09JyUoZmxvYXRfcGFyYW0pJyAtLWNob2ljZV9wYXJhbT0nJShjaG9p… |
| experiment_name | multiple_evals_per_arm |
| mem_gb | 4 |
| parameter | [['int_param', 'range', '-100', '10', 'int'], ['float_param', 'range', '-100', '10', 'float'], ['choice_param', 'choice', '1,2,4,8,16,hallo'], |
| ['int_param_two', 'range', '-100', '10', 'int']] |
| continue_previous_job | None |
| experiment_constraints | None |
| run_dir | runs |
| seed | None |
| verbose_tqdm | False |
| model | BOTORCH_MODULAR |
| gridsearch | False |
| occ | False |
| show_sixel_scatter | False |
| show_sixel_general | False |
| show_sixel_trial_index_result | False |
| follow | False |
| send_anonymized_usage_stats | True |
| ui_url | None |
| root_venv_dir | /home/runner |
| exclude | None |
| main_process_gb | 8 |
| max_nr_of_zero_results | 10 |
| abbreviate_job_names | False |
| orchestrator_file | None |
| checkout_to_latest_tested_version | False |
| live_share | True |
| disable_tqdm | False |
| disable_previous_job_constraint | False |
| workdir | |
| occ_type | euclid |
| result_names | ['RESULT1=min', 'RESULT2=max'] |
| minkowski_p | 2 |
| signed_weighted_euclidean_weights | |
| generation_strategy | None |
| generate_all_jobs_at_once | True |
| revert_to_random_when_seemingly_exhausted | True |
| load_data_from_existing_jobs | [] |
| n_estimators_randomforest | 100 |
| max_attempts_for_generation | 20 |
| external_generator | None |
| username | None |
| max_failed_jobs | None |
| num_cpus_main_job | None |
| calculate_pareto_front_of_job | [] |
| show_generate_time_table | True |
| force_choice_for_ranges | False |
| max_abandoned_retrial | 20 |
| share_password | None |
| dryrun | False |
| db_url | None |
| run_program_once | None |
| worker_generator_path | None |
| save_to_database | False |
| range_max_difference | 1000000 |
| skip_search | False |
| nr_evals_per_arm | 2 |
| disable_notifications | True |
| dont_warm_start_refitting | False |
| refit_on_cv | False |
| fit_out_of_design | False |
| fit_abandoned | False |
| dont_jit_compile | False |
| num_restarts | 20 |
| raw_samples | 1024 |
| max_num_of_parallel_sruns | 16 |
| no_transform_inputs | False |
| no_normalize_y | False |
| transforms | [] |
| number_of_generators | 1 |
| num_parallel_jobs | 1 |
| worker_timeout | 5 |
| slurm_use_srun | False |
| time | 1200 |
| partition | alpha |
| reservation | None |
| force_local_execution | False |
| slurm_signal_delay_s | 0 |
| nodes_per_job | 1 |
| cpus_per_task | 1 |
| account | None |
| gpus | 0 |
| dependency | None |
| run_mode | local |
| verbose | False |
| verbose_break_run_search_table | False |
| debug | False |
| flame_graph | False |
| memray | False |
| no_sleep | False |
| tests | False |
| show_worker_percentage_table_at_end | False |
| auto_exclude_defective_hosts | True |
| run_tests_that_fail_on_taurus | False |
| raise_in_eval | False |
| show_ram_every_n_seconds | 0 |
| show_generation_and_submission_sixel | False |
| just_return_defaults | False |
| prettyprint | False |
| runtime_debug | False |
| debug_stack_regex | |
| debug_stack_trace_regex | None |
| show_func_name | False |
| beartype | True |
This logs the CPU and RAM usage of the main worker process.
timestamp,ram_usage_mb,cpu_usage_percent
1778373741,771.69140625,26.9
Parameter statistics
| Parameter | Min | Max | Mean | Std Dev | Count |
|---|
| run_time | 12 | 12 | 12 | 0 | 2 |
| RESULT1 | 1.1128 | 1.8542 | 1.4835 | 0.3707 | 2 |
| RESULT2 | 2.1636 | 2.4348 | 2.2992 | 0.1356 | 2 |
| int_param | -61 | -2 | -31.5 | 29.5 | 2 |
| float_param | -77.8563 | -31.8977 | -54.877 | 22.9793 | 2 |
| int_param_two | -92 | 4 | -44 | 48 | 2 |
| choice_param | 1 | 16 | 8.5 | 7.5 | 2 |
Show SLURM-Job-ID (if it exists)
submitit INFO (2026-05-10 00:42:23,888) - Starting with JobEnvironment(job_id=72663, hostname=runnervmeorf1, local_rank=0(1), node=0(1), global_rank=0(1))
submitit INFO (2026-05-10 00:42:23,888) - Loading pickle: /home/runner/work/OmniOpt/OmniOpt/runs/multiple_evals_per_arm/0/single_runs/72663/72663_submitted.pkl
Trial-Index: 0
Running 2 sub-evaluations for trial 0...
Sub-eval 1/2 for trial 0: {'RESULT1': 1.76643264720133, 'RESULT2': 2.03351387367317}
OO-Info: int_param: -2
OO-Info: int_param_two: -92
OO-Info: float_param: -77.8562596440315246582
OO-Info: choice_param: 1
RESULT1: 1.76643264720133
RESULT2: 2.03351387367317
Sub-eval 2/2 for trial 0: {'RESULT1': 1.94191461599349, 'RESULT2': 2.29370445022093}
OO-Info: int_param: -2
OO-Info: int_param_two: -92
OO-Info: float_param: -77.8562596440315246582
OO-Info: choice_param: 1
RESULT1: 1.94191461599349
RESULT2: 2.29370445022093
Aggregated result for trial 0: RESULT1: 1.854174 (SEM: 0.087741), RESULT2: 2.163609 (SEM: 0.130095)
submitit INFO (2026-05-10 00:42:37,392) - Job completed successfully
submitit INFO (2026-05-10 00:42:37,392) - Exiting after successful completion
