Experiment overview
| Setting | Value |
|---|
| Model for non-random steps | BOTORCH_MODULAR |
| Max. nr. evaluations | 4 |
| Number random steps | 2 |
| Nr. of workers (parameter) | 4 |
Best RESULT, min (total: 4)
| a | b | RESULT |
|---|
| 14.849792239049643 | 49.63893655299804 | 64.4887287920477 |
Job Summary per Generation Node
| Generation Node | Total | COMPLETED |
| SOBOL | 2 | 2 |
| BOTORCH_MODULAR | 2 | 2 |
Experiment parameters
| Name | Type | Lower bound | Upper bound | Type | Log Scale? |
|---|
| a | range | 5 | 100 | float | No |
| b | range | 5 | 100 | float | No |
Number of evaluations
| Failed |
Succeeded |
Running |
Total |
| 0 |
4 |
0 |
4 |
Result names and types
Last progressbar status
2025-11-04 19:10:39 (32c7b466-2fa1-4f68-ad38-59bd9c314535): BOTORCH_MODULAR, best RESULT: 64.4887287920477, finishing jobs, finished 1 job
Git-Version
Commit: c955bd1d9501575813a68affecbc1a05d9ab35ef (9069-3-gc955bd1d9)
trial_index,submit_time,queue_time,worker_generator_uuid,start_time,end_time,run_time,program_string,exit_code,signal,hostname,arm_name,trial_status,generation_node,RESULT,a,b
0,1762283394,2,32c7b466-2fa1-4f68-ad38-59bd9c314535,1762283396,1762283402,6,perl -e 'print "RESULT: " . (8.3752085268497467041 + 60.50131261348724365234)',0,,runnervmxu1zt,0_0,COMPLETED,SOBOL,68.876521140299999501621641684324,8.3752085268497467041015625,60.50131261348724365234375
1,1762283405,2,32c7b466-2fa1-4f68-ad38-59bd9c314535,1762283407,1762283413,6,perl -e 'print "RESULT: " . (53.1997404247522354126 + 18.50300468038767576218)',0,,runnervmxu1zt,1_0,COMPLETED,SOBOL,71.702745105100007094733882695436,53.19974042475223541259765625,18.503004680387675762176513671875
2,1762283416,2,32c7b466-2fa1-4f68-ad38-59bd9c314535,1762283418,1762283424,6,perl -e 'print "RESULT: " . (5 + 85.52372627493274137578)',0,,runnervmxu1zt,2_0,COMPLETED,BOTORCH_MODULAR,90.523726274899999566514452453703,5,85.523726274932741375778277870268
3,1762283428,2,32c7b466-2fa1-4f68-ad38-59bd9c314535,1762283430,1762283436,6,perl -e 'print "RESULT: " . (14.84979223904964307224 + 49.63893655299803953085)',0,,runnervmxu1zt,3_0,COMPLETED,BOTORCH_MODULAR,64.488728792047695037581434007734,14.849792239049643072235085128341,49.63893655299803953084847307764
========================================================================
Current git-hash: c955bd1d9501575813a68affecbc1a05d9ab35ef (last fully tested stable version 3 commits ago [7a7a36b0d71c0f21242cd3e193c84e6375482517, 9069])
Using coverage run -p because $RUN_WITH_COVERAGE is set
[WARNING 11-04 19:09:49] ax.service.utils.with_db_settings_base: Ax currently requires a sqlalchemy version below 2.0. This will be addressed in a future release. Disabling SQL storage in Ax for now, if you would like to use SQL storage please install Ax with mysql extras via `pip install ax-platform[mysql]`.
Run-UUID: a1618ae0-e869-47b9-8097-56aa2cc5b517
_________________________________________________
/ \
| OmniOpt2 - Hyperparameter tuning: The philosopher |
| ’s stone of deep learning. |
\ /
=================================================
\
\
\
\
___-------___
_-~~ ~~-_
_-~ /~-_
/^\__/^\ /~ \ / \
/| O|| O| / \_______________/ \
| |___||__| / / \ \
| \ / / \ \
| (_______) /______/ \_________ \
| / / \ / \
\ \^\\ \ / \ /
\ || \______________/ _-_ //\__//
\ ||------_-~~-_ ------------- \ --/~ ~\ || __/
~-----||====/~ |==================| |/~~~~~
(_(__/ ./ / \_\ \.
(_(___/ \_____)_)
omniopt --partition=alpha --experiment_name=multiplication_constraint --mem_gb=10 --time=60 --worker_timeout=60 --max_eval=4 --num_parallel_jobs=4 --gpus=0 --num_random_steps=2 --follow --live_share --send_anonymized_usage_stats --result_names RESULT=min --run_program=cGVybCAtZSAncHJpbnQgIlJFU1VMVDogIiAuICglYSArICViKSc= --cpus_per_task=1 --nodes_per_job=1 --generate_all_jobs_at_once --revert_to_random_when_seemingly_exhausted --model=BOTORCH_MODULAR --n_estimators_randomforest=100 --run_mode=local --occ_type=euclid --main_process_gb=8 --max_nr_of_zero_results=50 --slurm_signal_delay_s=0 --max_failed_jobs=0 --parameter a range 5 100 float false --parameter b range 5 100 float false --experiment_constraints YSAqIGIgPj0gMTA=
Run-folder: /home/runner/work/OmniOpt/OmniOpt/runs/multiplication_constraint/0
See https://imageseg.scads.de/omniax/share?user_id=runner&experiment_name=multiplication_constraint&run_nr=77 for live-results.
You have 4 CPUs available for the main process. No CUDA devices found.
Generation strategy: SOBOL for 2 steps and then BOTORCH_MODULAR for 2 steps.
Run-Program: perl -e 'print "RESULT: " . (%a + %b)'
Experiment parameters
┏━━━━━━┳━━━━━━━┳━━━━━━━━━━━━━┳━━━━━━━━━━━━━┳━━━━━━━┳━━━━━━━━━━━━┓
┃ Name ┃ Type ┃ Lower bound ┃ Upper bound ┃ Type ┃ Log Scale? ┃
┡━━━━━━╇━━━━━━━╇━━━━━━━━━━━━━╇━━━━━━━━━━━━━╇━━━━━━━╇━━━━━━━━━━━━┩
│ a │ range │ 5 │ 100 │ float │ No │
│ b │ range │ 5 │ 100 │ float │ No │
└──────┴───────┴─────────────┴─────────────┴───────┴────────────┘
┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┓
┃ Post-Generation-Constraints ┃
┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┩
│ a * b >= 10 │
└─────────────────────────────┘
Result-Names
┏━━━━━━━━━━━━━┳━━━━━━━━━━━━━┓
┃ Result-Name ┃ Min or max? ┃
┡━━━━━━━━━━━━━╇━━━━━━━━━━━━━┩
│ RESULT │ min │
└─────────────┴─────────────┘
Failed Jobs parameters
┏━━━━━━━━┳━━━━━━━━┳━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┓
┃ param1 ┃ param2 ┃ param3 ┃ error_description ┃
┡━━━━━━━━╇━━━━━━━━╇━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┩
│ value1 │ value2 │ value3 │ Some error occurred during execution (this is not a real error!). │
└────────┴────────┴────────┴───────────────────────────────────────────────────────────────────┘
Best RESULT, min (total: 4)
┏━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━┓
┃ a ┃ b ┃ RESULT ┃
┡━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━┩
│ 14.849792239049643 │ 49.63893655299804 │ 64.4887287920477 │
└────────────────────┴───────────────────┴──────────────────┘
Not printing sixel graphics in CI
Runtime Infos
┏━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━┳━━━━━━━━━━━┳━━━━━━━━━━━━━━┳━━━━━━━━━━━━━┓
┃ Number of evaluations ┃ Min time ┃ Max time ┃ Average time ┃ Median time ┃
┡━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━╇━━━━━━━━━━━╇━━━━━━━━━━━━━━╇━━━━━━━━━━━━━┩
│ 4 │ 6.00 sec │ 6.00 sec │ 6.00 sec │ 6.00 sec │
└───────────────────────┴───────────┴───────────┴──────────────┴─────────────┘
2025-11-04 19:09:54 (32c7b466-2fa1-4f68-ad38-59bd9c314535): SOBOL, Started OmniOpt2 run...
2025-11-04 19:09:54 (32c7b466-2fa1-4f68-ad38-59bd9c314535): SOBOL, getting new HP set (no sbatch)
2025-11-04 19:09:54 (32c7b466-2fa1-4f68-ad38-59bd9c314535): SOBOL, requested 1 jobs, got 1, 0.01 s/job
2025-11-04 19:09:54 (32c7b466-2fa1-4f68-ad38-59bd9c314535): SOBOL, eval #1/1 start
2025-11-04 19:09:54 (32c7b466-2fa1-4f68-ad38-59bd9c314535): SOBOL, starting new job
2025-11-04 19:09:54 (32c7b466-2fa1-4f68-ad38-59bd9c314535): SOBOL, started new job
2025-11-04 19:10:03 (32c7b466-2fa1-4f68-ad38-59bd9c314535): SOBOL, new result: RESULT: 68.876521
2025-11-04 19:10:05 (32c7b466-2fa1-4f68-ad38-59bd9c314535): SOBOL, best RESULT: 68.876521140337, finishing jobs, finished 1 job
2025-11-04 19:10:05 (32c7b466-2fa1-4f68-ad38-59bd9c314535): SOBOL, best RESULT: 68.876521140337, getting new HP set (no sbatch)
2025-11-04 19:10:05 (32c7b466-2fa1-4f68-ad38-59bd9c314535): SOBOL, best RESULT: 68.876521140337, requested 1 jobs, got 1, 0.03 s/job
2025-11-04 19:10:05 (32c7b466-2fa1-4f68-ad38-59bd9c314535): SOBOL, best RESULT: 68.876521140337, eval #1/1 start
2025-11-04 19:10:05 (32c7b466-2fa1-4f68-ad38-59bd9c314535): SOBOL, best RESULT: 68.876521140337, starting new job
2025-11-04 19:10:05 (32c7b466-2fa1-4f68-ad38-59bd9c314535): SOBOL, best RESULT: 68.876521140337, started new job
2025-11-04 19:10:14 (32c7b466-2fa1-4f68-ad38-59bd9c314535): SOBOL, best RESULT: 68.876521140337, new result: RESULT: 71.702745
2025-11-04 19:10:16 (32c7b466-2fa1-4f68-ad38-59bd9c314535): SOBOL, best RESULT: 68.8765211403, finishing jobs, finished 1 job
2025-11-04 19:10:16 (32c7b466-2fa1-4f68-ad38-59bd9c314535): BOTORCH_MODULAR, best RESULT: 68.8765211403, getting new HP set (no sbatch)
2025-11-04 19:10:16 (32c7b466-2fa1-4f68-ad38-59bd9c314535): BOTORCH_MODULAR, best RESULT: 68.8765211403, requested 1 jobs, got 1, 0.59 s/job
2025-11-04 19:10:16 (32c7b466-2fa1-4f68-ad38-59bd9c314535): BOTORCH_MODULAR, best RESULT: 68.8765211403, eval #1/1 start
2025-11-04 19:10:16 (32c7b466-2fa1-4f68-ad38-59bd9c314535): BOTORCH_MODULAR, best RESULT: 68.8765211403, starting new job
2025-11-04 19:10:16 (32c7b466-2fa1-4f68-ad38-59bd9c314535): BOTORCH_MODULAR, best RESULT: 68.8765211403, started new job
2025-11-04 19:10:25 (32c7b466-2fa1-4f68-ad38-59bd9c314535): BOTORCH_MODULAR, best RESULT: 68.8765211403, new result: RESULT: 90.523726
2025-11-04 19:10:28 (32c7b466-2fa1-4f68-ad38-59bd9c314535): BOTORCH_MODULAR, best RESULT: 68.8765211403, finishing jobs, finished 1 job
2025-11-04 19:10:28 (32c7b466-2fa1-4f68-ad38-59bd9c314535): BOTORCH_MODULAR, best RESULT: 68.8765211403, getting new HP set (no sbatch)
2025-11-04 19:10:28 (32c7b466-2fa1-4f68-ad38-59bd9c314535): BOTORCH_MODULAR, best RESULT: 68.8765211403, requested 1 jobs, got 1, 0.70 s/job
2025-11-04 19:10:28 (32c7b466-2fa1-4f68-ad38-59bd9c314535): BOTORCH_MODULAR, best RESULT: 68.8765211403, eval #1/1 start
2025-11-04 19:10:28 (32c7b466-2fa1-4f68-ad38-59bd9c314535): BOTORCH_MODULAR, best RESULT: 68.8765211403, starting new job
2025-11-04 19:10:28 (32c7b466-2fa1-4f68-ad38-59bd9c314535): BOTORCH_MODULAR, best RESULT: 68.8765211403, started new job
2025-11-04 19:10:37 (32c7b466-2fa1-4f68-ad38-59bd9c314535): BOTORCH_MODULAR, best RESULT: 68.8765211403, new result: RESULT: 64.488729
2025-11-04 19:10:39 (32c7b466-2fa1-4f68-ad38-59bd9c314535): BOTORCH_MODULAR, best RESULT: 64.4887287920477, finishing jobs, finished 1 job
Job submission durations
┏━━━━━━━━━┳━━━━━━━━━┳━━━━━━┳━━━━━━━━━━━━━━┓
┃ Batch ┃ Seconds ┃ Jobs ┃ Time per job ┃
┡━━━━━━━━━╇━━━━━━━━━╇━━━━━━╇━━━━━━━━━━━━━━┩
│ 1 │ 0.095 │ 1 │ 0.095 │
│ 2 │ 0.063 │ 1 │ 0.063 │
│ 3 │ 0.065 │ 1 │ 0.065 │
│ 4 │ 0.063 │ 1 │ 0.063 │
├─────────┼─────────┼──────┼──────────────┤
│ Average │ 0.071 │ │ │
│ Median │ 0.064 │ │ │
│ Total │ 0.286 │ │ │
│ Max │ 0.095 │ │ │
│ Min │ 0.063 │ │ │
└─────────┴─────────┴──────┴──────────────┘
Model generation times
┏━━━━━━━━━━━┳━━━━━━━━━┳━━━━━━┳━━━━━━━━━━━━━━┓
┃ Iteration ┃ Seconds ┃ Jobs ┃ Time per job ┃
┡━━━━━━━━━━━╇━━━━━━━━━╇━━━━━━╇━━━━━━━━━━━━━━┩
│ 1 │ 0.008 │ 1 │ 0.008 │
│ 2 │ 0.034 │ 1 │ 0.034 │
│ 3 │ 0.586 │ 1 │ 0.586 │
│ 4 │ 0.704 │ 1 │ 0.704 │
├───────────┼─────────┼──────┼──────────────┤
│ Average │ 0.333 │ │ │
│ Median │ 0.310 │ │ │
│ Total │ 1.332 │ │ │
│ Max │ 0.704 │ │ │
│ Min │ 0.008 │ │ │
└───────────┴─────────┴──────┴──────────────┘
Arguments Overview
| Key | Value |
|---|
| config_yaml | None |
| config_toml | None |
| config_json | None |
| num_random_steps | 2 |
| max_eval | 4 |
| run_program | [['cGVybCAtZSAncHJpbnQgIlJFU1VMVDogIiAuICglYSArICViKSc=']] |
| experiment_name | multiplication_constraint |
| mem_gb | 10 |
| parameter | [['a', 'range', '5', '100', 'float', 'false'], ['b', 'range', '5', '100', 'float', 'false']] |
| continue_previous_job | None |
| experiment_constraints | [['YSAqIGIgPj0gMTA=']] |
| run_dir | runs |
| seed | None |
| verbose_tqdm | False |
| model | BOTORCH_MODULAR |
| gridsearch | False |
| occ | False |
| show_sixel_scatter | False |
| show_sixel_general | False |
| show_sixel_trial_index_result | False |
| follow | True |
| send_anonymized_usage_stats | True |
| ui_url | None |
| root_venv_dir | /home/runner |
| exclude | None |
| main_process_gb | 8 |
| max_nr_of_zero_results | 50 |
| abbreviate_job_names | False |
| orchestrator_file | None |
| checkout_to_latest_tested_version | False |
| live_share | True |
| disable_tqdm | False |
| disable_previous_job_constraint | False |
| workdir | |
| occ_type | euclid |
| result_names | ['RESULT=min'] |
| minkowski_p | 2 |
| signed_weighted_euclidean_weights | |
| generation_strategy | None |
| generate_all_jobs_at_once | True |
| revert_to_random_when_seemingly_exhausted | True |
| load_data_from_existing_jobs | [] |
| n_estimators_randomforest | 100 |
| max_attempts_for_generation | 20 |
| external_generator | None |
| username | None |
| max_failed_jobs | 0 |
| num_cpus_main_job | None |
| calculate_pareto_front_of_job | [] |
| show_generate_time_table | False |
| force_choice_for_ranges | False |
| max_abandoned_retrial | 20 |
| share_password | None |
| dryrun | False |
| db_url | None |
| run_program_once | None |
| worker_generator_path | None |
| save_to_database | False |
| range_max_difference | 1000000 |
| skip_search | False |
| dont_warm_start_refitting | False |
| refit_on_cv | False |
| fit_out_of_design | False |
| fit_abandoned | False |
| dont_jit_compile | False |
| num_restarts | 20 |
| raw_samples | 1024 |
| max_num_of_parallel_sruns | 16 |
| no_transform_inputs | False |
| no_normalize_y | False |
| transforms | [] |
| number_of_generators | 1 |
| num_parallel_jobs | 4 |
| worker_timeout | 60 |
| slurm_use_srun | False |
| time | 60 |
| partition | alpha |
| reservation | None |
| force_local_execution | False |
| slurm_signal_delay_s | 0 |
| nodes_per_job | 1 |
| cpus_per_task | 1 |
| account | None |
| gpus | 0 |
| dependency | None |
| run_mode | local |
| verbose | False |
| verbose_break_run_search_table | False |
| debug | False |
| flame_graph | False |
| memray | False |
| no_sleep | False |
| tests | False |
| show_worker_percentage_table_at_end | False |
| auto_exclude_defective_hosts | False |
| run_tests_that_fail_on_taurus | False |
| raise_in_eval | False |
| show_ram_every_n_seconds | 0 |
| show_generation_and_submission_sixel | False |
| just_return_defaults | False |
| prettyprint | False |
| runtime_debug | False |
| debug_stack_regex | |
| debug_stack_trace_regex | None |
| show_func_name | False |
| beartype | False |
This logs the CPU and RAM usage of the main worker process.
timestamp,ram_usage_mb,cpu_usage_percent
1762283390,749.546875,28.8
RESULT (goal: minimize)
Best value: 64.488728792048
Achieved at:
- run_time = 6
- a = 14.84979223905
- b = 49.638936552998
Parameter statistics
| Parameter | Min | Max | Mean | Std Dev | Count |
|---|
| run_time | 6 | 6 | 6 | 0 | 4 |
| RESULT | 64.4887 | 90.5237 | 73.8979 | 9.9371 | 4 |
| a | 5 | 53.1997 | 20.3562 | 19.2897 | 4 |
| b | 18.503 | 85.5237 | 53.5417 | 24.0532 | 4 |
Show SLURM-Job-ID (if it exists)