Experiment overview
| Setting | Value |
|---|
| Max. nr. evaluations | 2 |
| Number random steps | 2 |
| Number random steps (from arguments) | 20 |
| Nr. of workers (parameter) | 20 |
Best RESULT, min (total: 2)
| OO_Info_int_param | OO_Info_int_param_two | OO_Info_float_param | OO_Info_choice_param | int_param | float_param | int_param_two | choice_param | RESULT |
|---|
| -40 | -79 | -83.71261060237885 | hallo | -40 | -83.71261060237885 | -79 | hallo | -169278.592798893 |
Job Summary per Generation Node
| Generation Node | Total | COMPLETED |
|---|
| SOBOL | 2 | 2 |
Experiment parameters
| Name | Type | Lower bound | Upper bound | Values | Type | Log Scale? |
|---|
| int_param | range | -100 | 10 | | int | No |
| float_param | range | -100 | 10 | | float | No |
| choice_param | choice | | | 1, 2, 4, 8, 16, hallo | | |
| int_param_two | range | -100 | 10 | | int | No |
Number of evaluations
| Failed |
Succeeded |
Running |
Total |
| 0 |
2 |
0 |
2 |
Result names and types
Last progressbar status
2025-11-12 21:30:47 (ab0e99c2-2b36-431f-b34d-54b717efa27c): SOBOL, best RESULT: -169278.592798893, finishing jobs, finished 1 job
Git-Version
Commit: 3ec5638cb1f0bc5d7c3e2c4fbff92d92c23a3902 (9077-3-g3ec5638cb)
trial_index,submit_time,queue_time,worker_generator_uuid,start_time,end_time,run_time,program_string,exit_code,signal,hostname,OO_Info_int_param,OO_Info_int_param_two,OO_Info_float_param,OO_Info_choice_param,arm_name,trial_status,generation_node,RESULT,int_param,float_param,int_param_two,choice_param
0,1762983023,3,ab0e99c2-2b36-431f-b34d-54b717efa27c,1762983026,1762983032,6,./.tests/optimization_example --int_param='-40' --float_param='-83.71261060237884521484' --choice_param='hallo' --int_param_two='-79',0,,runnervmw9dnm,-40,-79,-83.71261060237884521484375,hallo,0_0,COMPLETED,SOBOL,-169278.592798892990685999393463134766,-40,-83.71261060237884521484375,-79,hallo
1,1762983035,2,ab0e99c2-2b36-431f-b34d-54b717efa27c,1762983037,1762983043,6,./.tests/optimization_example --int_param='-74' --float_param='-16.38967362232506275177' --choice_param='4' --int_param_two='-28',0,,runnervmw9dnm,-74,-28,-16.38967362232506275177001953125,4,1_0,COMPLETED,SOBOL,-77958.501376695901853963732719421387,-74,-16.38967362232506275177001953125,-28,4
========================================================================
Current git-hash: 3ec5638cb1f0bc5d7c3e2c4fbff92d92c23a3902 (last fully tested stable version 3 commits ago [c469e04d3b6be6a64610427ed0a7f1562b9a4eae, 9077])
Using coverage run -p because $RUN_WITH_COVERAGE is set
[WARNING 11-12 21:30:18] ax.service.utils.with_db_settings_base: Ax currently requires a sqlalchemy version below 2.0. This will be addressed in a future release. Disabling SQL storage in Ax for now, if you would like to use SQL storage please install Ax with mysql extras via `pip install ax-platform[mysql]`.
Run-UUID: 3c5b6037-e414-41f4-bd87-4b1e09951b3a
_________________________________________________
/ \
| OmniOpt2 - Exploring parameter space like a ninja |
| in a maze. |
\ /
=================================================
\
\
\
\
.-=-==--==--.
..-==" ,'o`) `.
,' `"' \
: ( `.__...._
| ) / `-=-.
: ,vv.-._ / / `---==-._
\/\/\/VV ^ d88`;' / `.
`` ^/d88P!' / , `._
^/ !' ,. , / "-,,__,,--'""""-.
^/ !' ,' \ . .( ( _ ) ) ) ) ))_,-.\
^(__ ,!',"' ;:+.:%:a. \:.. . ,' ) ) ) ) ,"' '
',,,'',' /o:::":%:%a. \:.:.: . ) ) _,'
"""' ;':::'' `+%%%a._ \%:%| ;.). _,-""
,-='_.-' ``:%::) )%:| /:._,"
(/(/" ," ,'_,'%%%: (_,'
( (//(`.___; \
\ \ ` `
`. `. `. :
\. . .\ : . . . :
\. . .: `.. . .:
`..:.:\ \:...\
;:.:.; ::...:
):%:: :::::;
__,::%:( :::::
,;:%%%%%%%: ;:%::
;,--""-.`\ ,=--':%:%:\
/" "| /-".:%%%%%%%\
;,-"'`)%%)
/" "|
omniopt --config_yaml=.tests/example_config_cpu.yaml --follow
Run-folder: /home/runner/work/OmniOpt/OmniOpt/runs/__main__tests__/1
You have less --max_eval 2 than --num_random_steps 20. Switched both.
See https://imageseg.scads.de/omniax/share?user_id=runner&experiment_name=__main__tests__&run_nr=292 for live-results.
You have 4 CPUs available for the main process. No CUDA devices found.
Generation strategy: SOBOL for 2 steps.
Run-Program: ./.tests/optimization_example --int_param='%(int_param)' --float_param='%(float_param)' --choice_param='%(choice_param)' --int_param_two='%(int_param_two)'
Experiment parameters
┏━━━━━━━━━━━━━━━┳━━━━━━━━┳━━━━━━━━━━━━━┳━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━┳━━━━━━━━━━━━┓
┃ Name ┃ Type ┃ Lower bound ┃ Upper bound ┃ Values ┃ Type ┃ Log Scale? ┃
┡━━━━━━━━━━━━━━━╇━━━━━━━━╇━━━━━━━━━━━━━╇━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━╇━━━━━━━━━━━━┩
│ int_param │ range │ -100 │ 10 │ │ int │ No │
│ float_param │ range │ -100 │ 10 │ │ float │ No │
│ choice_param │ choice │ │ │ 1, 2, 4, 8, 16, hallo │ │ │
│ int_param_two │ range │ -100 │ 10 │ │ int │ No │
└───────────────┴────────┴─────────────┴─────────────┴───────────────────────┴───────┴────────────┘
Result-Names
┏━━━━━━━━━━━━━┳━━━━━━━━━━━━━┓
┃ Result-Name ┃ Min or max? ┃
┡━━━━━━━━━━━━━╇━━━━━━━━━━━━━┩
│ RESULT │ min │
└─────────────┴─────────────┘
Failed Jobs parameters
┏━━━━━━━━┳━━━━━━━━┳━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┓
┃ param1 ┃ param2 ┃ param3 ┃ error_description ┃
┡━━━━━━━━╇━━━━━━━━╇━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┩
│ value1 │ value2 │ value3 │ Some error occurred during execution (this is not a real error!). │
└────────┴────────┴────────┴───────────────────────────────────────────────────────────────────┘
Best RESULT, min (total: 2)
┏━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━┓
┃ OO_Info_int_param ┃ OO_Info_int_param_two ┃ OO_Info_float_param ┃ OO_Info_choice_param ┃ int_param ┃ float_param ┃ int_param_two ┃ choice_param ┃ RESULT ┃
┡━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━┩
│ -40 │ -79 │ -83.71261060237885 │ hallo │ -40 │ -83.71261060237885 │ -79 │ hallo │ -169278.592798893 │
└───────────────────┴───────────────────────┴─────────────────────┴──────────────────────┴───────────┴────────────────────┴───────────────┴──────────────┴───────────────────┘
Not printing sixel graphics in CI
Runtime Infos
┏━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━┳━━━━━━━━━━━┳━━━━━━━━━━━━━━┳━━━━━━━━━━━━━┓
┃ Number of evaluations ┃ Min time ┃ Max time ┃ Average time ┃ Median time ┃
┡━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━╇━━━━━━━━━━━╇━━━━━━━━━━━━━━╇━━━━━━━━━━━━━┩
│ 2 │ 6.00 sec │ 6.00 sec │ 6.00 sec │ 6.00 sec │
└───────────────────────┴───────────┴───────────┴──────────────┴─────────────┘
2025-11-12 21:30:23 (ab0e99c2-2b36-431f-b34d-54b717efa27c): SOBOL, Started OmniOpt2 run...
2025-11-12 21:30:23 (ab0e99c2-2b36-431f-b34d-54b717efa27c): SOBOL, getting new HP set (no sbatch)
2025-11-12 21:30:23 (ab0e99c2-2b36-431f-b34d-54b717efa27c): SOBOL, requested 1 jobs, got 1, 0.02 s/job
2025-11-12 21:30:23 (ab0e99c2-2b36-431f-b34d-54b717efa27c): SOBOL, eval #1/1 start
2025-11-12 21:30:23 (ab0e99c2-2b36-431f-b34d-54b717efa27c): SOBOL, starting new job
2025-11-12 21:30:24 (ab0e99c2-2b36-431f-b34d-54b717efa27c): SOBOL, started new job
2025-11-12 21:30:33 (ab0e99c2-2b36-431f-b34d-54b717efa27c): SOBOL, new result: RESULT: -169278.592799
2025-11-12 21:30:35 (ab0e99c2-2b36-431f-b34d-54b717efa27c): SOBOL, best RESULT: -169278.592798893, finishing jobs, finished 1 job
2025-11-12 21:30:35 (ab0e99c2-2b36-431f-b34d-54b717efa27c): SOBOL, best RESULT: -169278.592798893, getting new HP set (no sbatch)
2025-11-12 21:30:35 (ab0e99c2-2b36-431f-b34d-54b717efa27c): SOBOL, best RESULT: -169278.592798893, requested 1 jobs, got 1, 0.07 s/job
2025-11-12 21:30:35 (ab0e99c2-2b36-431f-b34d-54b717efa27c): SOBOL, best RESULT: -169278.592798893, eval #1/1 start
2025-11-12 21:30:35 (ab0e99c2-2b36-431f-b34d-54b717efa27c): SOBOL, best RESULT: -169278.592798893, starting new job
2025-11-12 21:30:35 (ab0e99c2-2b36-431f-b34d-54b717efa27c): SOBOL, best RESULT: -169278.592798893, started new job
2025-11-12 21:30:44 (ab0e99c2-2b36-431f-b34d-54b717efa27c): SOBOL, best RESULT: -169278.592798893, new result: RESULT: -77958.501377
2025-11-12 21:30:47 (ab0e99c2-2b36-431f-b34d-54b717efa27c): SOBOL, best RESULT: -169278.592798893, finishing jobs, finished 1 job
Job submission durations
┏━━━━━━━━━┳━━━━━━━━━┳━━━━━━┳━━━━━━━━━━━━━━┓
┃ Batch ┃ Seconds ┃ Jobs ┃ Time per job ┃
┡━━━━━━━━━╇━━━━━━━━━╇━━━━━━╇━━━━━━━━━━━━━━┩
│ 1 │ 0.237 │ 1 │ 0.237 │
│ 2 │ 0.090 │ 1 │ 0.090 │
├─────────┼─────────┼──────┼──────────────┤
│ Average │ 0.164 │ │ │
│ Median │ 0.164 │ │ │
│ Total │ 0.327 │ │ │
│ Max │ 0.237 │ │ │
│ Min │ 0.090 │ │ │
└─────────┴─────────┴──────┴──────────────┘
Model generation times
┏━━━━━━━━━━━┳━━━━━━━━━┳━━━━━━┳━━━━━━━━━━━━━━┓
┃ Iteration ┃ Seconds ┃ Jobs ┃ Time per job ┃
┡━━━━━━━━━━━╇━━━━━━━━━╇━━━━━━╇━━━━━━━━━━━━━━┩
│ 1 │ 0.016 │ 1 │ 0.016 │
│ 2 │ 0.066 │ 1 │ 0.066 │
├───────────┼─────────┼──────┼──────────────┤
│ Average │ 0.041 │ │ │
│ Median │ 0.041 │ │ │
│ Total │ 0.082 │ │ │
│ Max │ 0.066 │ │ │
│ Min │ 0.016 │ │ │
└───────────┴─────────┴──────┴──────────────┘
Arguments Overview
| Key | Value |
|---|
| config_yaml | .tests/example_config_cpu.yaml |
| config_toml | None |
| config_json | None |
| num_random_steps | 20 |
| max_eval | 2 |
| run_program | ./.tests/optimization_example --int_param='%(int_param)' --float_param='%(float_param)' --choice_param='%(choice_param)' |
| --int_param_two='%(int_param_two)' |
| experiment_name | __main__tests__ |
| mem_gb | 4 |
| parameter | [{'param': ['int_param', 'range', '-100', '10', 'int']}, {'param': ['float_param', 'range', '-100', '10', 'float']}, {'param': ['choice_param', |
| 'choice', '1,2,4,8,16,hallo']}, {'param': ['int_param_two', 'range', '-100', '10', 'int'], 'num_random_steps': 1, 'model': 'BOTORCH_MODULAR', |
| 'auto_exclude_defective_hosts': True}] |
| continue_previous_job | None |
| experiment_constraints | None |
| run_dir | runs |
| seed | None |
| verbose_tqdm | False |
| model | None |
| gridsearch | False |
| occ | False |
| show_sixel_scatter | False |
| show_sixel_general | False |
| show_sixel_trial_index_result | False |
| follow | True |
| send_anonymized_usage_stats | False |
| ui_url | None |
| root_venv_dir | /home/runner |
| exclude | None |
| main_process_gb | 8 |
| max_nr_of_zero_results | 10 |
| abbreviate_job_names | False |
| orchestrator_file | None |
| checkout_to_latest_tested_version | False |
| live_share | True |
| disable_tqdm | False |
| disable_previous_job_constraint | False |
| workdir | |
| occ_type | euclid |
| result_names | ['RESULT=min'] |
| minkowski_p | 2 |
| signed_weighted_euclidean_weights | |
| generation_strategy | None |
| generate_all_jobs_at_once | True |
| revert_to_random_when_seemingly_exhausted | False |
| load_data_from_existing_jobs | [] |
| n_estimators_randomforest | 100 |
| max_attempts_for_generation | 20 |
| external_generator | None |
| username | None |
| max_failed_jobs | None |
| num_cpus_main_job | None |
| calculate_pareto_front_of_job | [] |
| show_generate_time_table | False |
| force_choice_for_ranges | False |
| max_abandoned_retrial | 20 |
| share_password | None |
| dryrun | False |
| db_url | None |
| run_program_once | None |
| worker_generator_path | None |
| save_to_database | False |
| range_max_difference | 1000000 |
| skip_search | False |
| dont_warm_start_refitting | False |
| refit_on_cv | False |
| fit_out_of_design | False |
| fit_abandoned | False |
| dont_jit_compile | False |
| num_restarts | 20 |
| raw_samples | 1024 |
| max_num_of_parallel_sruns | 16 |
| no_transform_inputs | False |
| no_normalize_y | False |
| transforms | [] |
| number_of_generators | 1 |
| num_parallel_jobs | 20 |
| worker_timeout | 5 |
| slurm_use_srun | False |
| time | 60 |
| partition | alpha |
| reservation | None |
| force_local_execution | False |
| slurm_signal_delay_s | 0 |
| nodes_per_job | 1 |
| cpus_per_task | 1 |
| account | None |
| gpus | 0 |
| dependency | None |
| run_mode | local |
| verbose | False |
| verbose_break_run_search_table | False |
| debug | False |
| flame_graph | False |
| memray | False |
| no_sleep | False |
| tests | False |
| show_worker_percentage_table_at_end | False |
| auto_exclude_defective_hosts | False |
| run_tests_that_fail_on_taurus | False |
| raise_in_eval | False |
| show_ram_every_n_seconds | 0 |
| show_generation_and_submission_sixel | False |
| just_return_defaults | False |
| prettyprint | False |
| runtime_debug | False |
| debug_stack_regex | |
| debug_stack_trace_regex | None |
| show_func_name | False |
| beartype | False |
This logs the CPU and RAM usage of the main worker process.
timestamp,ram_usage_mb,cpu_usage_percent
1762983019,775.80078125,27.1
Parameter statistics
| Parameter | Min | Max | Mean | Std Dev | Count |
|---|
| run_time | 6 | 6 | 6 | 0 | 2 |
| OO_Info_int_param | -74 | -40 | -57 | 17 | 2 |
| OO_Info_int_param_two | -79 | -28 | -53.5 | 25.5 | 2 |
| OO_Info_float_param | -83.7126 | -16.3897 | -50.0511 | 33.6615 | 2 |
| OO_Info_choice_param | No numerical statistics available |
| RESULT | -169278.5928 | -77958.5014 | -123618.5471 | 45660.0457 | 2 |
| int_param | -74 | -40 | -57 | 17 | 2 |
| float_param | -83.7126 | -16.3897 | -50.0511 | 33.6615 | 2 |
| int_param_two | -79 | -28 | -53.5 | 25.5 | 2 |
| choice_param | No numerical statistics available |
Show SLURM-Job-ID (if it exists)
/home/runner/.omniax_venvs/Python_3.12.3/x86_64/lib/python3.12/site-packages/submitit/core/plugins.py:24: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
import pkg_resources
submitit INFO (2025-11-12 21:30:24,494) - Starting with JobEnvironment(job_id=109399, hostname=runnervmw9dnm, local_rank=0(1), node=0(1), global_rank=0(1))
submitit INFO (2025-11-12 21:30:24,494) - Loading pickle: /home/runner/work/OmniOpt/OmniOpt/runs/__main__tests__/1/single_runs/109399/109399_submitted.pkl
Trial-Index: 0
Parameters: {"int_param": -40, "float_param": -83.71261060237885, "int_param_two": -79, "choice_param": "hallo"}
Debug-Infos:
========
DEBUG INFOS START:
Program-Code: ./.tests/optimization_example --int_param='-40' --float_param='-83.71261060237884521484' --choice_param='hallo' --int_param_two='-79'
pwd: /home/runner/work/OmniOpt/OmniOpt
File: ./.tests/optimization_example
UID: 1001
GID: 1001
Status-Change-Time: 1762981793.8887846
Size: 5714 Bytes
Permissions: -rwxr-xr-x
Owner: runner
Last access: 1762982250.7650862
Last modification: 1762981793.8887846
Hostname: runnervmw9dnm
========
DEBUG INFOS END
./.tests/optimization_example --int_param='-40' --float_param='-83.71261060237884521484' --choice_param='hallo' --int_param_two='-79'
stdout:
OO-Info: int_param: -40
OO-Info: int_param_two: -79
OO-Info: float_param: -83.71261060237884521484
OO-Info: choice_param: hallo
RESULT: -169278.592798893
stderr was empty
Result: {'RESULT': -169278.592798893}
Final-results: {'RESULT': -169278.592798893}
EXIT_CODE: 0
submitit INFO (2025-11-12 21:30:32,168) - Job completed successfully
submitit INFO (2025-11-12 21:30:32,168) - Exiting after successful completion
