Experiment overview
| Setting | Value |
|---|
| Model for non-random steps | BOTORCH_MODULAR |
| Max. nr. evaluations | 4 |
| Number random steps | 1 |
| Nr. of workers (parameter) | 4 |
| Seed | 1234 |
Best RESULT, min (total: 4)
| name | RESULT |
|---|
| simple_ok | 0.123 |
Job Summary per Generation Node
| Generation Node | Total | COMPLETED |
|---|
| SOBOL | 1 | 1 |
| BOTORCH_MODULAR | 3 | 3 |
Experiment parameters
| Name | Type | Values |
|---|
| name | choice | simple_ok, storage_error, timeout_failure, gpu_disconnected |
Number of evaluations
| Failed |
Succeeded |
Running |
Total |
| 0 |
4 |
0 |
4 |
Result names and types
Last progressbar status
2025-12-28 18:07:36 (1bada116-b460-4c6a-8182-826ac2c0b523): BOTORCH_MODULAR, best RESULT: 0.123, finishing jobs, finished 1 job
Git-Version
Commit: 9c0a25172e3c44bd98f8651b1fb4dd8f983da9ed (9205-1-g9c0a25172)
trial_index,submit_time,queue_time,worker_generator_uuid,start_time,end_time,run_time,program_string,exit_code,signal,hostname,arm_name,trial_status,generation_node,RESULT,name
0,1766945210,2,1bada116-b460-4c6a-8182-826ac2c0b523,1766945212,1766945218,6,./.tests/orchestrator_tests.bin/timeout_failure,0,,runnervmdwttx,0_0,COMPLETED,SOBOL,29742,timeout_failure
1,1766945221,2,1bada116-b460-4c6a-8182-826ac2c0b523,1766945223,1766945229,6,./.tests/orchestrator_tests.bin/storage_error,0,,runnervmdwttx,1_0,COMPLETED,BOTORCH_MODULAR,31877,storage_error
2,1766945233,2,1bada116-b460-4c6a-8182-826ac2c0b523,1766945235,1766945241,6,./.tests/orchestrator_tests.bin/gpu_disconnected,0,,runnervmdwttx,2_0,COMPLETED,BOTORCH_MODULAR,20411,gpu_disconnected
3,1766945245,2,1bada116-b460-4c6a-8182-826ac2c0b523,1766945247,1766945253,6,./.tests/orchestrator_tests.bin/simple_ok,0,,runnervmdwttx,3_0,COMPLETED,BOTORCH_MODULAR,0.1229999999999999982236431606,simple_ok
========================================================================
Current git-hash: 9c0a25172e3c44bd98f8651b1fb4dd8f983da9ed (last fully tested stable version 1 commit ago [c53538d72fd964f91794defe73be612acdc56009, 9205])
Using coverage run -p because $RUN_WITH_COVERAGE is set
[WARNING 12-28 18:06:47] ax.service.utils.with_db_settings_base: Ax currently requires a sqlalchemy version below 2.0. This will be addressed in a future release. Disabling SQL storage in Ax for now, if you would like to use SQL storage please install Ax with mysql extras via `pip install ax-platform[mysql]`.
Run-UUID: 80aa7132-e84c-497c-bfda-4888447eebe8
____ _ ____ _ ___
/ __ \ (_)/ __ \ | | |__ \
| | | |_ __ ___ _ __ _| | | |_ __ | |_ ) |
| | | | '_ ` _ \| '_ \| | | | | '_ \| __| / /
| |__| | | | | | | | | | | |__| | |_) | |_ / /_
\____/|_| |_| |_|_| |_|_|\____/| .__/ \__|____|
| |
|_|
omniopt --live_share --send_anonymized_usage_stats --partition=alpha --experiment_name=test_orchestrator --mem_gb=5 --time=60 --worker_timeout=5 --max_eval=4 --num_parallel_jobs=4 --gpus=0 --run_program=Li8udGVzdHMvb3JjaGVzdHJhdG9yX3Rlc3RzLmJpbi8lKG5hbWUp --parameter name choice simple_ok,storage_error,timeout_failure,gpu_disconnected --num_random_steps=1 --model=BOTORCH_MODULAR --auto_exclude_defective_hosts --orchestrator_file .tests/example_orchestrator_config.yaml --seed 1234 --follow
Run-folder: /home/runner/work/OmniOpt/OmniOpt/runs/test_orchestrator/0
--orchestrator_file will be ignored on non-sbatch-systems.
See https://imageseg.scads.de/omniax/share?user_id=runner&experiment_name=test_orchestrator&run_nr=85 for live-results.
You have 4 CPUs available for the main process. No CUDA devices found.
Generation strategy: SOBOL for 1 step and then BOTORCH_MODULAR for 3 steps.
Run-Program: ./.tests/orchestrator_tests.bin/%(name)
Experiment parameters
┏━━━━━━┳━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┓
┃ Name ┃ Type ┃ Values ┃
┡━━━━━━╇━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┩
│ name │ choice │ simple_ok, storage_error, timeout_failure, gpu_disconnected │
└──────┴────────┴─────────────────────────────────────────────────────────────┘
Result-Names
┏━━━━━━━━━━━━━┳━━━━━━━━━━━━━┓
┃ Result-Name ┃ Min or max? ┃
┡━━━━━━━━━━━━━╇━━━━━━━━━━━━━┩
│ RESULT │ min │
└─────────────┴─────────────┘
Failed Jobs parameters
┏━━━━━━━━┳━━━━━━━━┳━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┓
┃ param1 ┃ param2 ┃ param3 ┃ error_description ┃
┡━━━━━━━━╇━━━━━━━━╇━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┩
│ value1 │ value2 │ value3 │ Some error occurred during execution (this is not a real error!). │
└────────┴────────┴────────┴───────────────────────────────────────────────────────────────────┘
Best RESULT, min (total: 4)
┏━━━━━━━━━━━┳━━━━━━━━┓
┃ name ┃ RESULT ┃
┡━━━━━━━━━━━╇━━━━━━━━┩
│ simple_ok │ 0.123 │
└───────────┴────────┘
Not printing sixel graphics in CI
Runtime Infos
┏━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━┳━━━━━━━━━━━┳━━━━━━━━━━━━━━┳━━━━━━━━━━━━━┓
┃ Number of evaluations ┃ Min time ┃ Max time ┃ Average time ┃ Median time ┃
┡━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━╇━━━━━━━━━━━╇━━━━━━━━━━━━━━╇━━━━━━━━━━━━━┩
│ 4 │ 6.00 sec │ 6.00 sec │ 6.00 sec │ 6.00 sec │
└───────────────────────┴───────────┴───────────┴──────────────┴─────────────┘
2025-12-28 18:06:50 (1bada116-b460-4c6a-8182-826ac2c0b523): SOBOL, Started OmniOpt2 run...
2025-12-28 18:06:50 (1bada116-b460-4c6a-8182-826ac2c0b523): SOBOL, getting new HP set (no sbatch)
2025-12-28 18:06:50 (1bada116-b460-4c6a-8182-826ac2c0b523): SOBOL, requested 1 jobs, got 1, 0.02 s/job
2025-12-28 18:06:50 (1bada116-b460-4c6a-8182-826ac2c0b523): SOBOL, eval #1/1 start
2025-12-28 18:06:50 (1bada116-b460-4c6a-8182-826ac2c0b523): SOBOL, starting new job
2025-12-28 18:06:50 (1bada116-b460-4c6a-8182-826ac2c0b523): SOBOL, started new job
2025-12-28 18:06:59 (1bada116-b460-4c6a-8182-826ac2c0b523): SOBOL, new result: RESULT: 29742.000000
2025-12-28 18:07:00 (1bada116-b460-4c6a-8182-826ac2c0b523): SOBOL, best RESULT: 29742, finishing jobs, finished 1 job
2025-12-28 18:07:01 (1bada116-b460-4c6a-8182-826ac2c0b523): BOTORCH_MODULAR, best RESULT: 29742, getting new HP set (no sbatch)
2025-12-28 18:07:01 (1bada116-b460-4c6a-8182-826ac2c0b523): BOTORCH_MODULAR, best RESULT: 29742, requested 1 jobs, got 1, 0.31 s/job
2025-12-28 18:07:01 (1bada116-b460-4c6a-8182-826ac2c0b523): BOTORCH_MODULAR, best RESULT: 29742, eval #1/1 start
2025-12-28 18:07:01 (1bada116-b460-4c6a-8182-826ac2c0b523): BOTORCH_MODULAR, best RESULT: 29742, starting new job
2025-12-28 18:07:01 (1bada116-b460-4c6a-8182-826ac2c0b523): BOTORCH_MODULAR, best RESULT: 29742, started new job
2025-12-28 18:07:10 (1bada116-b460-4c6a-8182-826ac2c0b523): BOTORCH_MODULAR, best RESULT: 29742, new result: RESULT: 31877.000000
2025-12-28 18:07:12 (1bada116-b460-4c6a-8182-826ac2c0b523): BOTORCH_MODULAR, best RESULT: 29742, finishing jobs, finished 1 job
2025-12-28 18:07:13 (1bada116-b460-4c6a-8182-826ac2c0b523): BOTORCH_MODULAR, best RESULT: 29742, getting new HP set (no sbatch)
2025-12-28 18:07:13 (1bada116-b460-4c6a-8182-826ac2c0b523): BOTORCH_MODULAR, best RESULT: 29742, requested 1 jobs, got 1, 1.17 s/job
2025-12-28 18:07:13 (1bada116-b460-4c6a-8182-826ac2c0b523): BOTORCH_MODULAR, best RESULT: 29742, eval #1/1 start
2025-12-28 18:07:13 (1bada116-b460-4c6a-8182-826ac2c0b523): BOTORCH_MODULAR, best RESULT: 29742, starting new job
2025-12-28 18:07:13 (1bada116-b460-4c6a-8182-826ac2c0b523): BOTORCH_MODULAR, best RESULT: 29742, started new job
2025-12-28 18:07:22 (1bada116-b460-4c6a-8182-826ac2c0b523): BOTORCH_MODULAR, best RESULT: 29742, new result: RESULT: 20411.000000
2025-12-28 18:07:23 (1bada116-b460-4c6a-8182-826ac2c0b523): BOTORCH_MODULAR, best RESULT: 20411, finishing jobs, finished 1 job
2025-12-28 18:07:25 (1bada116-b460-4c6a-8182-826ac2c0b523): BOTORCH_MODULAR, best RESULT: 20411, getting new HP set (no sbatch)
2025-12-28 18:07:25 (1bada116-b460-4c6a-8182-826ac2c0b523): BOTORCH_MODULAR, best RESULT: 20411, requested 1 jobs, got 1, 1.63 s/job
2025-12-28 18:07:25 (1bada116-b460-4c6a-8182-826ac2c0b523): BOTORCH_MODULAR, best RESULT: 20411, eval #1/1 start
2025-12-28 18:07:25 (1bada116-b460-4c6a-8182-826ac2c0b523): BOTORCH_MODULAR, best RESULT: 20411, starting new job
2025-12-28 18:07:25 (1bada116-b460-4c6a-8182-826ac2c0b523): BOTORCH_MODULAR, best RESULT: 20411, started new job
2025-12-28 18:07:34 (1bada116-b460-4c6a-8182-826ac2c0b523): BOTORCH_MODULAR, best RESULT: 20411, new result: RESULT: 0.123000
2025-12-28 18:07:36 (1bada116-b460-4c6a-8182-826ac2c0b523): BOTORCH_MODULAR, best RESULT: 0.123, finishing jobs, finished 1 job
Job submission durations
┏━━━━━━━━━┳━━━━━━━━━┳━━━━━━┳━━━━━━━━━━━━━━┓
┃ Batch ┃ Seconds ┃ Jobs ┃ Time per job ┃
┡━━━━━━━━━╇━━━━━━━━━╇━━━━━━╇━━━━━━━━━━━━━━┩
│ 1 │ 0.105 │ 1 │ 0.105 │
│ 2 │ 0.071 │ 1 │ 0.071 │
│ 3 │ 0.068 │ 1 │ 0.068 │
│ 4 │ 0.069 │ 1 │ 0.069 │
├─────────┼─────────┼──────┼──────────────┤
│ Average │ 0.078 │ │ │
│ Median │ 0.070 │ │ │
│ Total │ 0.312 │ │ │
│ Max │ 0.105 │ │ │
│ Min │ 0.068 │ │ │
└─────────┴─────────┴──────┴──────────────┘
Model generation times
┏━━━━━━━━━━━┳━━━━━━━━━┳━━━━━━┳━━━━━━━━━━━━━━┓
┃ Iteration ┃ Seconds ┃ Jobs ┃ Time per job ┃
┡━━━━━━━━━━━╇━━━━━━━━━╇━━━━━━╇━━━━━━━━━━━━━━┩
│ 1 │ 0.025 │ 1 │ 0.025 │
│ 2 │ 0.308 │ 1 │ 0.308 │
│ 3 │ 1.174 │ 1 │ 1.174 │
│ 4 │ 1.630 │ 1 │ 1.630 │
├───────────┼─────────┼──────┼──────────────┤
│ Average │ 0.784 │ │ │
│ Median │ 0.741 │ │ │
│ Total │ 3.137 │ │ │
│ Max │ 1.630 │ │ │
│ Min │ 0.025 │ │ │
└───────────┴─────────┴──────┴──────────────┘
Arguments Overview
| Key | Value |
|---|
| config_yaml | None |
| config_toml | None |
| config_json | None |
| num_random_steps | 1 |
| max_eval | 4 |
| run_program | [['Li8udGVzdHMvb3JjaGVzdHJhdG9yX3Rlc3RzLmJpbi8lKG5hbWUp']] |
| experiment_name | test_orchestrator |
| mem_gb | 5 |
| parameter | [['name', 'choice', 'simple_ok,storage_error,timeout_failure,gpu_disconnected']] |
| continue_previous_job | None |
| experiment_constraints | None |
| run_dir | runs |
| seed | 1234 |
| verbose_tqdm | False |
| model | BOTORCH_MODULAR |
| gridsearch | False |
| occ | False |
| show_sixel_scatter | False |
| show_sixel_general | False |
| show_sixel_trial_index_result | False |
| follow | True |
| send_anonymized_usage_stats | True |
| ui_url | None |
| root_venv_dir | /home/runner |
| exclude | None |
| main_process_gb | 8 |
| max_nr_of_zero_results | 10 |
| abbreviate_job_names | False |
| orchestrator_file | .tests/example_orchestrator_config.yaml |
| checkout_to_latest_tested_version | False |
| live_share | True |
| disable_tqdm | False |
| disable_previous_job_constraint | False |
| workdir | |
| occ_type | euclid |
| result_names | ['RESULT=min'] |
| minkowski_p | 2 |
| signed_weighted_euclidean_weights | |
| generation_strategy | None |
| generate_all_jobs_at_once | False |
| revert_to_random_when_seemingly_exhausted | False |
| load_data_from_existing_jobs | [] |
| n_estimators_randomforest | 100 |
| max_attempts_for_generation | 20 |
| external_generator | None |
| username | None |
| max_failed_jobs | None |
| num_cpus_main_job | None |
| calculate_pareto_front_of_job | [] |
| show_generate_time_table | False |
| force_choice_for_ranges | False |
| max_abandoned_retrial | 20 |
| share_password | None |
| dryrun | False |
| db_url | None |
| run_program_once | None |
| worker_generator_path | None |
| save_to_database | False |
| range_max_difference | 1000000 |
| skip_search | False |
| dont_warm_start_refitting | False |
| refit_on_cv | False |
| fit_out_of_design | False |
| fit_abandoned | False |
| dont_jit_compile | False |
| num_restarts | 20 |
| raw_samples | 1024 |
| max_num_of_parallel_sruns | 16 |
| no_transform_inputs | False |
| no_normalize_y | False |
| transforms | [] |
| number_of_generators | 1 |
| num_parallel_jobs | 4 |
| worker_timeout | 5 |
| slurm_use_srun | False |
| time | 60 |
| partition | alpha |
| reservation | None |
| force_local_execution | False |
| slurm_signal_delay_s | 0 |
| nodes_per_job | 1 |
| cpus_per_task | 1 |
| account | None |
| gpus | 0 |
| dependency | None |
| run_mode | local |
| verbose | False |
| verbose_break_run_search_table | False |
| debug | False |
| flame_graph | False |
| memray | False |
| no_sleep | False |
| tests | False |
| show_worker_percentage_table_at_end | False |
| auto_exclude_defective_hosts | True |
| run_tests_that_fail_on_taurus | False |
| raise_in_eval | False |
| show_ram_every_n_seconds | 0 |
| show_generation_and_submission_sixel | False |
| just_return_defaults | False |
| prettyprint | False |
| runtime_debug | False |
| debug_stack_regex | |
| debug_stack_trace_regex | None |
| show_func_name | False |
| beartype | False |
This logs the CPU and RAM usage of the main worker process.
timestamp,ram_usage_mb,cpu_usage_percent
1766945207,756.8359375,28.6
RESULT (goal: minimize)
Best value: 0.123
Achieved at:
- run_time = 6
Parameter statistics
| Parameter | Min | Max | Mean | Std Dev | Count |
|---|
| run_time | 6 | 6 | 6 | 0 | 4 |
| RESULT | 0.123 | 31877 | 20507.5308 | 12600.6284 | 4 |
| name | No numerical statistics available |
Show SLURM-Job-ID (if it exists)
