Experiment overview
| Setting | Value |
|---|
| Model for non-random steps | EXTERNAL_GENERATOR |
| Max. nr. evaluations | 2 |
| Number random steps | 1 |
| Nr. of workers (parameter) | 1 |
Best RESULT, max (total: 2)
| x | y | z | RESULT |
|---|
| 139 | 5431 | 111 | 1395431.0 |
Job Summary per Generation Node
| Generation Node | Total | COMPLETED |
|---|
| SOBOL | 1 | 1 |
| EXTERNAL_GENERATOR | 1 | 1 |
Experiment parameters
| Name | Type | Lower bound | Upper bound | Values | Type | Log Scale? |
|---|
| x | range | 123 | 1000 | | int | No |
| y | choice | | | 5431, 1234 | | |
| z | fixed | | | 111 | | |
Number of evaluations
| Failed |
Succeeded |
Running |
Total |
| 0 |
2 |
0 |
2 |
Result names and types
Last progressbar status
2026-05-10 10:02:05 (3442d269-c547-4094-afb1-ae8b67a21e4f): EXTERNAL_GENERATOR, best RESULT: 1395431, ▁█, finishing jobs, finished 1 job
Git-Version
Commit: 35c250215b7365bf0aa1a8b33d7ddc1e197e7d1c (9325-2-g35c250215)
trial_index,submit_time,queue_time,worker_generator_uuid,start_time,end_time,run_time,program_string,exit_code,signal,hostname,arm_name,trial_status,generation_node,RESULT,x,y,z
0,1778407304,2,3442d269-c547-4094-afb1-ae8b67a21e4f,1778407306,1778407312,6,echo "RESULT: 1341234" && echo "RESULT2: 111",0,,runnervmrc6n4,0_0,COMPLETED,SOBOL,1341234,134,1234,111
1,1778407315,2,3442d269-c547-4094-afb1-ae8b67a21e4f,1778407317,1778407323,6,echo "RESULT: 1395431" && echo "RESULT2: 111",0,,runnervmrc6n4,1_0,COMPLETED,EXTERNAL_GENERATOR,1395431,139,5431,111
========================================================================
Current git-hash: 35c250215b7365bf0aa1a8b33d7ddc1e197e7d1c (last fully tested stable version 2 commits ago [10e58f176a57b3e4bbd0e9c189c2a9f555e68d1e, 9325])
Using coverage run -p because $RUN_WITH_COVERAGE is set
[WARNING 05-10 10:01:40] ax.service.utils.with_db_settings_base: Ax currently requires a sqlalchemy version below 2.0. This will be addressed in a future release. Disabling SQL storage in Ax for now, if you would like to use SQL storage please install Ax with mysql extras via `pip install ax-platform[mysql]`.
Run-UUID: d4e48b04-a347-4fd5-b695-b40523152069
/home/runner/.omniax_venvs/Python_3.10.12/x86_64/lib/python3.10/site-packages/plyer/platforms/linux/notification.py:103: UserWarning: The Python dbus package is not installed.
Try installing it with your distribution's package manager, it is usually called python-dbus or python3-dbus, but you might have to try dbus-python instead, e.g. when using pip.
warnings.warn(msg)
/home/runner/.omniax_venvs/Python_3.10.12/x86_64/lib/python3.10/site-packages/plyer/platforms/linux/notification.py:107: UserWarning: notify-send not found.
warnings.warn("notify-send not found.")
_________________________________________________
/ \
| OmniOpt2 - A trip through the hyperspace of the p |
| arameter landscape. |
\ /
=================================================
\
\
\
\
/ \\ //\\
|\\___/| / \\// \\\\
/0 0 \\__ / // | \\ \\
/ / \\/_/ // | \\ \\
\@_^_\@'/ \\/_ // | \\ \\
//_^_/ \\/_ // | \\ \\
( //) | \\/// | \\ \\
( / /) _|_ / ) // | \\ _\\
( // /) '/,_ _ _/ ( ; -. | _ _\\.-~ .-~~~^-.
(( / / )) ,-{ _ `-.|.-~-. .~ `.
(( // / )) '/\\ / ~-. _ .-~ .-~^-. \\
(( /// )) `. { } / \\ \\
(( / )) .----~-.\\ \\-' .~ \\ `. \\^-.
///.----..> \\ _ -~ `. ^-` ^-_
///-._ _ _ _ _ _ _}^ - - - - ~ ~-- ,.-~
/.-~
omniopt --partition=alpha --experiment_name=EXTERNAL_GENERATOR_test --mem_gb=1 --time=60 --worker_timeout=60 --max_eval=2 --num_parallel_jobs=1 --gpus=1 --num_random_steps=1 --follow --live_share --send_anonymized_usage_stats --result_names RESULT=max --run_program=ZWNobyAiUkVTVUxUOiAlKHgpJSh5KSIgJiYgZWNobyAiUkVTVUxUMjogJXoi --cpus_per_task=1 --nodes_per_job=1 --generate_all_jobs_at_once --revert_to_random_when_seemingly_exhausted --model=EXTERNAL_GENERATOR --run_mode=local --occ_type=euclid --main_process_gb=8 --max_nr_of_zero_results=1 --slurm_signal_delay_s=0 --n_estimators_randomforest=100 --parameter x range 123 1000 int false --parameter y choice 5431,1234 --parameter z fixed 111 --external_generator=cHl0aG9uMyAvaG9tZS9ydW5uZXIvd29yay9PbW5pT3B0L09tbmlPcHQvLnRlc3RzL2V4YW1wbGVfZXh0ZXJuYWwucHkK
Run-folder: /home/runner/work/OmniOpt/OmniOpt/runs/EXTERNAL_GENERATOR_test/0
See https://imageseg.scads.de/omniax/share?user_id=runner&experiment_name=EXTERNAL_GENERATOR_test&run_nr=73 for live-results.
You have 4 CPUs available for the main process. No CUDA devices found.
Generation strategy: SOBOL for 1 step and then EXTERNAL_GENERATOR for 1 step.
Run-Program: echo "RESULT: %(x)%(y)" && echo "RESULT2: %z"
External-Generator: python3 /home/runner/work/OmniOpt/OmniOpt/.tests/example_external.py
Experiment parameters
┏━━━━━━┳━━━━━━━━┳━━━━━━━━━━━━━┳━━━━━━━━━━━━━┳━━━━━━━━━━━━┳━━━━━━┳━━━━━━━━━━━━┓
┃ Name ┃ Type ┃ Lower bound ┃ Upper bound ┃ Values ┃ Type ┃ Log Scale? ┃
┡━━━━━━╇━━━━━━━━╇━━━━━━━━━━━━━╇━━━━━━━━━━━━━╇━━━━━━━━━━━━╇━━━━━━╇━━━━━━━━━━━━┩
│ x │ range │ 123 │ 1000 │ │ int │ No │
│ y │ choice │ │ │ 5431, 1234 │ │ │
│ z │ fixed │ │ │ 111 │ │ │
└──────┴────────┴─────────────┴─────────────┴────────────┴──────┴────────────┘
Result-Names
┏━━━━━━━━━━━━━┳━━━━━━━━━━━━━┓
┃ Result-Name ┃ Min or max? ┃
┡━━━━━━━━━━━━━╇━━━━━━━━━━━━━┩
│ RESULT │ max │
└─────────────┴─────────────┘
Failed Jobs parameters
┏━━━━━━━━┳━━━━━━━━┳━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┓
┃ param1 ┃ param2 ┃ param3 ┃ error_description ┃
┡━━━━━━━━╇━━━━━━━━╇━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┩
│ value1 │ value2 │ value3 │ Some error occurred during execution (this is not a real error!). │
└────────┴────────┴────────┴───────────────────────────────────────────────────────────────────┘
Best RESULT, max (total: 2)
┏━━━━━┳━━━━━━┳━━━━━┳━━━━━━━━━━━┓
┃ x ┃ y ┃ z ┃ RESULT ┃
┡━━━━━╇━━━━━━╇━━━━━╇━━━━━━━━━━━┩
│ 139 │ 5431 │ 111 │ 1395431.0 │
└─────┴──────┴─────┴───────────┘
Not printing sixel graphics in CI
Runtime Infos
┏━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━┳━━━━━━━━━━━┳━━━━━━━━━━━━━━┳━━━━━━━━━━━━━┓
┃ Number of evaluations ┃ Min time ┃ Max time ┃ Average time ┃ Median time ┃
┡━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━╇━━━━━━━━━━━╇━━━━━━━━━━━━━━╇━━━━━━━━━━━━━┩
│ 2 │ 6.00 sec │ 6.00 sec │ 6.00 sec │ 6.00 sec │
└───────────────────────┴───────────┴───────────┴──────────────┴─────────────┘
╭──────────────────────────────────────────────────────────────────────────────────────── OmniOpt2 Run Summary ────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ ✅ Optimization complete! │
│ │
│ 📊 Trials: 2 succeeded / 0 failed / 2 done / 2 submitted │
│ ⏱️ Duration: 32s │
│ 🏆 Best RESULT: 1395431 │
│ 📁 Results: /home/runner/work/OmniOpt/OmniOpt/runs/EXTERNAL_GENERATOR_test/0/results.csv │
│ 🧠 Model: EXTERNAL_GENERATOR │
│ │
╰──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
2026-05-10 10:01:44 (3442d269-c547-4094-afb1-ae8b67a21e4f): SOBOL, Started OmniOpt2 run...
2026-05-10 10:01:44 (3442d269-c547-4094-afb1-ae8b67a21e4f): SOBOL, getting new HP set (no sbatch)
2026-05-10 10:01:44 (3442d269-c547-4094-afb1-ae8b67a21e4f): SOBOL, requested 1 jobs, got 1, 0.02 s/job
2026-05-10 10:01:44 (3442d269-c547-4094-afb1-ae8b67a21e4f): SOBOL, eval #1/1 start
2026-05-10 10:01:44 (3442d269-c547-4094-afb1-ae8b67a21e4f): SOBOL, starting new job
2026-05-10 10:01:44 (3442d269-c547-4094-afb1-ae8b67a21e4f): SOBOL, started new job
2026-05-10 10:01:53 (3442d269-c547-4094-afb1-ae8b67a21e4f): SOBOL, new result: RESULT: 1341234.000000
2026-05-10 10:01:55 (3442d269-c547-4094-afb1-ae8b67a21e4f): SOBOL, best RESULT: 1341234, finishing jobs, finished 1 job
2026-05-10 10:01:55 (3442d269-c547-4094-afb1-ae8b67a21e4f): EXTERNAL_GENERATOR, best RESULT: 1341234, getting new HP set (no sbatch)
2026-05-10 10:01:55 (3442d269-c547-4094-afb1-ae8b67a21e4f): EXTERNAL_GENERATOR, best RESULT: 1341234, requested 1 jobs, got 1, 0.06 s/job
2026-05-10 10:01:55 (3442d269-c547-4094-afb1-ae8b67a21e4f): EXTERNAL_GENERATOR, best RESULT: 1341234, eval #1/1 start
2026-05-10 10:01:55 (3442d269-c547-4094-afb1-ae8b67a21e4f): EXTERNAL_GENERATOR, best RESULT: 1341234, starting new job
2026-05-10 10:01:55 (3442d269-c547-4094-afb1-ae8b67a21e4f): EXTERNAL_GENERATOR, best RESULT: 1341234, started new job
2026-05-10 10:02:04 (3442d269-c547-4094-afb1-ae8b67a21e4f): EXTERNAL_GENERATOR, best RESULT: 1341234, new result: RESULT: 1395431.000000
2026-05-10 10:02:05 (3442d269-c547-4094-afb1-ae8b67a21e4f): EXTERNAL_GENERATOR, best RESULT: 1395431, ▁█, finishing jobs, finished 1 job
Job submission durations
┏━━━━━━━━━┳━━━━━━━━━┳━━━━━━┳━━━━━━━━━━━━━━┓
┃ Batch ┃ Seconds ┃ Jobs ┃ Time per job ┃
┡━━━━━━━━━╇━━━━━━━━━╇━━━━━━╇━━━━━━━━━━━━━━┩
│ 1 │ 0.117 │ 1 │ 0.117 │
│ 2 │ 0.069 │ 1 │ 0.069 │
├─────────┼─────────┼──────┼──────────────┤
│ Average │ 0.093 │ │ │
│ Median │ 0.093 │ │ │
│ Total │ 0.186 │ │ │
│ Max │ 0.117 │ │ │
│ Min │ 0.069 │ │ │
└─────────┴─────────┴──────┴──────────────┘
Model generation times
┏━━━━━━━━━━━┳━━━━━━━━━┳━━━━━━┳━━━━━━━━━━━━━━┓
┃ Iteration ┃ Seconds ┃ Jobs ┃ Time per job ┃
┡━━━━━━━━━━━╇━━━━━━━━━╇━━━━━━╇━━━━━━━━━━━━━━┩
│ 1 │ 0.024 │ 1 │ 0.024 │
│ 2 │ 0.063 │ 1 │ 0.063 │
├───────────┼─────────┼──────┼──────────────┤
│ Average │ 0.044 │ │ │
│ Median │ 0.044 │ │ │
│ Total │ 0.087 │ │ │
│ Max │ 0.063 │ │ │
│ Min │ 0.024 │ │ │
└───────────┴─────────┴──────┴──────────────┘
Arguments Overview
| Key | Value |
|---|
| config_yaml | None |
| config_toml | None |
| config_json | None |
| num_random_steps | 1 |
| max_eval | 2 |
| run_program | [['ZWNobyAiUkVTVUxUOiAlKHgpJSh5KSIgJiYgZWNobyAiUkVTVUxUMjogJXoi']] |
| experiment_name | EXTERNAL_GENERATOR_test |
| mem_gb | 1 |
| parameter | [['x', 'range', '123', '1000', 'int', 'false'], ['y', 'choice', '5431,1234'], ['z', 'fixed', '111']] |
| continue_previous_job | None |
| experiment_constraints | None |
| run_dir | runs |
| seed | None |
| verbose_tqdm | False |
| model | EXTERNAL_GENERATOR |
| gridsearch | False |
| occ | False |
| show_sixel_scatter | False |
| show_sixel_general | False |
| show_sixel_trial_index_result | False |
| follow | True |
| send_anonymized_usage_stats | True |
| ui_url | None |
| root_venv_dir | /home/runner |
| exclude | None |
| main_process_gb | 8 |
| max_nr_of_zero_results | 1 |
| abbreviate_job_names | False |
| orchestrator_file | None |
| checkout_to_latest_tested_version | False |
| live_share | True |
| disable_tqdm | False |
| disable_previous_job_constraint | False |
| workdir | |
| occ_type | euclid |
| result_names | ['RESULT=max'] |
| minkowski_p | 2 |
| signed_weighted_euclidean_weights | |
| generation_strategy | None |
| generate_all_jobs_at_once | True |
| revert_to_random_when_seemingly_exhausted | True |
| load_data_from_existing_jobs | [] |
| n_estimators_randomforest | 100 |
| max_attempts_for_generation | 20 |
| external_generator | cHl0aG9uMyAvaG9tZS9ydW5uZXIvd29yay9PbW5pT3B0L09tbmlPcHQvLnRlc3RzL2V4YW1wbGVfZXh0ZXJuYWwucHkK |
| username | None |
| max_failed_jobs | None |
| num_cpus_main_job | None |
| calculate_pareto_front_of_job | [] |
| show_generate_time_table | False |
| force_choice_for_ranges | False |
| max_abandoned_retrial | 20 |
| share_password | None |
| dryrun | False |
| db_url | None |
| run_program_once | None |
| worker_generator_path | None |
| save_to_database | False |
| range_max_difference | 1000000 |
| skip_search | False |
| nr_evals_per_arm | 1 |
| disable_notifications | False |
| dont_warm_start_refitting | False |
| refit_on_cv | False |
| fit_out_of_design | False |
| fit_abandoned | False |
| dont_jit_compile | False |
| num_restarts | 20 |
| raw_samples | 1024 |
| max_num_of_parallel_sruns | 16 |
| no_transform_inputs | False |
| no_normalize_y | False |
| transforms | [] |
| number_of_generators | 1 |
| num_parallel_jobs | 1 |
| worker_timeout | 60 |
| slurm_use_srun | False |
| time | 60 |
| partition | alpha |
| reservation | None |
| force_local_execution | False |
| slurm_signal_delay_s | 0 |
| nodes_per_job | 1 |
| cpus_per_task | 1 |
| account | None |
| gpus | 1 |
| dependency | None |
| run_mode | local |
| verbose | False |
| verbose_break_run_search_table | False |
| debug | False |
| flame_graph | False |
| memray | False |
| no_sleep | False |
| tests | False |
| show_worker_percentage_table_at_end | False |
| auto_exclude_defective_hosts | False |
| run_tests_that_fail_on_taurus | False |
| raise_in_eval | False |
| show_ram_every_n_seconds | 0 |
| show_generation_and_submission_sixel | False |
| just_return_defaults | False |
| prettyprint | False |
| runtime_debug | False |
| debug_stack_regex | |
| debug_stack_trace_regex | None |
| show_func_name | False |
| beartype | False |
This logs the CPU and RAM usage of the main worker process.
timestamp,ram_usage_mb,cpu_usage_percent
1778407301,741.91015625,28
Parameter statistics
| Parameter | Min | Max | Mean | Std Dev | Count |
|---|
| run_time | 6 | 6 | 6 | 0 | 2 |
| RESULT | 1341234 | 1395431 | 1368332.5 | 27098.5 | 2 |
| x | 134 | 139 | 136.5 | 2.5 | 2 |
| y | 1234 | 5431 | 3332.5 | 2098.5 | 2 |
| z | 111 | 111 | 111 | 0 | 2 |
Show SLURM-Job-ID (if it exists)
submitit INFO (2026-05-10 10:01:45,164) - Starting with JobEnvironment(job_id=85918, hostname=runnervmrc6n4, local_rank=0(1), node=0(1), global_rank=0(1))
submitit INFO (2026-05-10 10:01:45,164) - Loading pickle: /home/runner/work/OmniOpt/OmniOpt/runs/EXTERNAL_GENERATOR_test/0/single_runs/85918/85918_submitted.pkl
Trial-Index: 0
Parameters: {"x": 134, "y": 1234, "z": 111}
Debug-Infos:
echo "RESULT: 1341234" && echo "RESULT2: 111"
stdout:
RESULT: 1341234
RESULT2: 111
stderr was empty
Result: {'RESULT': 1341234.0}
Final-results: {'RESULT': 1341234.0}
EXIT_CODE: 0
submitit INFO (2026-05-10 10:01:52,666) - Job completed successfully
submitit INFO (2026-05-10 10:01:52,666) - Exiting after successful completion
