Experiment overview Setting Value Model for non-random steps EXTERNAL_GENERATOR Max. nr. evaluations 2 Number random steps 1 Nr. of workers (parameter) 1
Best RESULT, max (total: 2) x y z RESULT 739 1234 111 7391234.0
Job Summary per Generation Node
Generation Node Total COMPLETED
SOBOL 1 1 EXTERNAL_GENERATOR 1 1
Experiment parameters Name Type Lower bound Upper bound Values Type Log Scale? x range 123 1000 int No y choice 5431, 1234 z fixed 111
Number of evaluations
Failed
Succeeded
Running
Total
0
2
0
2
Result names and types
Last progressbar status
2026-07-16 11:09:08 (613205d3-93bb-42fe-a1ec-ecfbb74a0e80): EXTERNAL_GENERATOR, best RESULT: 7391234, ▁█, finishing jobs, finished 1 job Git-Version
Commit: 604d53d394e04e7808e903636a42b164d6cc0c12 (9375-13-g604d53d39)
trial_index,submit_time,queue_time,worker_generator_uuid,start_time,end_time,run_time,program_string,exit_code,signal,hostname,arm_name,trial_status,generation_node,RESULT,x,y,z
0,1784200126,2,613205d3-93bb-42fe-a1ec-ecfbb74a0e80,1784200128,1784200134,6,echo "RESULT: 5111234" && echo "RESULT2: 111",0,,runnervm5mmn9,0_0,COMPLETED,SOBOL,5111234,511,1234,111
1,1784200137,2,613205d3-93bb-42fe-a1ec-ecfbb74a0e80,1784200139,1784200145,6,echo "RESULT: 7391234" && echo "RESULT2: 111",0,,runnervm5mmn9,1_0,COMPLETED,EXTERNAL_GENERATOR,7391234,739,1234,111
========================================================================
Current git-hash: 604d53d394e04e7808e903636a42b164d6cc0c12 (last fully tested stable version 13 commits ago [7ec7c180ddeb70e69ef837c896ebe061f7046be1, 9375])
Using coverage run -p because $RUN_WITH_COVERAGE is set
[INFO 07-16 11:08:43] ax.storage.sqa_store.with_db_settings_base: Ax SQL storage initialized with SQLAlchemy 2.0.51
Run-UUID: 1390808f-534d-4d93-99d8-41eaea3fd91e
/home/runner/.omniax_venvs/Python_3.12.3/x86_64/lib/python3.12/site-packages/plyer/platforms/linux/notification.py:103: UserWarning: The Python dbus package is not installed.
Try installing it with your distribution's package manager, it is usually called python-dbus or python3-dbus, but you might have to try dbus-python instead, e.g. when using pip.
warnings.warn(msg)
/home/runner/.omniax_venvs/Python_3.12.3/x86_64/lib/python3.12/site-packages/plyer/platforms/linux/notification.py:107: UserWarning: notify-send not found.
warnings.warn("notify-send not found.")
.d88888b. d8b .d88888b. 888 .d8888b.
d88P" "Y88b Y8Pd88P" "Y88b 888 d88P Y88b
888 888 888 888 888 888
888 88888888b.d88b. 88888b. 888888 88888888b. 888888 .d88P
888 888888 "888 "88b888 "88b888888 888888 "88b888 .od888P"
888 888888 888 888888 888888888 888888 888888 d88P"
Y88b. .d88P888 888 888888 888888Y88b. .d88P888 d88PY88b. 888"
"Y88888P" 888 888 888888 888888 "Y88888P" 88888P" "Y888888888888
888
888
888
omniopt --partition=alpha --experiment_name=EXTERNAL_GENERATOR_test --mem_gb=1 --time=60 --worker_timeout=60 --max_eval=2 --num_parallel_jobs=1 --gpus=1 --num_random_steps=1 --follow --live_share --send_anonymized_usage_stats --result_names RESULT=max --run_program=ZWNobyAiUkVTVUxUOiAlKHgpJSh5KSIgJiYgZWNobyAiUkVTVUxUMjogJXoi --cpus_per_task=1 --nodes_per_job=1 --generate_all_jobs_at_once --revert_to_random_when_seemingly_exhausted --model=EXTERNAL_GENERATOR --run_mode=local --occ_type=euclid --main_process_gb=8 --max_nr_of_zero_results=1 --slurm_signal_delay_s=0 --n_estimators_randomforest=100 --parameter x range 123 1000 int false --parameter y choice 5431,1234 --parameter z fixed 111 --external_generator=cHl0aG9uMyAvaG9tZS9ydW5uZXIvd29yay9PbW5pT3B0L09tbmlPcHQvLnRlc3RzL2V4YW1wbGVfZXh0ZXJuYWwucHkK
Run-folder : /home/runner/work/OmniOpt/OmniOpt/runs/EXTERNAL_GENERATOR_test/ 0
See https://imageseg.scads.de/omniax/share?user_id=runner&experiment_name=EXTERNAL_GENERATOR_test&run_nr=91 for live-results.
You have 4 CPUs available for the main process. No CUDA devices found.
Generation strategy: SOBOL for 1 step and then EXTERNAL_GENERATOR for 1 step.
Run-Program: echo "RESULT: %(x)%(y)" && echo "RESULT2: %z"
External-Generator: python3 /home/runner/work/OmniOpt/OmniOpt/.tests/example_external.py
Experiment parameters
┏━━━━━━┳━━━━━━━━┳━━━━━━━━━━━━━┳━━━━━━━━━━━━━┳━━━━━━━━━━━━┳━━━━━━┳━━━━━━━━━━━━┓
┃ Name ┃ Type ┃ Lower bound ┃ Upper bound ┃ Values ┃ Type ┃ Log Scale? ┃
┡━━━━━━╇━━━━━━━━╇━━━━━━━━━━━━━╇━━━━━━━━━━━━━╇━━━━━━━━━━━━╇━━━━━━╇━━━━━━━━━━━━┩
│ x │ range │ 123 │ 1000 │ │ int │ No │
│ y │ choice │ │ │ 5431, 1234 │ │ │
│ z │ fixed │ │ │ 111 │ │ │
└──────┴────────┴─────────────┴─────────────┴────────────┴──────┴────────────┘
Result-Names
┏━━━━━━━━━━━━━┳━━━━━━━━━━━━━┓
┃ Result-Name ┃ Min or max? ┃
┡━━━━━━━━━━━━━╇━━━━━━━━━━━━━┩
│ RESULT │ max │
└─────────────┴─────────────┘
Failed Jobs parameters
┏━━━━━━━━┳━━━━━━━━┳━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┓
┃ param1 ┃ param2 ┃ param3 ┃ error_description ┃
┡━━━━━━━━╇━━━━━━━━╇━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┩
│ value1 │ value2 │ value3 │ Some error occurred during execution (this is not a real error!). │
└────────┴────────┴────────┴───────────────────────────────────────────────────────────────────┘
Best RESULT, max (total: 2)
┏━━━━━┳━━━━━━┳━━━━━┳━━━━━━━━━━━┓
┃ x ┃ y ┃ z ┃ RESULT ┃
┡━━━━━╇━━━━━━╇━━━━━╇━━━━━━━━━━━┩
│ 739 │ 1234 │ 111 │ 7391234.0 │
└─────┴──────┴─────┴───────────┘
Not printing sixel graphics in CI
Runtime Infos
┏━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━┳━━━━━━━━━━━┳━━━━━━━━━━━━━━┳━━━━━━━━━━━━━┓
┃ Number of evaluations ┃ Min time ┃ Max time ┃ Average time ┃ Median time ┃
┡━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━╇━━━━━━━━━━━╇━━━━━━━━━━━━━━╇━━━━━━━━━━━━━┩
│ 2 │ 6.00 sec │ 6.00 sec │ 6.00 sec │ 6.00 sec │
└───────────────────────┴───────────┴───────────┴──────────────┴─────────────┘
╭─ ─────────────────────────────────────────────────────────────────────────────────────── OmniOpt2 Run Summary ─────────────────────────────────────────────────────────────────────────────────────── ─╮
│ │
│ ✅ Optimization complete! │
│ │
│ 📊 Trials: 2 succeeded / 0 failed / 2 done / 2 submitted │
│ ⏱️ Duration: 36s │
│ 🏆 Best RESULT: 7391234 │
│ 📁 Results: /home/runner/work/OmniOpt/OmniOpt/runs/EXTERNAL_GENERATOR_test/0/results.csv │
│ 🤖 Model: EXTERNAL_GENERATOR │
│ │
╰──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
2026-07-16 11:08:46 (613205d3-93bb-42fe-a1ec-ecfbb74a0e80): SOBOL, Started OmniOpt2 run...
2026-07-16 11:08:46 (613205d3-93bb-42fe-a1ec-ecfbb74a0e80): SOBOL, getting new HP set (no sbatch)
2026-07-16 11:08:46 (613205d3-93bb-42fe-a1ec-ecfbb74a0e80): SOBOL, requested 1 jobs, got 1, 0.04 s/job
2026-07-16 11:08:46 (613205d3-93bb-42fe-a1ec-ecfbb74a0e80): SOBOL, eval #1/1 start
2026-07-16 11:08:46 (613205d3-93bb-42fe-a1ec-ecfbb74a0e80): SOBOL, starting new job
2026-07-16 11:08:46 (613205d3-93bb-42fe-a1ec-ecfbb74a0e80): SOBOL, started new job
2026-07-16 11:08:55 (613205d3-93bb-42fe-a1ec-ecfbb74a0e80): SOBOL, new result: RESULT: 5111234.000000
2026-07-16 11:08:57 (613205d3-93bb-42fe-a1ec-ecfbb74a0e80): SOBOL, best RESULT: 5111234, finishing jobs, finished 1 job
2026-07-16 11:08:57 (613205d3-93bb-42fe-a1ec-ecfbb74a0e80): EXTERNAL_GENERATOR, best RESULT: 5111234, getting new HP set (no sbatch)
2026-07-16 11:08:57 (613205d3-93bb-42fe-a1ec-ecfbb74a0e80): EXTERNAL_GENERATOR, best RESULT: 5111234, requested 1 jobs, got 1, 0.11 s/job
2026-07-16 11:08:57 (613205d3-93bb-42fe-a1ec-ecfbb74a0e80): EXTERNAL_GENERATOR, best RESULT: 5111234, eval #1/1 start
2026-07-16 11:08:57 (613205d3-93bb-42fe-a1ec-ecfbb74a0e80): EXTERNAL_GENERATOR, best RESULT: 5111234, starting new job
2026-07-16 11:08:57 (613205d3-93bb-42fe-a1ec-ecfbb74a0e80): EXTERNAL_GENERATOR, best RESULT: 5111234, started new job
2026-07-16 11:09:06 (613205d3-93bb-42fe-a1ec-ecfbb74a0e80): EXTERNAL_GENERATOR, best RESULT: 5111234, new result: RESULT: 7391234.000000
2026-07-16 11:09:08 (613205d3-93bb-42fe-a1ec-ecfbb74a0e80): EXTERNAL_GENERATOR, best RESULT: 7391234, ▁█, finishing jobs, finished 1 job
Job submission durations
┏━━━━━━━━━┳━━━━━━━━━┳━━━━━━┳━━━━━━━━━━━━━━┓
┃ Batch ┃ Seconds ┃ Jobs ┃ Time per job ┃
┡━━━━━━━━━╇━━━━━━━━━╇━━━━━━╇━━━━━━━━━━━━━━┩
│ 1 │ 0.270 │ 1 │ 0.270 │
│ 2 │ 0.091 │ 1 │ 0.091 │
├─────────┼─────────┼──────┼──────────────┤
│ Average │ 0.180 │ │ │
│ Median │ 0.180 │ │ │
│ Total │ 0.361 │ │ │
│ Max │ 0.270 │ │ │
│ Min │ 0.091 │ │ │
└─────────┴─────────┴──────┴──────────────┘
Model generation times
┏━━━━━━━━━━━┳━━━━━━━━━┳━━━━━━┳━━━━━━━━━━━━━━┓
┃ Iteration ┃ Seconds ┃ Jobs ┃ Time per job ┃
┡━━━━━━━━━━━╇━━━━━━━━━╇━━━━━━╇━━━━━━━━━━━━━━┩
│ 1 │ 0.040 │ 1 │ 0.040 │
│ 2 │ 0.113 │ 1 │ 0.113 │
├───────────┼─────────┼──────┼──────────────┤
│ Average │ 0.077 │ │ │
│ Median │ 0.077 │ │ │
│ Total │ 0.154 │ │ │
│ Max │ 0.113 │ │ │
│ Min │ 0.040 │ │ │
└───────────┴─────────┴──────┴──────────────┘
Arguments Overview Key Value config_yaml None config_toml None config_json None num_random_steps 1 max_eval 2 run_program [['ZWNobyAiUkVTVUxUOiAlKHgpJSh5KSIgJiYgZWNobyAiUkVTVUxUMjogJXoi']] experiment_name EXTERNAL_GENERATOR_test mem_gb 1 parameter [['x', 'range', '123', '1000', 'int', 'false'], ['y', 'choice', '5431,1234'], ['z', 'fixed', '111']] continue_previous_job None experiment_constraints None run_dir runs seed None verbose_tqdm False model EXTERNAL_GENERATOR gridsearch False occ False show_sixel_scatter False show_sixel_general False show_sixel_trial_index_result False follow True send_anonymized_usage_stats True ui_url None root_venv_dir /home/runner exclude None main_process_gb 8 max_nr_of_zero_results 1 abbreviate_job_names False orchestrator_file None checkout_to_latest_tested_version False live_share True disable_tqdm False disable_previous_job_constraint False workdir occ_type euclid result_names ['RESULT=max'] minkowski_p 2 signed_weighted_euclidean_weights generation_strategy None generate_all_jobs_at_once True revert_to_random_when_seemingly_exhausted True load_data_from_existing_jobs [] n_estimators_randomforest 100 max_attempts_for_generation 20 external_generator cHl0aG9uMyAvaG9tZS9ydW5uZXIvd29yay9PbW5pT3B0L09tbmlPcHQvLnRlc3RzL2V4YW1wbGVfZXh0ZXJuYWwucHkK username None max_failed_jobs None num_cpus_main_job None calculate_pareto_front_of_job [] show_generate_time_table False force_choice_for_ranges False max_abandoned_retrial 20 share_password None dryrun False db_url None run_program_once None worker_generator_path None save_to_database False range_max_difference 1000000 skip_search False nr_evals_per_arm 1 disable_notifications False dump_config None dont_warm_start_refitting False refit_on_cv False fit_out_of_design False fit_abandoned False dont_jit_compile False num_restarts 20 raw_samples 1024 max_num_of_parallel_sruns 16 no_transform_inputs False no_normalize_y False transforms [] number_of_generators 1 num_parallel_jobs 1 worker_timeout 60 slurm_use_srun False time 60 partition alpha reservation None force_local_execution False slurm_signal_delay_s 0 nodes_per_job 1 cpus_per_task 1 account None gpus 1 dependency None run_mode local verbose False verbose_break_run_search_table False debug False flame_graph False memray False no_sleep False tests False show_worker_percentage_table_at_end False auto_exclude_defective_hosts False run_tests_that_fail_on_taurus False raise_in_eval False show_ram_every_n_seconds 0 show_generation_and_submission_sixel False just_return_defaults False prettyprint False runtime_debug False debug_stack_regex debug_stack_trace_regex None show_func_name False beartype False
This logs the CPU and RAM usage of the main worker process.
timestamp,ram_usage_mb,cpu_usage_percent
1784200124,887.359375,26.6
! No notable correlations between parameters were found (threshold: |r| > 0.3).Top-5 Best Results Parameter Sensitivity Ranking Parameters ranked by absolute Pearson correlation with each result. Stronger correlations (|r| ≥ 0.7) suggest the parameter has more influence on the outcome.
Parameter statistics Parameter Min Max Mean Std Dev Count run_time 6 6 6 0 2 RESULT 5111234 7391234 6251234 1140000 2 x 511 739 625 114 2 y 1234 1234 1234 0 2 z 111 111 111 0 2
0 (7s)
1 (8s)
submitit INFO (2026-07-16 11:08:47,098 ) - Starting with JobEnvironment(job_id=85194, hostname=runnervm5mmn9, local_rank=0(1), node=0(1), global_rank=0(1))
submitit INFO (2026-07-16 11:08:47,098 ) - Loading pickle: /home/runner/work/OmniOpt/OmniOpt/runs/EXTERNAL_GENERATOR_test/0/single_runs/85194/85194_submitted.pkl
Trial-Index: 0
Parameters: {"x": 511, "y": 1234, "z": 111}
Debug-Infos:
echo "RESULT: 5111234" && echo "RESULT2: 111"
stdout:
RESULT: 5111234
RESULT2: 111
stderr was empty
Result: {'RESULT': 5111234.0}
Final-results: {'RESULT': 5111234.0}
EXIT_CODE: 0
submitit INFO (2026-07-16 11:08:54,756 ) - Job completed successfully
submitit INFO (2026-07-16 11:08:54,756 ) - Exiting after successful completion
Click here to enable the export (reloads the site)
