Experiment overview
| Setting | Value |
|---|
| Model for non-random steps | EXTERNAL_GENERATOR |
| Max. nr. evaluations | 2 |
| Number random steps | 1 |
| Nr. of workers (parameter) | 1 |
| Main process memory (GB) | 8 |
| Worker memory (GB) | 1 |
Best RESULT, max (total: 2)
| OO_Info_SLURM_JOB_ID | x | y | z | RESULT |
|---|
| 1170299 | 622 | 5431 | 111 | 6225431.0 |
Job Summary per Generation Node
| Generation Node | Total | COMPLETED |
| SOBOL | 1 | 1 |
| EXTERNAL_GENERATOR | 1 | 1 |
Experiment parameters
| Name | Type | Lower bound | Upper bound | Values | Type | Log Scale? |
|---|
| x | range | 123 | 1000 | | int | No |
| y | choice | | | 5431, 1234 | | |
| z | fixed | | | 111 | | |
Number of evaluations
| Failed |
Succeeded |
Running |
Total |
| 0 |
2 |
0 |
2 |
Result names and types
Last progressbar status
2025-10-25 01:23:04 (f09601a5-d732-477b-9451-97a9cc4e419c): SOBOL, best RESULT: 6225431, waiting for 1 job, finished 1 job
Git-Version
Commit: 87dbf732124d22378d92f4f9fd4a3243b54c0639 (8885)
trial_index,submit_time,queue_time,worker_generator_uuid,start_time,end_time,run_time,program_string,exit_code,signal,hostname,OO_Info_SLURM_JOB_ID,arm_name,trial_status,generation_node,RESULT,x,y,z
0,1761348010,75,f09601a5-d732-477b-9451-97a9cc4e419c,1761348085,1761348085,0,echo "RESULT: 6225431" && echo "RESULT2: 111",0,,c111,1170299,0_0,COMPLETED,SOBOL,6225431,622,5431,111
1,1761348089,91,f09601a5-d732-477b-9451-97a9cc4e419c,1761348180,1761348180,0,echo "RESULT: 2491234" && echo "RESULT2: 111",0,,c148,1170309,1_0,COMPLETED,EXTERNAL_GENERATOR,2491234,249,1234,111
========================================================================
To cancel, press CTRL c, then run 'scancel 1170292'
⠋ Importing logging...
⠋ Importing warnings...
⠋ Importing argparse...
⠋ Importing datetime...
⠋ Importing dataclass...
⠋ Importing socket...
⠋ Importing stat...
⠋ Importing pwd...
⠋ Importing base64...
⠋ Importing json...
⠋ Importing yaml...
⠋ Importing toml...
⠋ Importing csv...
⠋ Importing ast...
⠋ Importing rich.table...
⠋ Importing rich print...
⠋ Importing rich.pretty...
⠋ Importing pformat...
⠋ Importing rich.prompt...
⠋ Importing types.FunctionType...
⠋ Importing typing...
⠋ Importing ThreadPoolExecutor...
⠋ Importing submitit.LocalExecutor...
⠋ Importing submitit.Job...
⠋ Importing importlib.util...
⠋ Importing platform...
⠋ Importing inspect frame info...
⠋ Importing pathlib.Path...
⠋ Importing uuid...
⠋ Importing cowsay...
⠋ Importing shutil...
⠋ Importing itertools.combinations...
⠋ Importing os.listdir...
⠋ Importing os.path...
⠋ Importing PIL.Image...
⠋ Importing sixel...
⠋ Importing subprocess...
⠋ Importing tqdm...
⠙ Importing beartype...
⠋ Importing statistics...
⠋ Trying to import pyfiglet...
⠹ Importing helpers...
⠋ Parsing arguments...
⠴ Importing torch...
⠋ Importing numpy...
[WARNING 10-25 01:19:52] ax.service.utils.with_db_settings_base: Ax currently requires a sqlalchemy version below 2.0. This will be addressed in a future release. Disabling SQL storage in Ax for now, if you would like to use SQL storage please install Ax with mysql extras via `pip install ax-platform[mysql]`.
⠋ Importing ax...
⠋ Importing ax.core.generator_run...
⠋ Importing Cont_X_trans and Y_trans from ax.adapter.registry...
⠋ Importing ax.core.arm...
⠋ Importing ax.core.objective...
⠋ Importing ax.core.Metric...
⠋ Importing ax.exceptions.core...
⠋ Importing ax.exceptions.generation_strategy...
⠋ Importing CORE_DECODER_REGISTRY...
⠋ Trying ax.generation_strategy.generation_node...
⠋ Importing GenerationStep, GenerationStrategy from generation_strategy...
⠋ Importing GenerationNode from generation_node...
⠋ Importing ExternalGenerationNode...
⠋ Importing MaxTrials...
⠋ Importing GeneratorSpec...
⠋ Importing Models from ax.generation_strategy.registry...
⠋ Importing get_pending_observation_features...
⠋ Importing load_experiment...
⠋ Importing save_experiment...
⠋ Importing save_experiment_to_db...
⠋ Importing TrialStatus...
⠋ Importing Data...
⠋ Importing Experiment...
⠋ Importing parameter types...
⠋ Importing TParameterization...
⠋ Importing pandas...
⠋ Importing AxClient and ObjectiveProperties...
⠋ Importing RandomForestRegressor...
⠋ Importing botorch...
⠋ Importing submitit...
⠋ Importing ax logger...
⠋ Importing SQL-Storage-Stuff...
Run-UUID: 4f0c8706-ff55-4d89-9f5c-1d7584fb8f21
####### ## ## ## ## #### ####### ######## ######## #######
## ## ### ### ### ## ## ## ## ## ## ## ## ##
## ## #### #### #### ## ## ## ## ## ## ## ##
## ## ## ### ## ## ## ## ## ## ## ######## ## #######
## ## ## ## ## #### ## ## ## ## ## ##
## ## ## ## ## ### ## ## ## ## ## ##
####### ## ## ## ## #### ####### ## ## #########
⠋ Writing worker creation log...
omniopt --partition=alpha --experiment_name=EXTERNAL_GENERATOR_test --mem_gb=1 --time=60 --worker_timeout=60 --max_eval=2 --num_parallel_jobs=1 --gpus=1 --num_random_steps=1 --follow --live_share --send_anonymized_usage_stats --result_names RESULT=max --run_program=ZWNobyAiUkVTVUxUOiAlKHgpJSh5KSIgJiYgZWNobyAiUkVTVUxUMjogJXoi --cpus_per_task=1 --nodes_per_job=1 --generate_all_jobs_at_once --revert_to_random_when_seemingly_exhausted --model=EXTERNAL_GENERATOR --run_mode=local --occ_type=euclid --main_process_gb=8 --max_nr_of_zero_results=1 --slurm_signal_delay_s=0 --n_estimators_randomforest=100 --parameter x range 123 1000 int false --parameter y choice 5431,1234 --parameter z fixed 111 --external_generator=cHl0aG9uMyAvZGF0YS9ob3JzZS93cy9zMzgxMTE0MS1vb19jcmFwL29tbmlvcHQvLnRlc3RzL2V4YW1wbGVfZXh0ZXJuYWwucHkK
⠋ Disabling logging...
⠋ Setting run folder...
⠋ Creating folder /data/horse/ws/s3811141-oo_crap/omniopt/runs/EXTERNAL_GENERATOR_test/3...
⠋ Writing revert_to_random_when_seemingly_exhausted file ...
⠋ Writing username state file...
⠋ Writing result names file...
⠋ Writing result min/max file...
⠋ Saving state files...
Run-folder: /data/horse/ws/s3811141-oo_crap/omniopt/runs/EXTERNAL_GENERATOR_test/3
⠋ Writing live_share file if it is present...
⠋ Writing job_start_time file...
⠴ Writing git information
⠋ Checking max_eval...
⠋ Calculating number of steps...
⠋ Adding excluded nodes...
⠋ Initializing ax_client...
⠋ Setting orchestrator...
See https://imageseg.scads.de/omniax/share?user_id=s3811141&experiment_name=EXTERNAL_GENERATOR_test&run_nr=6 for live-results.
You have 1 CPUs available for the main process. Using CUDA device NVIDIA H100.
Generation strategy: SOBOL for 1 step and then EXTERNAL_GENERATOR for 1 step.
Run-Program: echo "RESULT: %(x)%(y)" && echo "RESULT2: %z"
External-Generator: python3 /data/horse/ws/s3811141-oo_crap/omniopt/.tests/example_external.py
Experiment parameters
┏━━━━━━┳━━━━━━━━┳━━━━━━━━━━━━━┳━━━━━━━━━━━━━┳━━━━━━━━━━━━┳━━━━━━┳━━━━━━━━━━━━┓
┃ Name ┃ Type ┃ Lower bound ┃ Upper bound ┃ Values ┃ Type ┃ Log Scale? ┃
┡━━━━━━╇━━━━━━━━╇━━━━━━━━━━━━━╇━━━━━━━━━━━━━╇━━━━━━━━━━━━╇━━━━━━╇━━━━━━━━━━━━┩
│ x │ range │ 123 │ 1000 │ │ int │ No │
│ y │ choice │ │ │ 5431, 1234 │ │ │
│ z │ fixed │ │ │ 111 │ │ │
└──────┴────────┴─────────────┴─────────────┴────────────┴──────┴────────────┘
Result-Names
┏━━━━━━━━━━━━━┳━━━━━━━━━━━━━┓
┃ Result-Name ┃ Min or max? ┃
┡━━━━━━━━━━━━━╇━━━━━━━━━━━━━┩
│ RESULT │ max │
└─────────────┴─────────────┘
⠋ Write files and show overview
SOBOL, best RESULT: 6225431, waiting for 1 job, finished 1 job : 100%|██████████| 2/2 [02:59<00:00, 89.78s/it]
Best RESULT, max (total: 2)
┏━━━━━━━━━━━━━━━━━━━━━━┳━━━━━┳━━━━━━┳━━━━━┳━━━━━━━━━━━┓
┃ OO_Info_SLURM_JOB_ID ┃ x ┃ y ┃ z ┃ RESULT ┃
┡━━━━━━━━━━━━━━━━━━━━━━╇━━━━━╇━━━━━━╇━━━━━╇━━━━━━━━━━━┩
│ 1170299 │ 622 │ 5431 │ 111 │ 6225431.0 │
└──────────────────────┴─────┴──────┴─────┴───────────┘
2025-10-25 01:20:05 (f09601a5-d732-477b-9451-97a9cc4e419c): SOBOL, Started OmniOpt2 run...
2025-10-25 01:20:08 (f09601a5-d732-477b-9451-97a9cc4e419c): SOBOL, getting new HP set
2025-10-25 01:20:08 (f09601a5-d732-477b-9451-97a9cc4e419c): SOBOL, requested 1 jobs, got 1, 0.49 s/job
2025-10-25 01:20:09 (f09601a5-d732-477b-9451-97a9cc4e419c): SOBOL, eval #1/1 start
2025-10-25 01:20:10 (f09601a5-d732-477b-9451-97a9cc4e419c): SOBOL, starting new job
2025-10-25 01:20:10 (f09601a5-d732-477b-9451-97a9cc4e419c): SOBOL, unknown 1 = ∑1/1, started new job
2025-10-25 01:20:11 (f09601a5-d732-477b-9451-97a9cc4e419c): SOBOL, unknown 1 = ∑1/1, waiting for 1 job
2025-10-25 01:20:15 (f09601a5-d732-477b-9451-97a9cc4e419c): SOBOL, pending 1 = ∑1/1, waiting for 1 job
2025-10-25 01:21:26 (f09601a5-d732-477b-9451-97a9cc4e419c): SOBOL, pending 1 = ∑1/1, new result: RESULT: 6225431.000000
2025-10-25 01:21:29 (f09601a5-d732-477b-9451-97a9cc4e419c): SOBOL, best RESULT: 6225431, waiting for 1 job, finished 1 job
2025-10-25 01:21:29 (f09601a5-d732-477b-9451-97a9cc4e419c): SOBOL, best RESULT: 6225431, getting new HP set
2025-10-25 01:21:29 (f09601a5-d732-477b-9451-97a9cc4e419c): SOBOL, best RESULT: 6225431, requested 1 jobs, got 1, 0.52 s/job
2025-10-25 01:21:29 (f09601a5-d732-477b-9451-97a9cc4e419c): SOBOL, best RESULT: 6225431, eval #1/1 start
2025-10-25 01:21:29 (f09601a5-d732-477b-9451-97a9cc4e419c): SOBOL, best RESULT: 6225431, starting new job
2025-10-25 01:21:29 (f09601a5-d732-477b-9451-97a9cc4e419c): SOBOL, best RESULT: 6225431, unknown 1 = ∑1/1, started new job
2025-10-25 01:21:30 (f09601a5-d732-477b-9451-97a9cc4e419c): SOBOL, best RESULT: 6225431, unknown 1 = ∑1/1, waiting for 1 job
2025-10-25 01:21:32 (f09601a5-d732-477b-9451-97a9cc4e419c): SOBOL, best RESULT: 6225431, pending 1 = ∑1/1, waiting for 1 job
2025-10-25 01:23:01 (f09601a5-d732-477b-9451-97a9cc4e419c): SOBOL, best RESULT: 6225431, pending 1 = ∑1/1, new result: RESULT: 2491234.000000
2025-10-25 01:23:04 (f09601a5-d732-477b-9451-97a9cc4e419c): SOBOL, best RESULT: 6225431, waiting for 1 job, finished 1 job
Job submission durations
┏━━━━━━━━━┳━━━━━━━━━┳━━━━━━┳━━━━━━━━━━━━━━┓
┃ Batch ┃ Seconds ┃ Jobs ┃ Time per job ┃
┡━━━━━━━━━╇━━━━━━━━━╇━━━━━━╇━━━━━━━━━━━━━━┩
│ 1 │ 1.098 │ 1 │ 1.098 │
│ 2 │ 0.242 │ 1 │ 0.242 │
├─────────┼─────────┼──────┼──────────────┤
│ Average │ 0.670 │ │ │
│ Median │ 0.670 │ │ │
│ Total │ 1.341 │ │ │
│ Max │ 1.098 │ │ │
│ Min │ 0.242 │ │ │
└─────────┴─────────┴──────┴──────────────┘
Model generation times
┏━━━━━━━━━━━┳━━━━━━━━━┳━━━━━━┳━━━━━━━━━━━━━━┓
┃ Iteration ┃ Seconds ┃ Jobs ┃ Time per job ┃
┡━━━━━━━━━━━╇━━━━━━━━━╇━━━━━━╇━━━━━━━━━━━━━━┩
│ 1 │ 0.493 │ 1 │ 0.493 │
│ 2 │ 0.522 │ 1 │ 0.522 │
├───────────┼─────────┼──────┼──────────────┤
│ Average │ 0.507 │ │ │
│ Median │ 0.507 │ │ │
│ Total │ 1.015 │ │ │
│ Max │ 0.522 │ │ │
│ Min │ 0.493 │ │ │
└───────────┴─────────┴──────┴──────────────┘
Arguments Overview
| Key | Value |
|---|
| config_yaml | None |
| config_toml | None |
| config_json | None |
| num_random_steps | 1 |
| max_eval | 2 |
| run_program | [['ZWNobyAiUkVTVUxUOiAlKHgpJSh5KSIgJiYgZWNobyAiUkVTVUxUMjogJXoi']] |
| experiment_name | EXTERNAL_GENERATOR_test |
| mem_gb | 1 |
| parameter | [['x', 'range', '123', '1000', 'int', 'false'], ['y', 'choice', '5431,1234'], ['z', 'fixed', '111']] |
| continue_previous_job | None |
| experiment_constraints | None |
| run_dir | runs |
| seed | None |
| verbose_tqdm | False |
| model | EXTERNAL_GENERATOR |
| gridsearch | False |
| occ | False |
| show_sixel_scatter | False |
| show_sixel_general | False |
| show_sixel_trial_index_result | False |
| follow | True |
| send_anonymized_usage_stats | True |
| ui_url | None |
| root_venv_dir | /home/s3811141 |
| exclude | None |
| main_process_gb | 8 |
| max_nr_of_zero_results | 1 |
| abbreviate_job_names | False |
| orchestrator_file | None |
| checkout_to_latest_tested_version | False |
| live_share | True |
| disable_tqdm | False |
| disable_previous_job_constraint | False |
| workdir | |
| occ_type | euclid |
| result_names | ['RESULT=max'] |
| minkowski_p | 2 |
| signed_weighted_euclidean_weights | |
| generation_strategy | None |
| generate_all_jobs_at_once | True |
| revert_to_random_when_seemingly_exhausted | True |
| load_data_from_existing_jobs | [] |
| n_estimators_randomforest | 100 |
| max_attempts_for_generation | 20 |
| external_generator | cHl0aG9uMyAvZGF0YS9ob3JzZS93cy9zMzgxMTE0MS1vb19jcmFwL29tbmlvcHQvLnRlc3RzL2V4YW1wbGVfZXh0ZXJuYWwucHkK |
| username | None |
| max_failed_jobs | None |
| num_cpus_main_job | None |
| calculate_pareto_front_of_job | [] |
| show_generate_time_table | False |
| force_choice_for_ranges | False |
| max_abandoned_retrial | 20 |
| share_password | None |
| dryrun | False |
| db_url | None |
| run_program_once | None |
| worker_generator_path | None |
| save_to_database | False |
| range_max_difference | 1000000 |
| skip_search | False |
| dont_warm_start_refitting | False |
| refit_on_cv | False |
| fit_out_of_design | False |
| fit_abandoned | False |
| dont_jit_compile | False |
| num_restarts | 20 |
| raw_samples | 1024 |
| max_num_of_parallel_sruns | 16 |
| no_transform_inputs | False |
| no_normalize_y | False |
| transforms | [] |
| number_of_generators | 1 |
| num_parallel_jobs | 1 |
| worker_timeout | 60 |
| slurm_use_srun | False |
| time | 60 |
| partition | alpha |
| reservation | None |
| force_local_execution | False |
| slurm_signal_delay_s | 0 |
| nodes_per_job | 1 |
| cpus_per_task | 1 |
| account | None |
| gpus | 1 |
| dependency | None |
| run_mode | local |
| verbose | False |
| verbose_break_run_search_table | False |
| debug | False |
| flame_graph | False |
| memray | False |
| no_sleep | False |
| tests | False |
| show_worker_percentage_table_at_end | False |
| auto_exclude_defective_hosts | False |
| run_tests_that_fail_on_taurus | False |
| raise_in_eval | False |
| show_ram_every_n_seconds | 0 |
| show_generation_and_submission_sixel | False |
| just_return_defaults | False |
| prettyprint | False |
| runtime_debug | False |
| debug_stack_regex | |
| debug_stack_trace_regex | None |
| show_func_name | False |
| beartype | False |
1761347997.0233,1,0,0
1761348009.9762,1,0,0
1761348010.7731,1,1,100
1761348184.9917,1,1,100
1761348187.1137,1,0,0
This logs the CPU and RAM usage of the main worker process.
timestamp,ram_usage_mb,cpu_usage_percent
1761347997,807.9921875,6.1
1761348057,820.1796875,5.1
1761348117,823.1796875,7.3
1761348177,823.1796875,5.9
Parameter statistics
| Parameter | Min | Max | Mean | Std Dev | Count |
|---|
| run_time | 0 | 0 | 0 | 0 | 2 |
| RESULT | 2491234 | 6225431 | 4358332.5 | 1867098.5 | 2 |
| x | 249 | 622 | 435.5 | 186.5 | 2 |
| y | 1234 | 5431 | 3332.5 | 2098.5 | 2 |
| z | 111 | 111 | 111 | 0 | 2 |
Show SLURM-Job-ID (if it exists)
submitit INFO (2025-10-25 01:21:18,059) - Starting with JobEnvironment(job_id=1170299, hostname=c111, local_rank=0(1), node=0(1), global_rank=0(1))
submitit INFO (2025-10-25 01:21:18,061) - Loading pickle: /data/horse/ws/s3811141-oo_crap/omniopt/runs/EXTERNAL_GENERATOR_test/3/single_runs/1170299/1170299_submitted.pkl
Trial-Index: 0
Parameters: {"x": 622, "y": 5431, "z": 111}
Debug-Infos:
echo "RESULT: 6225431" && echo "RESULT2: 111"
stdout:
RESULT: 6225431
RESULT2: 111
stderr was empty
Result: {'RESULT': 6225431.0}
Final-results: {'RESULT': 6225431.0}
EXIT_CODE: 0
submitit INFO (2025-10-25 01:21:25,462) - Job completed successfully
submitit INFO (2025-10-25 01:21:25,477) - Exiting after successful completion