OmniOpt2

Experiment overview

Setting	Value
Max. nr. evaluations	23
Number random steps	1
Nr. of workers (parameter)	10

Best RESULT, min (total: 5, failed: 18)

program	RESULT
perl	0.0331842635

Job Summary per Generation Node

Generation Node	Total	COMPLETED	FAILED
SOBOL	2	1	1
BOTORCH_MODULAR	21	4	17

Experiment parameters

Name	Type	Values
program	choice	divide_by_0, simple_ok, perl, exit_code_137, result_but_exit_code_stdout_stderr, exit_code_stdout, signal_but_has_output,
		exit_code_no_output, exit_code_stdout_stderr, module_not_found, signal, empty, file_does_not_exist,
		sleep_10_and_result_exit_252, no_chmod_x, no_shebang, perl_module_fail, segfault, wrong_arch, python_name_error, syntax_error,
		tensorflow_syntax_error, force_keyboard_interrupt

Number of evaluations

Failed	Succeeded	Running	Total
18	5	0	23

Result names and types

name	min/max
RESULT	min

Git-Version

Commit: 7c9529f03bd96807cf7d7122f48a4f29e029e3a9 (9875-63-g7c9529f03)

trial_index,submit_time,queue_time,worker_generator_uuid,start_time,end_time,run_time,program_string,exit_code,signal,hostname,arm_name,trial_status,generation_node,RESULT,program
0,1788276535,6,bae57872-5a12-4566-a045-51371e1be4c3,1788276541,1788276547,6,./.tests/test_wronggoing_stuff.bin/bin/tensorflow_syntax_error,1,,norman-20fms48v00,0_0,FAILED,SOBOL,,tensorflow_syntax_error
1,1788276549,6,bae57872-5a12-4566-a045-51371e1be4c3,1788276555,1788276567,12,./.tests/test_wronggoing_stuff.bin/bin/sleep_10_and_result_exit_252,252,,norman-20fms48v00,1_0,COMPLETED,SOBOL,1234,sleep_10_and_result_exit_252
2,1788276571,6,bae57872-5a12-4566-a045-51371e1be4c3,1788276577,1788276584,7,./.tests/test_wronggoing_stuff.bin/bin/perl_module_fail,2,,norman-20fms48v00,2_0,FAILED,BOTORCH_MODULAR,,perl_module_fail
3,1788276589,6,bae57872-5a12-4566-a045-51371e1be4c3,1788276595,1788276601,6,./.tests/test_wronggoing_stuff.bin/bin/force_keyboard_interrupt,130,,norman-20fms48v00,3_0,FAILED,BOTORCH_MODULAR,,force_keyboard_interrupt
4,1788276607,5,bae57872-5a12-4566-a045-51371e1be4c3,1788276612,1788276618,6,./.tests/test_wronggoing_stuff.bin/bin/divide_by_0,255,,norman-20fms48v00,4_0,FAILED,BOTORCH_MODULAR,,divide_by_0
5,1788276621,5,bae57872-5a12-4566-a045-51371e1be4c3,1788276626,1788276632,6,./.tests/test_wronggoing_stuff.bin/bin/wrong_arch,126,,norman-20fms48v00,5_0,FAILED,BOTORCH_MODULAR,,wrong_arch
6,1788276636,5,bae57872-5a12-4566-a045-51371e1be4c3,1788276641,1788276647,6,./.tests/test_wronggoing_stuff.bin/bin/module_not_found,1,,norman-20fms48v00,6_0,FAILED,BOTORCH_MODULAR,,module_not_found
7,1788276650,5,bae57872-5a12-4566-a045-51371e1be4c3,1788276655,1788276661,6,./.tests/test_wronggoing_stuff.bin/bin/no_chmod_x,126,,norman-20fms48v00,7_0,FAILED,BOTORCH_MODULAR,,no_chmod_x
8,1788276667,6,bae57872-5a12-4566-a045-51371e1be4c3,1788276673,1788276679,6,./.tests/test_wronggoing_stuff.bin/bin/result_but_exit_code_stdout_stderr,5,,norman-20fms48v00,8_0,COMPLETED,BOTORCH_MODULAR,1451767068,result_but_exit_code_stdout_stderr
9,1788276701,6,bae57872-5a12-4566-a045-51371e1be4c3,1788276707,1788276713,6,./.tests/test_wronggoing_stuff.bin/bin/empty,126,,norman-20fms48v00,9_0,FAILED,BOTORCH_MODULAR,,empty
10,1788276732,5,bae57872-5a12-4566-a045-51371e1be4c3,1788276737,1788276743,6,./.tests/test_wronggoing_stuff.bin/bin/exit_code_no_output,5,,norman-20fms48v00,10_0,FAILED,BOTORCH_MODULAR,,exit_code_no_output
11,1788276760,6,bae57872-5a12-4566-a045-51371e1be4c3,1788276766,1788276772,6,./.tests/test_wronggoing_stuff.bin/bin/python_name_error,1,,norman-20fms48v00,11_0,FAILED,BOTORCH_MODULAR,,python_name_error
12,1788276792,6,bae57872-5a12-4566-a045-51371e1be4c3,1788276798,1788276804,6,./.tests/test_wronggoing_stuff.bin/bin/exit_code_stdout_stderr,5,,norman-20fms48v00,12_0,FAILED,BOTORCH_MODULAR,,exit_code_stdout_stderr
13,1788276835,6,bae57872-5a12-4566-a045-51371e1be4c3,1788276841,1788276847,6,./.tests/test_wronggoing_stuff.bin/bin/file_does_not_exist,127,,norman-20fms48v00,13_0,FAILED,BOTORCH_MODULAR,,file_does_not_exist
14,1788276864,5,bae57872-5a12-4566-a045-51371e1be4c3,1788276869,1788276876,7,./.tests/test_wronggoing_stuff.bin/bin/exit_code_stdout,5,,norman-20fms48v00,14_0,COMPLETED,BOTORCH_MODULAR,504583681,exit_code_stdout
15,1788276918,8,bae57872-5a12-4566-a045-51371e1be4c3,1788276926,1788276932,6,./.tests/test_wronggoing_stuff.bin/bin/signal,137,,norman-20fms48v00,15_0,FAILED,BOTORCH_MODULAR,,signal
16,1788277038,4,bae57872-5a12-4566-a045-51371e1be4c3,1788277042,1788277048,6,./.tests/test_wronggoing_stuff.bin/bin/perl,0,,norman-20fms48v00,16_0,COMPLETED,BOTORCH_MODULAR,0.033184263499999998303646719933,perl
17,1788277065,5,bae57872-5a12-4566-a045-51371e1be4c3,1788277070,1788277076,6,./.tests/test_wronggoing_stuff.bin/bin/syntax_error,1,,norman-20fms48v00,17_0,FAILED,BOTORCH_MODULAR,,syntax_error
18,1788277268,9,bae57872-5a12-4566-a045-51371e1be4c3,1788277277,1788277284,7,./.tests/test_wronggoing_stuff.bin/bin/signal_but_has_output,137,,norman-20fms48v00,18_0,FAILED,BOTORCH_MODULAR,,signal_but_has_output
19,1788277337,6,bae57872-5a12-4566-a045-51371e1be4c3,1788277343,1788277350,7,./.tests/test_wronggoing_stuff.bin/bin/exit_code_137,137,,norman-20fms48v00,19_0,FAILED,BOTORCH_MODULAR,,exit_code_137
20,1788277456,10,bae57872-5a12-4566-a045-51371e1be4c3,1788277466,1788277472,6,./.tests/test_wronggoing_stuff.bin/bin/segfault,139,,norman-20fms48v00,20_0,FAILED,BOTORCH_MODULAR,,segfault
21,1788277662,6,bae57872-5a12-4566-a045-51371e1be4c3,1788277668,1788277674,6,./.tests/test_wronggoing_stuff.bin/bin/simple_ok,0,,norman-20fms48v00,21_0,COMPLETED,BOTORCH_MODULAR,376019624,simple_ok
22,,,,,,,,,,,22_0,FAILED,BOTORCH_MODULAR,,no_shebang


⚠ Raw data does not conform to the expected structure. Expected either a tuple of (mean, SEM) or a float, but got None.


⚠ Raw data does not conform to the expected structure. Expected either a tuple of (mean, SEM) or a float, but got None.


⚠ Raw data does not conform to the expected structure. Expected either a tuple of (mean, SEM) or a float, but got None.


⚠ Raw data does not conform to the expected structure. Expected either a tuple of (mean, SEM) or a float, but got None.


⚠ Raw data does not conform to the expected structure. Expected either a tuple of (mean, SEM) or a float, but got None.


⚠ Raw data does not conform to the expected structure. Expected either a tuple of (mean, SEM) or a float, but got None.


⚠ Raw data does not conform to the expected structure. Expected either a tuple of (mean, SEM) or a float, but got None.


⚠ Raw data does not conform to the expected structure. Expected either a tuple of (mean, SEM) or a float, but got None.


⚠ Raw data does not conform to the expected structure. Expected either a tuple of (mean, SEM) or a float, but got None.


⚠ Raw data does not conform to the expected structure. Expected either a tuple of (mean, SEM) or a float, but got None.


⚠ Raw data does not conform to the expected structure. Expected either a tuple of (mean, SEM) or a float, but got None.


⚠ Raw data does not conform to the expected structure. Expected either a tuple of (mean, SEM) or a float, but got None.


⚠ Raw data does not conform to the expected structure. Expected either a tuple of (mean, SEM) or a float, but got None.


⚠ Raw data does not conform to the expected structure. Expected either a tuple of (mean, SEM) or a float, but got None.


⚠ Raw data does not conform to the expected structure. Expected either a tuple of (mean, SEM) or a float, but got None.


⚠ Raw data does not conform to the expected structure. Expected either a tuple of (mean, SEM) or a float, but got None.


⚠ Raw data does not conform to the expected structure. Expected either a tuple of (mean, SEM) or a float, but got None.


⚠ Job 736996 (task: 0) with path /home/norman/repos/OmniOpt/runs/test_wronggoing_stuff/3/single_runs/736996/736996_0_result.pkl
has not produced any output (state: FINISHED)
No error stream produced. Look at stdout: /home/norman/repos/OmniOpt/runs/test_wronggoing_stuff/3/single_runs/736996/736996_0_log.out
----------------------------------------
submitit INFO (2026-09-01 17:50:45,475) - Starting with JobEnvironment(job_id=736996, hostname=norman-20fms48v00, local_rank=0(1), node=0(1), global_rank=0(1))
submitit INFO (2026-09-01 17:50:45,476) - Loading pickle: /home/norman/repos/OmniOpt/runs/test_wronggoing_stuff/3/single_runs/736996/736996_submitted.pkl
Trial-Index: 22

         Job submission durations          
┏━━━━━━━━━┳━━━━━━━━━┳━━━━━━┳━━━━━━━━━━━━━━┓
┃   Batch ┃ Seconds ┃ Jobs ┃ Time per job ┃
┡━━━━━━━━━╇━━━━━━━━━╇━━━━━━╇━━━━━━━━━━━━━━┩
│       1 │   0.525 │    1 │        0.525 │
│       2 │   0.127 │    1 │        0.127 │
│       3 │   0.147 │    1 │        0.147 │
│       4 │   0.171 │    1 │        0.171 │
│       5 │   0.206 │    1 │        0.206 │
│       6 │   0.168 │    1 │        0.168 │
│       7 │   0.166 │    1 │        0.166 │
│       8 │   0.212 │    1 │        0.212 │
│       9 │   0.206 │    1 │        0.206 │
│      10 │   0.321 │    1 │        0.321 │
│      11 │   0.191 │    1 │        0.191 │
│      12 │   0.231 │    1 │        0.231 │
│      13 │   0.200 │    1 │        0.200 │
│      14 │   0.242 │    1 │        0.242 │
│      15 │   0.217 │    1 │        0.217 │
│      16 │   0.170 │    1 │        0.170 │
│      17 │   0.126 │    1 │        0.126 │
│      18 │   0.177 │    1 │        0.177 │
│      19 │   0.326 │    1 │        0.326 │
│      20 │   0.189 │    1 │        0.189 │
│      21 │   0.660 │    1 │        0.660 │
│      22 │   0.435 │    1 │        0.435 │
│      23 │   0.364 │    1 │        0.364 │
├─────────┼─────────┼──────┼──────────────┤
│ Average │   0.251 │      │              │
│  Median │   0.206 │      │              │
│   Total │   5.774 │      │              │
│     Max │   0.660 │      │              │
│     Min │   0.126 │      │              │
└─────────┴─────────┴──────┴──────────────┘

           Model generation times            
┏━━━━━━━━━━━┳━━━━━━━━━┳━━━━━━┳━━━━━━━━━━━━━━┓
┃ Iteration ┃ Seconds ┃ Jobs ┃ Time per job ┃
┡━━━━━━━━━━━╇━━━━━━━━━╇━━━━━━╇━━━━━━━━━━━━━━┩
│         1 │   0.100 │    1 │        0.100 │
│         2 │   0.083 │    1 │        0.083 │
│         3 │   1.422 │    1 │        1.422 │
│         4 │   3.077 │    1 │        3.077 │
│         5 │   3.943 │    1 │        3.943 │
│         6 │   1.082 │    1 │        1.082 │
│         7 │   3.304 │    1 │        3.304 │
│         8 │   1.081 │    1 │        1.081 │
│         9 │   2.634 │    1 │        2.634 │
│        10 │  18.712 │    1 │       18.712 │
│        11 │  16.426 │    1 │       16.426 │
│        12 │  14.333 │    1 │       14.333 │
│        13 │  17.956 │    1 │       17.956 │
│        14 │  28.355 │    1 │       28.355 │
│        15 │  14.415 │    1 │       14.415 │
│        16 │  37.504 │    1 │       37.504 │
│        17 │ 103.093 │    1 │      103.093 │
│        18 │  12.970 │    1 │       12.970 │
│        19 │ 188.307 │    1 │      188.307 │
│        20 │  48.839 │    1 │       48.839 │
│        21 │  99.297 │    1 │       99.297 │
│        22 │ 186.179 │    1 │      186.179 │
│        23 │ 163.282 │    1 │      163.282 │
├───────────┼─────────┼──────┼──────────────┤
│   Average │  42.017 │      │              │
│    Median │  14.415 │      │              │
│     Total │ 966.392 │      │              │
│       Max │ 188.307 │      │              │
│       Min │   0.083 │      │              │
└───────────┴─────────┴──────┴──────────────┘

Arguments Overview

Key	Value
install	False
config_yaml	None
config_toml	None
config_json	None
num_random_steps	1
max_eval	23
run_program	[['Li8udGVzdHMvdGVzdF93cm9uZ2dvaW5nX3N0dWZmLmJpbi9iaW4vJShwcm9ncmFtKQ==']]
experiment_name	test_wronggoing_stuff
mem_gb	1
parameter	[['program', 'choice',
	'divide_by_0,simple_ok,perl,exit_code_137,result_but_exit_code_stdout_stderr,exit_code_stdout,signal_…
continue_previous_job	None
experiment_constraints	None
run_dir	runs
seed	None
verbose_tqdm	False
model	None
gridsearch	False
occ	False
show_sixel_scatter	False
show_sixel_general	False
show_sixel_trial_index_result	False
follow	True
wait_until_ended	False
send_anonymized_usage_stats	True
ui_url	None
root_venv_dir	/home/norman
exclude	None
main_process_gb	8
max_nr_of_zero_results	3
abbreviate_job_names	False
orchestrator_file	None
checkout_to_latest_tested_version	False
live_share	True
disable_tqdm	False
disable_previous_job_constraint	False
workdir
occ_type	euclid
result_names	['RESULT=min']
minkowski_p	2
signed_weighted_euclidean_weights
generation_strategy	None
generate_all_jobs_at_once	False
revert_to_random_when_seemingly_exhausted	False
load_data_from_existing_jobs	[]
n_estimators_randomforest	100
max_attempts_for_generation	20
external_generator	None
optuna_sampler	None
optuna_pruner	none
optuna_n_startup_trials	10
optuna_multivariate	False
optuna_group	False
optuna_constraints	False
optuna_n_ei_candidates	0
optuna_storage	None
optuna_study_name	omniopt_study
optuna_no_load_if_exists	False
optuna_extra_iters	1
username	None
max_failed_jobs	None
num_cpus_main_job	None
calculate_pareto_front_of_job	[]
show_generate_time_table	False
force_choice_for_ranges	False
max_abandoned_retrial	20
share_password	None
dryrun	False
db_url	None
run_program_once	None
worker_generator_path	None
save_to_database	False
range_max_difference	1000000
skip_search	False
nr_evals_per_arm	1
dump_config	None
dont_warm_start_refitting	False
refit_on_cv	False
fit_out_of_design	False
fit_abandoned	False
dont_jit_compile	False
num_restarts	20
raw_samples	1024
max_num_of_parallel_sruns	16
no_transform_inputs	False
no_normalize_y	False
transforms	[]
number_of_generators	1
num_parallel_jobs	10
worker_timeout	1
slurm_use_srun	False
time	120
partition	alpha
reservation	None
force_local_execution	False
slurm_signal_delay_s	0
nodes_per_job	1
cpus_per_task	1
account	None
gpus	0
dependency	None
run_mode	local
verbose	False
verbose_break_run_search_table	False
debug	False
flame_graph	False
memray	False
no_sleep	False
tests	False
show_worker_percentage_table_at_end	False
auto_exclude_defective_hosts	False
run_tests_that_fail_on_taurus	False
raise_in_eval	False
show_ram_every_n_seconds	0
show_generation_and_submission_sixel	False
just_return_defaults	False
prettyprint	False
runtime_debug	False
debug_stack_regex
debug_stack_trace_regex	None
show_func_name	False
beartype	False

This logs the CPU and RAM usage of the main worker process.

timestamp,ram_usage_mb,cpu_usage_percent
1788276534,870.98828125,84.6
1788276602,897.83984375,79.8
1788276663,899.1953125,76.6
1788276732,901.2890625,86
1788276806,902.30078125,92.3
1788276877,903.3984375,90.4
1788276958,904.21484375,96.1
1788277038,904.9921875,92.3
1788277115,905.328125,81.8
1788277216,905.34765625,99.4
1788277312,905.35546875,96.2
1788277410,905.35546875,99.1
1788277500,905.3671875,98.7
1788277598,905.41796875,98.6
1788277676,905.5078125,98.9
1788277775,905.51171875,98.9
1788277922,903.43359375,94.7

! No notable correlations between parameters were found (threshold: |r| > 0.3).

Top-5 Best Results

Parameter Sensitivity Ranking

Parameters ranked by absolute Pearson correlation with each result. Stronger correlations (|r| ≥ 0.7) suggest the parameter has more influence on the outcome.

Convergence Analysis

Parameter statistics

Parameter	Min	Max	Mean	Std Dev	Count
run_time	6	12	6.4545	1.2695	22
RESULT	0.0332	1451767068	466474321.4066	532096157.8205	5
program	No numerical statistics available

submitit INFO (2026-09-01 15:40:18,278) - Starting with JobEnvironment(job_id=638318, hostname=norman-20fms48v00, local_rank=0(1), node=0(1), global_rank=0(1))
submitit INFO (2026-09-01 15:40:18,278) - Loading pickle: /home/norman/repos/OmniOpt/runs/test_wronggoing_stuff/1/single_runs/638318/638318_submitted.pkl
Trial-Index: 0
This has stderr

Parameters: {"program": "exit_code_stdout_stderr"}
Debug-Infos: 
========
DEBUG INFOS START:
Program-Code: ./.tests/test_wronggoing_stuff.bin/bin/exit_code_stdout_stderr
pwd: /home/norman/repos/OmniOpt
File: ./.tests/test_wronggoing_stuff.bin/bin/exit_code_stdout_stderr
UID: 1000
GID: 1000
Status-Change-Time: 1786435199.7236452
Size: 318 Bytes
Permissions: -rwxr-xr-x
Owner: norman
Last access: 1788196485.8636093
Last modification: 1786435199.7236452
Hostname: norman-20fms48v00
========
DEBUG INFOS END

./.tests/test_wronggoing_stuff.bin/bin/exit_code_stdout_stderr
stdout:
 This has stdout

stderr:
 This has stderr

Result: {'RESULT': None}
Final-results: {'RESULT': None}
EXIT_CODE: 5
submitit INFO (2026-09-01 15:40:27,051) - Job completed successfully
submitit INFO (2026-09-01 15:40:27,051) - Exiting after successful completion