OmniOpt2

Experiment overview

Setting	Value
Max. nr. evaluations	23
Number random steps	1
Nr. of workers (parameter)	10

Best RESULT, min (total: 5, failed: 18)

program	RESULT
perl	0.38641190140000004

Job Summary per Generation Node

Generation Node	Total	COMPLETED	FAILED
SOBOL	5	1	4
BOTORCH_MODULAR	18	4	14

Experiment parameters

Name	Type	Values
program	choice	divide_by_0, simple_ok, perl, exit_code_137, result_but_exit_code_stdout_stderr, exit_code_stdout, signal_but_has_output,
		exit_code_no_output, exit_code_stdout_stderr, module_not_found, signal, empty, file_does_not_exist,
		sleep_10_and_result_exit_252, no_chmod_x, no_shebang, perl_module_fail, segfault, wrong_arch, python_name_error, syntax_error,
		tensorflow_syntax_error, force_keyboard_interrupt

Number of evaluations

Failed	Succeeded	Running	Total
18	5	0	23

Result names and types

name	min/max
RESULT	min

Git-Version

Commit: 23a695b01c0f84e383e25d7a4fb146bb588c068d (9800-8-g23a695b01)

trial_index,submit_time,queue_time,worker_generator_uuid,start_time,end_time,run_time,program_string,exit_code,signal,hostname,arm_name,trial_status,generation_node,RESULT,program
0,1786719266,18,4a88ec96-963d-4277-8dac-e2e5dbdd1371,1786719284,1786719290,6,./.tests/test_wronggoing_stuff.bin/bin/exit_code_137,137,,norman-20fms48v00,0_0,FAILED,SOBOL,,exit_code_137
1,1786719294,14,4a88ec96-963d-4277-8dac-e2e5dbdd1371,1786719308,1786719315,7,./.tests/test_wronggoing_stuff.bin/bin/wrong_arch,126,,norman-20fms48v00,1_0,FAILED,SOBOL,,wrong_arch
2,1786719319,17,4a88ec96-963d-4277-8dac-e2e5dbdd1371,1786719336,1786719343,7,./.tests/test_wronggoing_stuff.bin/bin/signal_but_has_output,137,,norman-20fms48v00,2_0,FAILED,SOBOL,,signal_but_has_output
3,,,,,,,,,,,3_0,FAILED,SOBOL,,no_shebang
4,1786719427,7,4a88ec96-963d-4277-8dac-e2e5dbdd1371,1786719434,1786719440,6,./.tests/test_wronggoing_stuff.bin/bin/perl,0,,norman-20fms48v00,4_0,COMPLETED,SOBOL,0.386411901400000035167181522411,perl
5,1786719446,7,4a88ec96-963d-4277-8dac-e2e5dbdd1371,1786719453,1786719459,6,./.tests/test_wronggoing_stuff.bin/bin/exit_code_stdout,5,,norman-20fms48v00,5_0,COMPLETED,BOTORCH_MODULAR,728310751,exit_code_stdout
6,1786719478,8,4a88ec96-963d-4277-8dac-e2e5dbdd1371,1786719486,1786719492,6,./.tests/test_wronggoing_stuff.bin/bin/exit_code_stdout_stderr,5,,norman-20fms48v00,6_0,FAILED,BOTORCH_MODULAR,,exit_code_stdout_stderr
7,1786719510,6,4a88ec96-963d-4277-8dac-e2e5dbdd1371,1786719516,1786719523,7,./.tests/test_wronggoing_stuff.bin/bin/force_keyboard_interrupt,130,,norman-20fms48v00,7_0,FAILED,BOTORCH_MODULAR,,force_keyboard_interrupt
8,1786719540,8,4a88ec96-963d-4277-8dac-e2e5dbdd1371,1786719548,1786719554,6,./.tests/test_wronggoing_stuff.bin/bin/exit_code_no_output,5,,norman-20fms48v00,8_0,FAILED,BOTORCH_MODULAR,,exit_code_no_output
9,1786719571,8,4a88ec96-963d-4277-8dac-e2e5dbdd1371,1786719579,1786719585,6,./.tests/test_wronggoing_stuff.bin/bin/divide_by_0,255,,norman-20fms48v00,9_0,FAILED,BOTORCH_MODULAR,,divide_by_0
10,1786719602,8,4a88ec96-963d-4277-8dac-e2e5dbdd1371,1786719610,1786719618,8,./.tests/test_wronggoing_stuff.bin/bin/perl_module_fail,2,,norman-20fms48v00,10_0,FAILED,BOTORCH_MODULAR,,perl_module_fail
11,1786719634,6,4a88ec96-963d-4277-8dac-e2e5dbdd1371,1786719640,1786719646,6,./.tests/test_wronggoing_stuff.bin/bin/signal,137,,norman-20fms48v00,11_0,FAILED,BOTORCH_MODULAR,,signal
12,1786719661,7,4a88ec96-963d-4277-8dac-e2e5dbdd1371,1786719668,1786719674,6,./.tests/test_wronggoing_stuff.bin/bin/tensorflow_syntax_error,1,,norman-20fms48v00,12_0,FAILED,BOTORCH_MODULAR,,tensorflow_syntax_error
13,1786719689,7,4a88ec96-963d-4277-8dac-e2e5dbdd1371,1786719696,1786719702,6,./.tests/test_wronggoing_stuff.bin/bin/empty,126,,norman-20fms48v00,13_0,FAILED,BOTORCH_MODULAR,,empty
14,1786719736,8,4a88ec96-963d-4277-8dac-e2e5dbdd1371,1786719744,1786719756,12,./.tests/test_wronggoing_stuff.bin/bin/sleep_10_and_result_exit_252,252,,norman-20fms48v00,14_0,COMPLETED,BOTORCH_MODULAR,1234,sleep_10_and_result_exit_252
15,1786719794,13,4a88ec96-963d-4277-8dac-e2e5dbdd1371,1786719807,1786719813,6,./.tests/test_wronggoing_stuff.bin/bin/syntax_error,1,,norman-20fms48v00,15_0,FAILED,BOTORCH_MODULAR,,syntax_error
16,1786719851,15,4a88ec96-963d-4277-8dac-e2e5dbdd1371,1786719866,1786719873,7,./.tests/test_wronggoing_stuff.bin/bin/no_chmod_x,126,,norman-20fms48v00,16_0,FAILED,BOTORCH_MODULAR,,no_chmod_x
17,1786719949,10,4a88ec96-963d-4277-8dac-e2e5dbdd1371,1786719959,1786719965,6,./.tests/test_wronggoing_stuff.bin/bin/module_not_found,1,,norman-20fms48v00,17_0,FAILED,BOTORCH_MODULAR,,module_not_found
18,1786720003,7,4a88ec96-963d-4277-8dac-e2e5dbdd1371,1786720010,1786720017,7,./.tests/test_wronggoing_stuff.bin/bin/file_does_not_exist,127,,norman-20fms48v00,18_0,FAILED,BOTORCH_MODULAR,,file_does_not_exist
19,1786720091,6,4a88ec96-963d-4277-8dac-e2e5dbdd1371,1786720097,1786720103,6,./.tests/test_wronggoing_stuff.bin/bin/python_name_error,1,,norman-20fms48v00,19_0,FAILED,BOTORCH_MODULAR,,python_name_error
20,1786720240,13,4a88ec96-963d-4277-8dac-e2e5dbdd1371,1786720253,1786720259,6,./.tests/test_wronggoing_stuff.bin/bin/segfault,139,,norman-20fms48v00,20_0,FAILED,BOTORCH_MODULAR,,segfault
21,1786720425,23,4a88ec96-963d-4277-8dac-e2e5dbdd1371,1786720448,1786720455,7,./.tests/test_wronggoing_stuff.bin/bin/result_but_exit_code_stdout_stderr,5,,norman-20fms48v00,21_0,COMPLETED,BOTORCH_MODULAR,380706380,result_but_exit_code_stdout_stderr
22,1786720980,9,4a88ec96-963d-4277-8dac-e2e5dbdd1371,1786720989,1786720995,6,./.tests/test_wronggoing_stuff.bin/bin/simple_ok,0,,norman-20fms48v00,22_0,COMPLETED,BOTORCH_MODULAR,2091887873,simple_ok


⚠ Raw data does not conform to the expected structure. Expected either a tuple of (mean, SEM) or a float, but got None.


⚠ Raw data does not conform to the expected structure. Expected either a tuple of (mean, SEM) or a float, but got None.


⚠ Raw data does not conform to the expected structure. Expected either a tuple of (mean, SEM) or a float, but got None.


⚠ Job 1866005 (task: 0) with path /home/norman/repos/OmniOpt/runs/test_wronggoing_stuff/0/single_runs/1866005/1866005_0_result.pkl
has not produced any output (state: FINISHED)
No error stream produced. Look at stdout: /home/norman/repos/OmniOpt/runs/test_wronggoing_stuff/0/single_runs/1866005/1866005_0_log.out
----------------------------------------
submitit INFO (2026-08-14 16:55:50,293) - Starting with JobEnvironment(job_id=1866005, hostname=norman-20fms48v00, local_rank=0(1), node=0(1), global_rank=0(1))
submitit INFO (2026-08-14 16:55:50,294) - Loading pickle: /home/norman/repos/OmniOpt/runs/test_wronggoing_stuff/0/single_runs/1866005/1866005_submitted.pkl
Trial-Index: 3



⚠ Raw data does not conform to the expected structure. Expected either a tuple of (mean, SEM) or a float, but got None.


⚠ Raw data does not conform to the expected structure. Expected either a tuple of (mean, SEM) or a float, but got None.


⚠ Raw data does not conform to the expected structure. Expected either a tuple of (mean, SEM) or a float, but got None.


⚠ Raw data does not conform to the expected structure. Expected either a tuple of (mean, SEM) or a float, but got None.


⚠ Raw data does not conform to the expected structure. Expected either a tuple of (mean, SEM) or a float, but got None.


⚠ Raw data does not conform to the expected structure. Expected either a tuple of (mean, SEM) or a float, but got None.


⚠ Raw data does not conform to the expected structure. Expected either a tuple of (mean, SEM) or a float, but got None.


⚠ Raw data does not conform to the expected structure. Expected either a tuple of (mean, SEM) or a float, but got None.


⚠ Raw data does not conform to the expected structure. Expected either a tuple of (mean, SEM) or a float, but got None.


⚠ Raw data does not conform to the expected structure. Expected either a tuple of (mean, SEM) or a float, but got None.


⚠ Raw data does not conform to the expected structure. Expected either a tuple of (mean, SEM) or a float, but got None.


⚠ Raw data does not conform to the expected structure. Expected either a tuple of (mean, SEM) or a float, but got None.


⚠ Raw data does not conform to the expected structure. Expected either a tuple of (mean, SEM) or a float, but got None.


⚠ Raw data does not conform to the expected structure. Expected either a tuple of (mean, SEM) or a float, but got None.

         Job submission durations          
┏━━━━━━━━━┳━━━━━━━━━┳━━━━━━┳━━━━━━━━━━━━━━┓
┃   Batch ┃ Seconds ┃ Jobs ┃ Time per job ┃
┡━━━━━━━━━╇━━━━━━━━━╇━━━━━━╇━━━━━━━━━━━━━━┩
│       1 │   2.031 │    1 │        2.031 │
│       2 │   0.493 │    1 │        0.493 │
│       3 │   0.744 │    1 │        0.744 │
│       4 │   0.578 │    1 │        0.578 │
│       5 │   0.274 │    1 │        0.274 │
│       6 │   0.375 │    1 │        0.375 │
│       7 │   0.308 │    1 │        0.308 │
│       8 │   0.261 │    1 │        0.261 │
│       9 │   0.247 │    1 │        0.247 │
│      10 │   0.250 │    1 │        0.250 │
│      11 │   0.287 │    1 │        0.287 │
│      12 │   0.204 │    1 │        0.204 │
│      13 │   0.250 │    1 │        0.250 │
│      14 │   0.262 │    1 │        0.262 │
│      15 │   0.405 │    1 │        0.405 │
│      16 │   0.376 │    1 │        0.376 │
│      17 │   0.248 │    1 │        0.248 │
│      18 │   0.310 │    1 │        0.310 │
│      19 │   0.238 │    1 │        0.238 │
│      20 │   0.246 │    1 │        0.246 │
│      21 │   0.406 │    1 │        0.406 │
│      22 │   0.655 │    1 │        0.655 │
│      23 │   0.294 │    1 │        0.294 │
├─────────┼─────────┼──────┼──────────────┤
│ Average │   0.424 │      │              │
│  Median │   0.294 │      │              │
│   Total │   9.742 │      │              │
│     Max │   2.031 │      │              │
│     Min │   0.204 │      │              │
└─────────┴─────────┴──────┴──────────────┘

            Model generation times            
┏━━━━━━━━━━━┳━━━━━━━━━━┳━━━━━━┳━━━━━━━━━━━━━━┓
┃ Iteration ┃  Seconds ┃ Jobs ┃ Time per job ┃
┡━━━━━━━━━━━╇━━━━━━━━━━╇━━━━━━╇━━━━━━━━━━━━━━┩
│         1 │    0.295 │    1 │        0.295 │
│         2 │    0.414 │    1 │        0.414 │
│         3 │    0.400 │    1 │        0.400 │
│         4 │    0.434 │    1 │        0.434 │
│         5 │    0.257 │    1 │        0.257 │
│         6 │    2.113 │    1 │        2.113 │
│         7 │   14.989 │    1 │       14.989 │
│         8 │   15.234 │    1 │       15.234 │
│         9 │   14.592 │    1 │       14.592 │
│        10 │   13.554 │    1 │       13.554 │
│        11 │   14.643 │    1 │       14.643 │
│        12 │   13.644 │    1 │       13.644 │
│        13 │   12.575 │    1 │       12.575 │
│        14 │   12.735 │    1 │       12.735 │
│        15 │   29.782 │    1 │       29.782 │
│        16 │   31.190 │    1 │       31.190 │
│        17 │   30.200 │    1 │       30.200 │
│        18 │   71.759 │    1 │       71.759 │
│        19 │   34.495 │    1 │       34.495 │
│        20 │   71.326 │    1 │       71.326 │
│        21 │  133.210 │    1 │      133.210 │
│        22 │  160.380 │    1 │      160.380 │
│        23 │  455.482 │    0 │        0.000 │
│        24 │   54.065 │    1 │       54.065 │
├───────────┼──────────┼──────┼──────────────┤
│   Average │   49.490 │      │              │
│    Median │   14.816 │      │              │
│     Total │ 1187.770 │      │              │
│       Max │  455.482 │      │              │
│       Min │    0.257 │      │              │
└───────────┴──────────┴──────┴──────────────┘

Arguments Overview

Key	Value
install	False
config_yaml	None
config_toml	None
config_json	None
num_random_steps	1
max_eval	23
run_program	[['Li8udGVzdHMvdGVzdF93cm9uZ2dvaW5nX3N0dWZmLmJpbi9iaW4vJShwcm9ncmFtKQ==']]
experiment_name	test_wronggoing_stuff
mem_gb	1
parameter	[['program', 'choice',
	'divide_by_0,simple_ok,perl,exit_code_137,result_but_exit_code_stdout_stderr,exit_code_stdout,signal_…
continue_previous_job	None
experiment_constraints	None
run_dir	runs
seed	None
verbose_tqdm	False
model	None
gridsearch	False
occ	False
show_sixel_scatter	False
show_sixel_general	False
show_sixel_trial_index_result	False
follow	True
send_anonymized_usage_stats	True
ui_url	None
root_venv_dir	/home/norman
exclude	None
main_process_gb	8
max_nr_of_zero_results	3
abbreviate_job_names	False
orchestrator_file	None
checkout_to_latest_tested_version	False
live_share	True
disable_tqdm	False
disable_previous_job_constraint	False
workdir
occ_type	euclid
result_names	['RESULT=min']
minkowski_p	2
signed_weighted_euclidean_weights
generation_strategy	None
generate_all_jobs_at_once	False
revert_to_random_when_seemingly_exhausted	False
load_data_from_existing_jobs	[]
n_estimators_randomforest	100
max_attempts_for_generation	20
external_generator	None
optuna_sampler	None
optuna_pruner	none
optuna_n_startup_trials	10
optuna_multivariate	False
optuna_group	False
optuna_constraints	False
optuna_n_ei_candidates	0
optuna_storage	None
optuna_study_name	omniopt_study
optuna_no_load_if_exists	False
optuna_extra_iters	1
username	None
max_failed_jobs	None
num_cpus_main_job	None
calculate_pareto_front_of_job	[]
show_generate_time_table	False
force_choice_for_ranges	False
max_abandoned_retrial	20
share_password	None
dryrun	False
db_url	None
run_program_once	None
worker_generator_path	None
save_to_database	False
range_max_difference	1000000
skip_search	False
nr_evals_per_arm	1
dump_config	None
dont_warm_start_refitting	False
refit_on_cv	False
fit_out_of_design	False
fit_abandoned	False
dont_jit_compile	False
num_restarts	20
raw_samples	1024
max_num_of_parallel_sruns	16
no_transform_inputs	False
no_normalize_y	False
transforms	[]
number_of_generators	1
num_parallel_jobs	10
worker_timeout	1
slurm_use_srun	False
time	120
partition	alpha
reservation	None
force_local_execution	False
slurm_signal_delay_s	0
nodes_per_job	1
cpus_per_task	1
account	None
gpus	0
dependency	None
run_mode	local
verbose	False
verbose_break_run_search_table	False
debug	False
flame_graph	False
memray	False
no_sleep	False
tests	False
show_worker_percentage_table_at_end	False
auto_exclude_defective_hosts	False
run_tests_that_fail_on_taurus	False
raise_in_eval	False
show_ram_every_n_seconds	0
show_generation_and_submission_sixel	False
just_return_defaults	False
prettyprint	False
runtime_debug	False
debug_stack_regex
debug_stack_trace_regex	None
show_func_name	False
beartype	False

This logs the CPU and RAM usage of the main worker process.

timestamp,ram_usage_mb,cpu_usage_percent
1786719261,880.91796875,98.6
1786719345,891.85546875,97.8
1786719426,892.1484375,72.8
1786719494,908.671875,82.9
1786719556,909.91015625,80.5
1786719620,910.78125,86.2
1786719704,912.0546875,76.6
1786719794,912.796875,94
1786719906,808.40234375,94.5
1786719985,808.58203125,88.4
1786720055,808.59765625,83.2
1786720124,808.6015625,75
1786720209,808.8828125,93.3
1786720316,808.0390625,96.4
1786720424,807.96875,99.7
1786720514,808.328125,99
1786720602,808.359375,99.7
1786720679,808.84375,89
1786720754,809.71484375,91.3
1786720836,810.25390625,87.6
1786720908,811.04296875,90.6
1786720980,812.0234375,90.6

! No notable correlations between parameters were found (threshold: |r| > 0.3).

Top-5 Best Results

Parameter Sensitivity Ranking

Parameters ranked by absolute Pearson correlation with each result. Stronger correlations (|r| ≥ 0.7) suggest the parameter has more influence on the outcome.

Convergence Analysis

Parameter statistics

Parameter	Min	Max	Mean	Std Dev	Count
run_time	6	12	6.6364	1.2984	22
RESULT	0.3864	2091887873	640181247.6773	774881748.6059	5
program	No numerical statistics available