OmniOpt2

Experiment overview

Setting	Value
Max. nr. evaluations	23
Number random steps	1
Nr. of workers (parameter)	10

Best RESULT, min (total: 2, failed: 11)

program	RESULT
sleep_10_and_result_exit_252	1234.0

Job Summary per Generation Node

Generation Node	Total	COMPLETED	FAILED
SOBOL	1	1	0
BOTORCH_MODULAR	12	1	11

Experiment parameters

Name	Type	Values
program	choice	divide_by_0, simple_ok, perl, exit_code_137, result_but_exit_code_stdout_stderr, exit_code_stdout, signal_but_has_output, exit_code_no_output, exit_code_stdout_stderr,
		module_not_found, signal, empty, file_does_not_exist, sleep_10_and_result_exit_252, no_chmod_x, no_shebang, perl_module_fail, segfault, wrong_arch, python_name_error,
		syntax_error, tensorflow_syntax_error, force_keyboard_interrupt

Number of evaluations

Failed	Succeeded	Running	Total
11	2	0	13

Result names and types

name	min/max
RESULT	min

Last progressbar status

2025-10-22 06:23:29 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 11 ('RESULT: <FLOAT>' not found), best RESULT: 1234, 3 empty jobs (>= 3)

Git-Version

Commit: f16d22535360fbc48329ca2ebf9ae2448bc26fcb (8710-2-gf16d22535)

trial_index,submit_time,queue_time,worker_generator_uuid,start_time,end_time,run_time,program_string,exit_code,signal,hostname,arm_name,trial_status,generation_node,RESULT,program
0,1761114012,2,1e9c4151-4347-468f-9d4d-f4ba6752e813,1761114014,1761114026,12,./.tests/test_wronggoing_stuff.bin/bin/sleep_10_and_result_exit_252,252,,runnervmwhb2z,0_0,COMPLETED,SOBOL,1234,sleep_10_and_result_exit_252
1,1761114029,2,1e9c4151-4347-468f-9d4d-f4ba6752e813,1761114031,1761114037,6,./.tests/test_wronggoing_stuff.bin/bin/empty,126,,runnervmwhb2z,1_0,FAILED,BOTORCH_MODULAR,,empty
2,1761114040,2,1e9c4151-4347-468f-9d4d-f4ba6752e813,1761114042,1761114048,6,./.tests/test_wronggoing_stuff.bin/bin/python_name_error,1,,runnervmwhb2z,2_0,FAILED,BOTORCH_MODULAR,,python_name_error
3,1761114052,1,1e9c4151-4347-468f-9d4d-f4ba6752e813,1761114053,1761114059,6,./.tests/test_wronggoing_stuff.bin/bin/tensorflow_syntax_error,1,,runnervmwhb2z,3_0,FAILED,BOTORCH_MODULAR,,tensorflow_syntax_error
4,1761114063,2,1e9c4151-4347-468f-9d4d-f4ba6752e813,1761114065,1761114071,6,./.tests/test_wronggoing_stuff.bin/bin/exit_code_137,137,,runnervmwhb2z,4_0,FAILED,BOTORCH_MODULAR,,exit_code_137
5,1761114075,1,1e9c4151-4347-468f-9d4d-f4ba6752e813,1761114076,1761114082,6,./.tests/test_wronggoing_stuff.bin/bin/force_keyboard_interrupt,130,,runnervmwhb2z,5_0,FAILED,BOTORCH_MODULAR,,force_keyboard_interrupt
6,1761114086,2,1e9c4151-4347-468f-9d4d-f4ba6752e813,1761114088,1761114094,6,./.tests/test_wronggoing_stuff.bin/bin/divide_by_0,255,,runnervmwhb2z,6_0,FAILED,BOTORCH_MODULAR,,divide_by_0
7,1761114100,1,1e9c4151-4347-468f-9d4d-f4ba6752e813,1761114101,1761114107,6,./.tests/test_wronggoing_stuff.bin/bin/exit_code_no_output,5,,runnervmwhb2z,7_0,FAILED,BOTORCH_MODULAR,,exit_code_no_output
8,1761114112,2,1e9c4151-4347-468f-9d4d-f4ba6752e813,1761114114,1761114120,6,./.tests/test_wronggoing_stuff.bin/bin/signal,137,,runnervmwhb2z,8_0,FAILED,BOTORCH_MODULAR,,signal
9,1761114123,2,1e9c4151-4347-468f-9d4d-f4ba6752e813,1761114125,1761114131,6,./.tests/test_wronggoing_stuff.bin/bin/file_does_not_exist,127,,runnervmwhb2z,9_0,FAILED,BOTORCH_MODULAR,,file_does_not_exist
10,1761114135,2,1e9c4151-4347-468f-9d4d-f4ba6752e813,1761114137,1761114143,6,./.tests/test_wronggoing_stuff.bin/bin/no_shebang,0,,runnervmwhb2z,10_0,FAILED,BOTORCH_MODULAR,,no_shebang
11,1761114151,2,1e9c4151-4347-468f-9d4d-f4ba6752e813,1761114153,1761114159,6,./.tests/test_wronggoing_stuff.bin/bin/module_not_found,1,,runnervmwhb2z,11_0,FAILED,BOTORCH_MODULAR,,module_not_found
12,1761114163,2,1e9c4151-4347-468f-9d4d-f4ba6752e813,1761114165,1761114171,6,./.tests/test_wronggoing_stuff.bin/bin/signal_but_has_output,137,,runnervmwhb2z,12_0,COMPLETED,BOTORCH_MODULAR,13369,signal_but_has_output


It seems like the search space was exhausted. You were able to get 8% of the jobs you requested (got: 2, submitted: 13, failed: 11, requested: 23) after main ran


========================================================================

Current git-hash: f16d22535360fbc48329ca2ebf9ae2448bc26fcb (last fully tested stable version 2 commits ago [6c64fbd932b26c7ccf94272c45bf171fa01f70f8, 8710])
Using coverage run -p because $RUN_WITH_COVERAGE is set
[WARNING 10-22 06:20:10] ax.service.utils.with_db_settings_base: Ax currently requires a sqlalchemy version below 2.0. This will be addressed in a future release. Disabling SQL storage in Ax for now, if you would like to use SQL storage please install Ax with mysql extras via `pip install ax-platform[mysql]`.
Run-UUID: e0bc370d-6e4a-4556-b3c6-c1d6c1221381
  ______   .___  ___. .__   __.  __    ______   .______   .___________.___   
 /  __  \  |   \/   | |  \ |  | |  |  /  __  \  |   _  \  |           |__ \  
|  |  |  | |  \  /  | |   \|  | |  | |  |  |  | |  |_)  | `---|  |----`  ) | 
|  |  |  | |  |\/|  | |  . `  | |  | |  |  |  | |   ___/      |  |      / /  
|  `--'  | |  |  |  | |  |\   | |  | |  `--'  | |  |          |  |     / /_  
 \______/  |__|  |__| |__| \__| |__|  \______/  | _|          |__|    |____| 
                                                                             

omniopt --max_nr_of_zero_results 3 --live_share --send_anonymized_usage_stats --partition=alpha --gpus=0 --experiment_name=test_wronggoing_stuff --mem_gb=1 --time=120 --worker_timeout=1 --max_eval=23 --num_parallel_jobs=10 --run_program=Li8udGVzdHMvdGVzdF93cm9uZ2dvaW5nX3N0dWZmLmJpbi9iaW4vJShwcm9ncmFtKQ== --parameter program choice divide_by_0,simple_ok,perl,exit_code_137,result_but_exit_code_stdout_stderr,exit_code_stdout,signal_but_has_output,exit_code_no_output,exit_code_stdout_stderr,module_not_found,signal,empty,file_does_not_exist,sleep_10_and_result_exit_252,no_chmod_x,no_shebang,perl_module_fail,segfault,wrong_arch,python_name_error,syntax_error,tensorflow_syntax_error,force_keyboard_interrupt --num_random_steps=1 --follow
Run-folder: /home/runner/work/OmniOpt/OmniOpt/runs/test_wronggoing_stuff/0
See https://imageseg.scads.de/omniax/share?user_id=runner&experiment_name=test_wronggoing_stuff&run_nr=25 for live-results.

You have 4 CPUs available for the main process. No CUDA devices found.
Generation strategy: SOBOL for 1 step and then BOTORCH_MODULAR for 22 steps.
Run-Program: ./.tests/test_wronggoing_stuff.bin/bin/%(program)
                                                                                         Experiment parameters                                                                                          
┏━━━━━━━━━┳━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┓
┃ Name    ┃ Type   ┃ Values                                                                                                                                                                            ┃
┡━━━━━━━━━╇━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┩
│ program │ choice │ divide_by_0, simple_ok, perl, exit_code_137, result_but_exit_code_stdout_stderr, exit_code_stdout, signal_but_has_output, exit_code_no_output, exit_code_stdout_stderr,           │
│         │        │ module_not_found, signal, empty, file_does_not_exist, sleep_10_and_result_exit_252, no_chmod_x, no_shebang, perl_module_fail, segfault, wrong_arch, python_name_error,            │
│         │        │ syntax_error, tensorflow_syntax_error, force_keyboard_interrupt                                                                                                                   │
└─────────┴────────┴───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘
        Result-Names         
┏━━━━━━━━━━━━━┳━━━━━━━━━━━━━┓
┃ Result-Name ┃ Min or max? ┃
┡━━━━━━━━━━━━━╇━━━━━━━━━━━━━┩
│ RESULT      │         min │
└─────────────┴─────────────┘

It seems like the search space was exhausted. You were able to get 8% of the jobs you requested (got: 2, submitted: 13, failed: 11, requested: 23) after main ran
                                     Failed Jobs parameters                                     
┏━━━━━━━━┳━━━━━━━━┳━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┓
┃ param1 ┃ param2 ┃ param3 ┃ error_description                                                 ┃
┡━━━━━━━━╇━━━━━━━━╇━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┩
│ value1 │ value2 │ value3 │ Some error occurred during execution (this is not a real error!). │
└────────┴────────┴────────┴───────────────────────────────────────────────────────────────────┘
 Best RESULT, min (total: 2, failed: 11) 
┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━┓
┃ program                      ┃ RESULT ┃
┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━┩
│ sleep_10_and_result_exit_252 │ 1234.0 │
└──────────────────────────────┴────────┘
Not printing sixel graphics in CI
                                 Runtime Infos                                 
┏━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━┳━━━━━━━━━━━━┳━━━━━━━━━━━━━━┳━━━━━━━━━━━━━┓
┃ Number of evaluations ┃ Min time  ┃  Max time  ┃ Average time ┃ Median time ┃
┡━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━╇━━━━━━━━━━━━╇━━━━━━━━━━━━━━╇━━━━━━━━━━━━━┩
│          13           │ 6.00 sec  │ 12.00 sec  │   6.46 sec   │  6.00 sec   │
└───────────────────────┴───────────┴────────────┴──────────────┴─────────────┘

2025-10-22 06:20:12 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, Started OmniOpt2 run...
2025-10-22 06:20:12 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, getting new HP set (no sbatch)
2025-10-22 06:20:12 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, requested 1 jobs, got 1, 0.02 s/job
2025-10-22 06:20:12 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, eval #1/1 start                    
2025-10-22 06:20:12 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, starting new job                   
2025-10-22 06:20:12 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, started new job                    
2025-10-22 06:20:27 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, new result: 1234.0                 
2025-10-22 06:20:29 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, best RESULT: 1234, finishing jobs, finished 1 job
2025-10-22 06:20:29 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, best RESULT: 1234, getting new HP set (no sbatch)
2025-10-22 06:20:29 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, best RESULT: 1234, requested 1 jobs, got 1, 0.47 s/job
2025-10-22 06:20:29 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, best RESULT: 1234, eval #1/1 start                    
2025-10-22 06:20:29 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, best RESULT: 1234, starting new job                   
2025-10-22 06:20:29 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, best RESULT: 1234, started new job                    
2025-10-22 06:20:38 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, best RESULT: 1234, job_failed                         
2025-10-22 06:20:40 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 1 ('RESULT: <FLOAT>' not found), best RESULT: 1234, finishing jobs, finished 1 job
2025-10-22 06:20:40 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 1 ('RESULT: <FLOAT>' not found), best RESULT: 1234, getting new HP set (no sbatch)
2025-10-22 06:20:40 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 1 ('RESULT: <FLOAT>' not found), best RESULT: 1234, requested 1 jobs, got 1, 0.38 s/job
2025-10-22 06:20:40 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 1 ('RESULT: <FLOAT>' not found), best RESULT: 1234, eval #1/1 start                    
2025-10-22 06:20:40 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 1 ('RESULT: <FLOAT>' not found), best RESULT: 1234, starting new job                   
2025-10-22 06:20:40 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 1 ('RESULT: <FLOAT>' not found), best RESULT: 1234, started new job                    
2025-10-22 06:20:49 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 1 ('RESULT: <FLOAT>' not found), best RESULT: 1234, job_failed                         
2025-10-22 06:20:51 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 2 ('RESULT: <FLOAT>' not found), best RESULT: 1234, finishing jobs, finished 1 job     
2025-10-22 06:20:52 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 2 ('RESULT: <FLOAT>' not found), best RESULT: 1234, getting new HP set (no sbatch)     
2025-10-22 06:20:52 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 2 ('RESULT: <FLOAT>' not found), best RESULT: 1234, requested 1 jobs, got 1, 0.40 s/job
2025-10-22 06:20:52 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 2 ('RESULT: <FLOAT>' not found), best RESULT: 1234, eval #1/1 start                    
2025-10-22 06:20:52 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 2 ('RESULT: <FLOAT>' not found), best RESULT: 1234, starting new job                   
2025-10-22 06:20:52 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 2 ('RESULT: <FLOAT>' not found), best RESULT: 1234, started new job                    
2025-10-22 06:21:01 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 2 ('RESULT: <FLOAT>' not found), best RESULT: 1234, job_failed                         
2025-10-22 06:21:02 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 3 ('RESULT: <FLOAT>' not found), best RESULT: 1234, finishing jobs, finished 1 job     
2025-10-22 06:21:03 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 3 ('RESULT: <FLOAT>' not found), best RESULT: 1234, getting new HP set (no sbatch)     
2025-10-22 06:21:03 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 3 ('RESULT: <FLOAT>' not found), best RESULT: 1234, requested 1 jobs, got 1, 0.39 s/job
2025-10-22 06:21:03 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 3 ('RESULT: <FLOAT>' not found), best RESULT: 1234, eval #1/1 start                    
2025-10-22 06:21:03 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 3 ('RESULT: <FLOAT>' not found), best RESULT: 1234, starting new job                   
2025-10-22 06:21:03 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 3 ('RESULT: <FLOAT>' not found), best RESULT: 1234, started new job                    
2025-10-22 06:21:12 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 3 ('RESULT: <FLOAT>' not found), best RESULT: 1234, job_failed                         
2025-10-22 06:21:14 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 4 ('RESULT: <FLOAT>' not found), best RESULT: 1234, finishing jobs, finished 1 job     
2025-10-22 06:21:14 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 4 ('RESULT: <FLOAT>' not found), best RESULT: 1234, getting new HP set (no sbatch)     
2025-10-22 06:21:15 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 4 ('RESULT: <FLOAT>' not found), best RESULT: 1234, requested 1 jobs, got 1, 0.77 s/job
2025-10-22 06:21:15 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 4 ('RESULT: <FLOAT>' not found), best RESULT: 1234, eval #1/1 start                    
2025-10-22 06:21:15 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 4 ('RESULT: <FLOAT>' not found), best RESULT: 1234, starting new job                   
2025-10-22 06:21:15 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 4 ('RESULT: <FLOAT>' not found), best RESULT: 1234, started new job                    
2025-10-22 06:21:24 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 4 ('RESULT: <FLOAT>' not found), best RESULT: 1234, job_failed                         
2025-10-22 06:21:26 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 5 ('RESULT: <FLOAT>' not found), best RESULT: 1234, finishing jobs, finished 1 job     
2025-10-22 06:21:26 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 5 ('RESULT: <FLOAT>' not found), best RESULT: 1234, getting new HP set (no sbatch)     
2025-10-22 06:21:26 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 5 ('RESULT: <FLOAT>' not found), best RESULT: 1234, requested 1 jobs, got 1, 0.41 s/job
2025-10-22 06:21:26 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 5 ('RESULT: <FLOAT>' not found), best RESULT: 1234, eval #1/1 start                    
2025-10-22 06:21:26 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 5 ('RESULT: <FLOAT>' not found), best RESULT: 1234, starting new job                   
2025-10-22 06:21:26 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 5 ('RESULT: <FLOAT>' not found), best RESULT: 1234, started new job                    
2025-10-22 06:21:35 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 5 ('RESULT: <FLOAT>' not found), best RESULT: 1234, job_failed                         
2025-10-22 06:21:39 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 6 ('RESULT: <FLOAT>' not found), best RESULT: 1234, finishing jobs, finished 1 job     
2025-10-22 06:21:39 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 6 ('RESULT: <FLOAT>' not found), best RESULT: 1234, getting new HP set (no sbatch)     
2025-10-22 06:21:39 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 6 ('RESULT: <FLOAT>' not found), best RESULT: 1234, requested 1 jobs, got 1, 0.38 s/job
2025-10-22 06:21:39 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 6 ('RESULT: <FLOAT>' not found), best RESULT: 1234, eval #1/1 start                    
2025-10-22 06:21:40 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 6 ('RESULT: <FLOAT>' not found), best RESULT: 1234, starting new job                   
2025-10-22 06:21:40 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 6 ('RESULT: <FLOAT>' not found), best RESULT: 1234, started new job                    
2025-10-22 06:21:49 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 6 ('RESULT: <FLOAT>' not found), best RESULT: 1234, job_failed                         
2025-10-22 06:21:51 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 1234, finishing jobs, finished 1 job     
2025-10-22 06:21:51 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 1234, getting new HP set (no sbatch)     
2025-10-22 06:21:52 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 1234, requested 1 jobs, got 1, 1.18 s/job
2025-10-22 06:21:52 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 1234, eval #1/1 start                    
2025-10-22 06:21:52 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 1234, starting new job                   
2025-10-22 06:21:52 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 1234, started new job                    
2025-10-22 06:22:01 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 1234, job_failed                         
2025-10-22 06:22:03 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 8 ('RESULT: <FLOAT>' not found), best RESULT: 1234, finishing jobs, finished 1 job     
2025-10-22 06:22:03 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 8 ('RESULT: <FLOAT>' not found), best RESULT: 1234, getting new HP set (no sbatch)     
2025-10-22 06:22:03 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 8 ('RESULT: <FLOAT>' not found), best RESULT: 1234, requested 1 jobs, got 1, 0.39 s/job
2025-10-22 06:22:03 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 8 ('RESULT: <FLOAT>' not found), best RESULT: 1234, eval #1/1 start                    
2025-10-22 06:22:03 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 8 ('RESULT: <FLOAT>' not found), best RESULT: 1234, starting new job                   
2025-10-22 06:22:03 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 8 ('RESULT: <FLOAT>' not found), best RESULT: 1234, started new job                    
2025-10-22 06:22:12 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 8 ('RESULT: <FLOAT>' not found), best RESULT: 1234, job_failed                         
2025-10-22 06:22:15 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 9 ('RESULT: <FLOAT>' not found), best RESULT: 1234, finishing jobs, finished 1 job     
2025-10-22 06:22:15 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 9 ('RESULT: <FLOAT>' not found), best RESULT: 1234, getting new HP set (no sbatch)     
2025-10-22 06:22:15 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 9 ('RESULT: <FLOAT>' not found), best RESULT: 1234, requested 1 jobs, got 1, 0.40 s/job
2025-10-22 06:22:15 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 9 ('RESULT: <FLOAT>' not found), best RESULT: 1234, eval #1/1 start                    
2025-10-22 06:22:15 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 9 ('RESULT: <FLOAT>' not found), best RESULT: 1234, starting new job                   
2025-10-22 06:22:15 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 9 ('RESULT: <FLOAT>' not found), best RESULT: 1234, started new job                    
2025-10-22 06:22:24 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 9 ('RESULT: <FLOAT>' not found), best RESULT: 1234, job_failed                         
2025-10-22 06:22:30 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 10 ('RESULT: <FLOAT>' not found), best RESULT: 1234, finishing jobs, finished 1 job    
2025-10-22 06:22:31 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 10 ('RESULT: <FLOAT>' not found), best RESULT: 1234, getting new HP set (no sbatch)    
2025-10-22 06:22:31 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 10 ('RESULT: <FLOAT>' not found), best RESULT: 1234, requested 1 jobs, got 1, 0.40 s/job
2025-10-22 06:22:31 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 10 ('RESULT: <FLOAT>' not found), best RESULT: 1234, eval #1/1 start                    
2025-10-22 06:22:31 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 10 ('RESULT: <FLOAT>' not found), best RESULT: 1234, starting new job                   
2025-10-22 06:22:31 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 10 ('RESULT: <FLOAT>' not found), best RESULT: 1234, started new job                    
2025-10-22 06:22:40 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 10 ('RESULT: <FLOAT>' not found), best RESULT: 1234, job_failed                         
2025-10-22 06:22:42 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 11 ('RESULT: <FLOAT>' not found), best RESULT: 1234, finishing jobs, finished 1 job     
2025-10-22 06:22:43 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 11 ('RESULT: <FLOAT>' not found), best RESULT: 1234, getting new HP set (no sbatch)     
2025-10-22 06:22:43 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 11 ('RESULT: <FLOAT>' not found), best RESULT: 1234, requested 1 jobs, got 1, 0.40 s/job
2025-10-22 06:22:43 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 11 ('RESULT: <FLOAT>' not found), best RESULT: 1234, eval #1/1 start                    
2025-10-22 06:22:43 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 11 ('RESULT: <FLOAT>' not found), best RESULT: 1234, starting new job                   
2025-10-22 06:22:43 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 11 ('RESULT: <FLOAT>' not found), best RESULT: 1234, started new job                    
2025-10-22 06:22:52 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 11 ('RESULT: <FLOAT>' not found), best RESULT: 1234, new result: 13369.0                
2025-10-22 06:22:54 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 11 ('RESULT: <FLOAT>' not found), best RESULT: 1234, finishing jobs, finished 1 job     
2025-10-22 06:22:55 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 11 ('RESULT: <FLOAT>' not found), best RESULT: 1234, getting new HP set (no sbatch)     
2025-10-22 06:23:06 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 11 ('RESULT: <FLOAT>' not found), best RESULT: 1234, requested 1 jobs, got 0, n/a       
2025-10-22 06:23:06 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 11 ('RESULT: <FLOAT>' not found), best RESULT: 1234, found 1 zero-jobs (max: 3)         
2025-10-22 06:23:06 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 11 ('RESULT: <FLOAT>' not found), best RESULT: 1234, getting new HP set (no sbatch)     
2025-10-22 06:23:17 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 11 ('RESULT: <FLOAT>' not found), best RESULT: 1234, requested 1 jobs, got 0, n/a       
2025-10-22 06:23:17 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 11 ('RESULT: <FLOAT>' not found), best RESULT: 1234, found 2 zero-jobs (max: 3)         
2025-10-22 06:23:18 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 11 ('RESULT: <FLOAT>' not found), best RESULT: 1234, getting new HP set (no sbatch)     
2025-10-22 06:23:29 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 11 ('RESULT: <FLOAT>' not found), best RESULT: 1234, requested 1 jobs, got 0, n/a       
2025-10-22 06:23:29 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 11 ('RESULT: <FLOAT>' not found), best RESULT: 1234, found 3 zero-jobs (max: 3)         
2025-10-22 06:23:29 (1e9c4151-4347-468f-9d4d-f4ba6752e813): SOBOL, failed: 11 ('RESULT: <FLOAT>' not found), best RESULT: 1234, 3 empty jobs (>= 3)

         Job submission durations          
┏━━━━━━━━━┳━━━━━━━━━┳━━━━━━┳━━━━━━━━━━━━━━┓
┃   Batch ┃ Seconds ┃ Jobs ┃ Time per job ┃
┡━━━━━━━━━╇━━━━━━━━━╇━━━━━━╇━━━━━━━━━━━━━━┩
│       1 │   0.220 │    1 │        0.220 │
│       2 │   0.076 │    1 │        0.076 │
│       3 │   0.079 │    1 │        0.079 │
│       4 │   0.078 │    1 │        0.078 │
│       5 │   0.079 │    1 │        0.079 │
│       6 │   0.078 │    1 │        0.078 │
│       7 │   0.080 │    1 │        0.080 │
│       8 │   0.079 │    1 │        0.079 │
│       9 │   0.080 │    1 │        0.080 │
│      10 │   0.079 │    1 │        0.079 │
│      11 │   0.079 │    1 │        0.079 │
│      12 │   0.079 │    1 │        0.079 │
│      13 │   0.077 │    1 │        0.077 │
├─────────┼─────────┼──────┼──────────────┤
│ Average │   0.090 │      │              │
│  Median │   0.079 │      │              │
│   Total │   1.164 │      │              │
│     Max │   0.220 │      │              │
│     Min │   0.076 │      │              │
└─────────┴─────────┴──────┴──────────────┘

           Model generation times            
┏━━━━━━━━━━━┳━━━━━━━━━┳━━━━━━┳━━━━━━━━━━━━━━┓
┃ Iteration ┃ Seconds ┃ Jobs ┃ Time per job ┃
┡━━━━━━━━━━━╇━━━━━━━━━╇━━━━━━╇━━━━━━━━━━━━━━┩
│         1 │   0.016 │    1 │        0.016 │
│         2 │   0.468 │    1 │        0.468 │
│         3 │   0.382 │    1 │        0.382 │
│         4 │   0.397 │    1 │        0.397 │
│         5 │   0.394 │    1 │        0.394 │
│         6 │   0.774 │    1 │        0.774 │
│         7 │   0.410 │    1 │        0.410 │
│         8 │   0.384 │    1 │        0.384 │
│         9 │   1.183 │    1 │        1.183 │
│        10 │   0.391 │    1 │        0.391 │
│        11 │   0.395 │    1 │        0.395 │
│        12 │   0.401 │    1 │        0.401 │
│        13 │   0.396 │    1 │        0.396 │
│        14 │  11.684 │    0 │        0.000 │
│        15 │  11.510 │    0 │        0.000 │
│        16 │  11.433 │    0 │        0.000 │
├───────────┼─────────┼──────┼──────────────┤
│   Average │   2.539 │      │              │
│    Median │   0.399 │      │              │
│     Total │  40.618 │      │              │
│       Max │  11.684 │      │              │
│       Min │   0.016 │      │              │
└───────────┴─────────┴──────┴──────────────┘

Arguments Overview

Key	Value
config_yaml	None
config_toml	None
config_json	None
num_random_steps	1
max_eval	23
run_program	[['Li8udGVzdHMvdGVzdF93cm9uZ2dvaW5nX3N0dWZmLmJpbi9iaW4vJShwcm9ncmFtKQ==']]
experiment_name	test_wronggoing_stuff
mem_gb	1
parameter	[['program', 'choice',
	'divide_by_0,simple_ok,perl,exit_code_137,result_but_exit_code_stdout_stderr,exit_code_stdout,signal_but_has_output,exit_code_no_output,exit_code_stdou…
continue_previous_job	None
experiment_constraints	None
run_dir	runs
seed	None
verbose_tqdm	False
model	None
gridsearch	False
occ	False
show_sixel_scatter	False
show_sixel_general	False
show_sixel_trial_index_result	False
follow	True
send_anonymized_usage_stats	True
ui_url	None
root_venv_dir	/home/runner
exclude	None
main_process_gb	8
max_nr_of_zero_results	3
abbreviate_job_names	False
orchestrator_file	None
checkout_to_latest_tested_version	False
live_share	True
disable_tqdm	False
disable_previous_job_constraint	False
workdir
occ_type	euclid
result_names	['RESULT=min']
minkowski_p	2
signed_weighted_euclidean_weights
generation_strategy	None
generate_all_jobs_at_once	False
revert_to_random_when_seemingly_exhausted	False
load_data_from_existing_jobs	[]
n_estimators_randomforest	100
max_attempts_for_generation	20
external_generator	None
username	None
max_failed_jobs	None
num_cpus_main_job	None
calculate_pareto_front_of_job	[]
show_generate_time_table	False
force_choice_for_ranges	False
max_abandoned_retrial	20
share_password	None
dryrun	False
db_url	None
run_program_once	None
worker_generator_path	None
save_to_database	False
range_max_difference	1000000
skip_search	False
dont_warm_start_refitting	False
refit_on_cv	False
fit_out_of_design	False
fit_abandoned	False
dont_jit_compile	False
num_restarts	20
raw_samples	1024
max_num_of_parallel_sruns	16
no_transform_inputs	False
no_normalize_y	False
transforms	[]
number_of_generators	1
num_parallel_jobs	10
worker_timeout	1
slurm_use_srun	False
time	120
partition	alpha
reservation	None
force_local_execution	False
slurm_signal_delay_s	0
nodes_per_job	1
cpus_per_task	1
account	None
gpus	0
dependency	None
run_mode	local
verbose	False
verbose_break_run_search_table	False
debug	False
flame_graph	False
memray	False
no_sleep	False
tests	False
show_worker_percentage_table_at_end	False
auto_exclude_defective_hosts	False
run_tests_that_fail_on_taurus	False
raise_in_eval	False
show_ram_every_n_seconds	0
show_generation_and_submission_sixel	False
just_return_defaults	False
prettyprint	False
runtime_debug	False
debug_stack_regex
debug_stack_trace_regex	None
show_func_name	False
beartype	False

timestamp,ram_usage_mb,cpu_usage_percent
1761114012,778.234375,24.5

Parameter statistics

Parameter	Min	Max	Mean	Std Dev	Count
run_time	6	12	6.4615	1.5988	13
RESULT	1234	13369	7301.5	6067.5	2
program	No numerical statistics available

/home/runner/.omniax_venvs/Python_3.12.3/x86_64/lib/python3.12/site-packages/submitit/core/plugins.py:24: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
  import pkg_resources
submitit INFO (2025-10-22 06:20:12,778) - Starting with JobEnvironment(job_id=117491, hostname=runnervmwhb2z, local_rank=0(1), node=0(1), global_rank=0(1))
submitit INFO (2025-10-22 06:20:12,778) - Loading pickle: /home/runner/work/OmniOpt/OmniOpt/runs/test_wronggoing_stuff/0/single_runs/117491/117491_submitted.pkl
Trial-Index: 0

Parameters: {"program": "sleep_10_and_result_exit_252"}
Debug-Infos: 
========
DEBUG INFOS START:
Program-Code: ./.tests/test_wronggoing_stuff.bin/bin/sleep_10_and_result_exit_252
pwd: /home/runner/work/OmniOpt/OmniOpt
File: ./.tests/test_wronggoing_stuff.bin/bin/sleep_10_and_result_exit_252
UID: 1001
GID: 1001
Status-Change-Time: 1761112565.3283277
Size: 60 Bytes
Permissions: -rwxr-xr-x
Owner: runner
Last access: 1761114014.271399
Last modification: 1761112565.3283277
Hostname: runnervmwhb2z
========
DEBUG INFOS END

./.tests/test_wronggoing_stuff.bin/bin/sleep_10_and_result_exit_252
stdout:
 RESULT: 1234

stderr was empty
Result: {'RESULT': 1234.0}
Final-results: {'RESULT': 1234.0}
EXIT_CODE: 252
submitit INFO (2025-10-22 06:20:26,296) - Job completed successfully
submitit INFO (2025-10-22 06:20:26,296) - Exiting after successful completion