It seems like the search space was exhausted. You were able to get 13% of the jobs you requested (got: 3, submitted: 10, failed: 7, requested: 23) after main ran
========================================================================
To cancel, press CTRLc, then run 'scancel 1171356'
⠋Importing logging...⠋Importing warnings...⠋Importing argparse...⠋Importing datetime...⠋Importing dataclass...⠋Importing socket...⠋Importing stat...⠋Importing pwd...⠋Importing base64...⠋Importing json...⠋Importing yaml...⠋Importing toml...⠋Importing csv...⠋Importing ast...⠋Importing rich.table...⠋Importing rich print...⠋Importing rich.pretty...⠋Importing pformat...⠋Importing rich.prompt...⠋Importing types.FunctionType...⠋Importing typing...⠋Importing ThreadPoolExecutor...⠋Importing submitit.LocalExecutor...⠋Importing submitit.Job...⠋Importing importlib.util...⠋Importing platform...⠋Importing inspect frame info...⠋Importing pathlib.Path...⠋Importing uuid...⠋Importing cowsay...⠋Importing shutil...⠋Importing itertools.combinations...⠋Importing os.listdir...⠋Importing os.path...⠋Importing PIL.Image...⠋Importing sixel...⠋Importing subprocess...⠋Importing tqdm...⠋Importing beartype...⠋Importing statistics...⠋Trying to import pyfiglet...⠙Importing helpers...⠋Parsing arguments...⠸Importing torch...⠋Importing numpy...
[WARNING 10-25 02:36:39] ax.service.utils.with_db_settings_base: Ax currently requires a sqlalchemy version below 2.0. This will be addressed in a future release. Disabling SQL storage in Ax for now, if you would like to use SQL storage please install Ax with mysql extras via `pip install ax-platform[mysql]`.
⠇Importing ax...⠋Importing ax.core.generator_run...⠋Importing Cont_X_trans and Y_trans from ax.adapter.registry...⠋Importing ax.core.arm...⠋Importing ax.core.objective...⠋Importing ax.core.Metric...⠋Importing ax.exceptions.core...⠋Importing ax.exceptions.generation_strategy...⠋Importing CORE_DECODER_REGISTRY...⠋Trying ax.generation_strategy.generation_node...⠋Importing GenerationStep, GenerationStrategy from generation_strategy...⠋Importing GenerationNode from generation_node...⠋Importing ExternalGenerationNode...⠋Importing MaxTrials...⠋Importing GeneratorSpec...⠋Importing Models from ax.generation_strategy.registry...⠋Importing get_pending_observation_features...⠋Importing load_experiment...⠋Importing save_experiment...⠋Importing save_experiment_to_db...⠋Importing TrialStatus...⠋Importing Data...⠋Importing Experiment...⠋Importing parameter types...⠋Importing TParameterization...⠋Importing pandas...⠋Importing AxClient and ObjectiveProperties...⠋Importing RandomForestRegressor...⠋Importing botorch...⠋Importing submitit...⠋Importing ax logger...⠋Importing SQL-Storage-Stuff...
Run-UUID: b44ce42e-e630-4370-a825-5eef338998c8
_________________________________________________
/ \
| OmniOpt2 - Fine-tuning on a quantum level – Schrö |
| dinger’s hyperparameter. |
\ /
=================================================
\
\
\
\
.-=-==--==--.
..-==" ,'o`) `.
,' `"' \
: ( `.__...._
| ) / `-=-.
: ,vv.-._ / / `---==-._
\/\/\/VV ^ d88`;' / `.
`` ^/d88P!' / , `._
^/ !' ,. , / "-,,__,,--'""""-.
^/ !' ,' \ . .( ( _ ) ) ) ) ))_,-.\
^(__ ,!',"' ;:+.:%:a. \:.. . ,' ) ) ) ) ,"' '
',,,'',' /o:::":%:%a. \:.:.: . ) ) _,'
"""' ;':::'' `+%%%a._ \%:%| ;.). _,-""
,-='_.-' ``:%::) )%:| /:._,"
(/(/" ," ,'_,'%%%: (_,'
( (//(`.___; \
\ \ ` `
`. `. `. :
\. . .\ : . . . :
\. . .: `.. . .:
`..:.:\ \:...\
;:.:.; ::...:
):%:: :::::;
__,::%:( :::::
,;:%%%%%%%: ;:%::
;,--""-.`\ ,=--':%:%:\
/" "| /-".:%%%%%%%\
;,-"'`)%%)
/" "|
⠋Writing worker creation log...
omniopt --max_nr_of_zero_results 3 --live_share --send_anonymized_usage_stats --partition=alpha --gpus=1 --experiment_name=test_wronggoing_stuff --mem_gb=1 --time=120 --worker_timeout=1 --max_eval=23 --num_parallel_jobs=10 --run_program=Li8udGVzdHMvdGVzdF93cm9uZ2dvaW5nX3N0dWZmLmJpbi9iaW4vJShwcm9ncmFtKQ== --parameter program choice divide_by_0,simple_ok,perl,exit_code_137,result_but_exit_code_stdout_stderr,exit_code_stdout,signal_but_has_output,exit_code_no_output,exit_code_stdout_stderr,module_not_found,signal,empty,file_does_not_exist,sleep_10_and_result_exit_252,no_chmod_x,no_shebang,perl_module_fail,segfault,wrong_arch,python_name_error,syntax_error,tensorflow_syntax_error,force_keyboard_interrupt --num_random_steps=1 --follow
⠋Disabling logging...⠋Setting run folder...⠋Creating folder /data/horse/ws/s3811141-oo_crap/omniopt/runs/test_wronggoing_stuff/3...⠋Writing revert_to_random_when_seemingly_exhausted file ...⠋Writing username state file...⠋Writing result names file...⠋Writing result min/max file...⠋Saving state files...Run-folder: /data/horse/ws/s3811141-oo_crap/omniopt/runs/test_wronggoing_stuff/3⠋Writing live_share file if it is present...⠋Writing job_start_time file...⠦Writing git information⠋Checking max_eval...Warning: --num_random_steps 1 is smaller than --num_parallel_jobs 10. It's recommended that --num_parallel_jobs is the same as or a multiple of --num_random_steps⠋Calculating number of steps...⠋Adding excluded nodes...⠋Initializing ax_client...⠋Setting orchestrator...See https://imageseg.scads.de/omniax/share?user_id=s3811141&experiment_name=test_wronggoing_stuff&run_nr=4 for live-results.You have 1 CPUs available for the main process.Using CUDA device NVIDIA H100.Generation strategy: SOBOL for 1 step and then BOTORCH_MODULAR for 22 steps.
Run-Program: ./.tests/test_wronggoing_stuff.bin/bin/%(program)
Experiment parameters
┏━━━━━━━━━┳━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┓
┃Name ┃Type ┃Values ┃
┡━━━━━━━━━╇━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┩
│program│choice│divide_by_0, simple_ok, perl, exit_code_137, result_but_exit_code_stdout_stderr, exit_code_stdout, signal_but_has_output, exit_code_no_output, exit_code_stdout_stderr, │
│││module_not_found, signal, empty, file_does_not_exist, sleep_10_and_result_exit_252, no_chmod_x, no_shebang, perl_module_fail, segfault, wrong_arch, python_name_error, │
│││syntax_error, tensorflow_syntax_error, force_keyboard_interrupt │
└─────────┴────────┴───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘
Result-Names
┏━━━━━━━━━━━━━┳━━━━━━━━━━━━━┓
┃Result-Name┃Min or max?┃
┡━━━━━━━━━━━━━╇━━━━━━━━━━━━━┩
│RESULT │ min│
└─────────────┴─────────────┘
⠋Write files and show overview
SOBOL, failed: 7 ('RESULT: ' not found), best RESULT: 2034, found 3 zero-jobs (max: 3) : 13%|█░░░░░░░░░| 3/23 [08:50<58:56, 176.81s/it]
It seems like the search space was exhausted. You were able to get 13% of the jobs you requested (got: 3, submitted: 10, failed: 7, requested: 23) after main ran Best RESULT, min (total: 3, failed: 7)
┏━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━┳━━━━━━━━┓
┃OO_Info_SLURM_JOB_ID┃program ┃RESULT┃
┡━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━╇━━━━━━━━┩
│1171414 │no_shebang│2034.0│
└──────────────────────┴────────────┴────────┘
Runtime Infos
┏━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━┳━━━━━━━━━━━┳━━━━━━━━━━━━━━┳━━━━━━━━━━━━━┓
┃Number of evaluations┃Min time ┃Max time ┃Average time┃Median time┃
┡━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━╇━━━━━━━━━━━╇━━━━━━━━━━━━━━╇━━━━━━━━━━━━━┩
│ 10 │ 0.00 sec │ 6.00 sec │ 5.40 sec │ 6.00 sec │
└───────────────────────┴───────────┴───────────┴──────────────┴─────────────┘
2025-10-25 02:36:53 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, Started OmniOpt2 run...
2025-10-25 02:36:54 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, getting new HP set
2025-10-25 02:36:54 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, requested 1 jobs, got 1, 0.10 s/job
2025-10-25 02:36:55 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, eval #1/1 start
2025-10-25 02:36:55 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, starting new job
2025-10-25 02:36:56 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, unknown 1∑1 (10%/10), started new job
2025-10-25 02:36:56 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, unknown 1∑1 (10%/10), getting new HP set
2025-10-25 02:36:56 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, unknown 1∑1 (10%/10), requested 1 jobs, got 1, 0.01 s/job
2025-10-25 02:36:56 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, unknown 1∑1 (10%/10), eval #1/1 start
2025-10-25 02:36:56 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, unknown 1∑1 (10%/10), starting new job
2025-10-25 02:36:56 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, pending 2∑2 (10%/10), started new job
2025-10-25 02:36:56 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, pending 2∑2 (10%/10), getting new HP set
2025-10-25 02:36:56 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, pending 2∑2 (10%/10), requested 1 jobs, got 1, 0.02 s/job
2025-10-25 02:36:56 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, pending 2∑2 (10%/10), eval #1/1 start
2025-10-25 02:36:56 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, pending 2∑2 (10%/10), starting new job
2025-10-25 02:36:57 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, pending/unknown 2/1∑3 (10%/10), started new job
2025-10-25 02:36:57 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, pending/unknown 2/1∑3 (10%/10), getting new HP set
2025-10-25 02:36:57 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, pending/unknown 2/1∑3 (10%/10), requested 1 jobs, got 1, 0.02 s/job
2025-10-25 02:36:57 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, pending/unknown 2/1∑3 (10%/10), eval #1/1 start
2025-10-25 02:36:57 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, pending/unknown 2/1∑3 (10%/10), starting new job
2025-10-25 02:36:57 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, pending/unknown 2/2∑4 (10%/10), started new job
2025-10-25 02:36:57 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, pending/unknown 2/2∑4 (10%/10), getting new HP set
2025-10-25 02:36:57 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, pending/unknown 2/2∑4 (10%/10), requested 1 jobs, got 1, 0.02 s/job
2025-10-25 02:36:57 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, pending/unknown 2/2∑4 (10%/10), eval #1/1 start
2025-10-25 02:36:57 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, pending/unknown 2/2∑4 (10%/10), starting new job
2025-10-25 02:36:58 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, pending/unknown 2/3∑5 (10%/10), started new job
2025-10-25 02:36:58 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, pending/unknown 2/3∑5 (10%/10), getting new HP set
2025-10-25 02:36:58 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, pending/unknown 2/3∑5 (10%/10), requested 1 jobs, got 1, 0.02 s/job
2025-10-25 02:36:58 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, pending/unknown 2/3∑5 (10%/10), eval #1/1 start
2025-10-25 02:36:58 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, pending/unknown 2/3∑5 (10%/10), starting new job
2025-10-25 02:36:58 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, pending/unknown 2/4∑6 (10%/10), started new job
2025-10-25 02:36:58 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, pending/unknown 2/4∑6 (10%/10), getting new HP set
2025-10-25 02:36:58 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, pending/unknown 2/4∑6 (10%/10), requested 1 jobs, got 1, 0.02 s/job
2025-10-25 02:36:58 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, pending/unknown 2/4∑6 (10%/10), eval #1/1 start
2025-10-25 02:36:58 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, pending/unknown 2/4∑6 (10%/10), starting new job
2025-10-25 02:36:59 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, pending/unknown 2/5∑7 (10%/10), started new job
2025-10-25 02:36:59 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, pending/unknown 2/5∑7 (10%/10), getting new HP set
2025-10-25 02:36:59 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, pending/unknown 2/5∑7 (10%/10), requested 1 jobs, got 1, 0.02 s/job
2025-10-25 02:36:59 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, pending/unknown 2/5∑7 (10%/10), eval #1/1 start
2025-10-25 02:36:59 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, pending/unknown 2/5∑7 (10%/10), starting new job
2025-10-25 02:37:00 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, pending/unknown 2/6∑8 (10%/10), started new job
2025-10-25 02:37:00 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, pending/unknown 2/6∑8 (10%/10), getting new HP set
2025-10-25 02:37:00 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, pending/unknown 2/6∑8 (10%/10), requested 1 jobs, got 1, 0.02 s/job
2025-10-25 02:37:00 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, pending/unknown 2/6∑8 (10%/10), eval #1/1 start
2025-10-25 02:37:00 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, pending/unknown 2/6∑8 (10%/10), starting new job
2025-10-25 02:37:00 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, pending/unknown 2/7∑9 (10%/10), started new job
2025-10-25 02:37:00 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, pending/unknown 2/7∑9 (10%/10), getting new HP set
2025-10-25 02:37:00 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, pending/unknown 2/7∑9 (10%/10), requested 1 jobs, got 1, 0.02 s/job
2025-10-25 02:37:00 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, pending/unknown 2/7∑9 (10%/10), eval #1/1 start
2025-10-25 02:37:00 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, pending/unknown 2/7∑9 (10%/10), starting new job
2025-10-25 02:37:02 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, pending/unknown 2/8∑10 (100%/10), started new job
2025-10-25 02:37:03 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, pending 10∑10 (100%/10), waiting for 10 jobs
2025-10-25 02:37:05 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, pending/running 1/9∑10 (100%/10), waiting for 10 jobs
2025-10-25 02:37:15 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, pending/running 1/9∑10 (100%/10), new result: RESULT: 2034.000000
2025-10-25 02:37:18 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, best RESULT: 2034, pending/running 1/8∑9 (100%/10), waiting for 10 jobs, finished 1 job
2025-10-25 02:37:18 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, best RESULT: 2034, pending/running 1/8∑9 (100%/10), waiting for 9 jobs
2025-10-25 02:37:19 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, best RESULT: 2034, pending/running 1/8∑9 (100%/10), job_failed
2025-10-25 02:37:19 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 1 ('RESULT: <FLOAT>' not found), best RESULT: 2034, pending/running 1/7∑8 (100%/10), waiting for 9 jobs, finished 1 job
2025-10-25 02:37:19 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 1 ('RESULT: <FLOAT>' not found), best RESULT: 2034, pending/running 1/7∑8 (100%/10), waiting for 8 jobs
2025-10-25 02:37:22 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 1 ('RESULT: <FLOAT>' not found), best RESULT: 2034, pending/running 1/7∑8 (80%/10), waiting for 8 jobs
2025-10-25 02:37:31 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 1 ('RESULT: <FLOAT>' not found), best RESULT: 2034, pending/running 1/7∑8 (80%/10), job_failed
2025-10-25 02:37:31 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 1 ('RESULT: <FLOAT>' not found), best RESULT: 2034, pending/running 1/7∑8 (80%/10), new result: RESULT: 14279.000000
2025-10-25 02:37:35 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 4 ('RESULT: <FLOAT>' not found), best RESULT: 2034, pending/running 1/3∑4 (80%/10), waiting for 8 jobs, finished 4 jobs
2025-10-25 02:37:35 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 4 ('RESULT: <FLOAT>' not found), best RESULT: 2034, pending/running 1/3∑4 (80%/10), waiting for 4 jobs
2025-10-25 02:37:43 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 4 ('RESULT: <FLOAT>' not found), best RESULT: 2034, pending/running 1/3∑4 (40%/10), waiting for 4 jobs
2025-10-25 02:37:53 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 4 ('RESULT: <FLOAT>' not found), best RESULT: 2034, pending/running 1/3∑4 (40%/10), job_failed
2025-10-25 02:37:54 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 5 ('RESULT: <FLOAT>' not found), best RESULT: 2034, pending/running 1/2∑3 (40%/10), waiting for 4 jobs, finished 1 job
2025-10-25 02:37:54 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 5 ('RESULT: <FLOAT>' not found), best RESULT: 2034, pending/running 1/2∑3 (40%/10), waiting for 3 jobs
2025-10-25 02:37:58 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 5 ('RESULT: <FLOAT>' not found), best RESULT: 2034, pending/running 1/2∑3 (30%/10), waiting for 3 jobs
2025-10-25 02:37:59 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 5 ('RESULT: <FLOAT>' not found), best RESULT: 2034, pending/running 1/2∑3 (30%/10), new result: RESULT: 4075.000000
2025-10-25 02:37:59 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 5 ('RESULT: <FLOAT>' not found), best RESULT: 2034, pending/running 1/2∑3 (30%/10), job_failed
2025-10-25 02:38:02 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 6 ('RESULT: <FLOAT>' not found), best RESULT: 2034, pending 1∑1 (30%/10), waiting for 3 jobs, finished 2 jobs
2025-10-25 02:38:02 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 6 ('RESULT: <FLOAT>' not found), best RESULT: 2034, pending 1∑1 (30%/10), waiting for 1 job
2025-10-25 02:38:08 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 6 ('RESULT: <FLOAT>' not found), best RESULT: 2034, pending 1∑1 (20%/10), waiting for 1 job
2025-10-25 02:38:13 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 6 ('RESULT: <FLOAT>' not found), best RESULT: 2034, pending 1∑1 (10%/10), waiting for 1 job
2025-10-25 02:38:17 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 6 ('RESULT: <FLOAT>' not found), best RESULT: 2034, pending 1∑1 (10%/10), job_failed
2025-10-25 02:38:18 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 2034, waiting for 1 job, finished 1 job
2025-10-25 02:38:18 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 2034, getting new HP set
2025-10-25 02:38:29 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 2034, requested 1 jobs, got 0, n/a
2025-10-25 02:38:30 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 2034, getting new HP set
2025-10-25 02:38:45 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 2034, requested 1 jobs, got 0, n/a
2025-10-25 02:38:46 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 2034, getting new HP set
2025-10-25 02:38:58 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 2034, requested 1 jobs, got 0, n/a
2025-10-25 02:39:00 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 2034, getting new HP set
2025-10-25 02:39:13 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 2034, requested 1 jobs, got 0, n/a
2025-10-25 02:39:14 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 2034, getting new HP set
2025-10-25 02:39:26 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 2034, requested 1 jobs, got 0, n/a
2025-10-25 02:39:28 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 2034, getting new HP set
2025-10-25 02:39:40 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 2034, requested 1 jobs, got 0, n/a
2025-10-25 02:39:41 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 2034, getting new HP set
2025-10-25 02:39:55 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 2034, requested 1 jobs, got 0, n/a
2025-10-25 02:39:56 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 2034, getting new HP set
2025-10-25 02:40:07 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 2034, requested 1 jobs, got 0, n/a
2025-10-25 02:40:08 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 2034, getting new HP set
2025-10-25 02:40:18 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 2034, requested 1 jobs, got 0, n/a
2025-10-25 02:40:19 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 2034, getting new HP set
2025-10-25 02:40:33 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 2034, requested 1 jobs, got 0, n/a
2025-10-25 02:40:35 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 2034, found 1 zero-jobs (max: 3)
2025-10-25 02:40:36 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 2034, getting new HP set
2025-10-25 02:40:50 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 2034, requested 1 jobs, got 0, n/a
2025-10-25 02:40:51 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 2034, getting new HP set
2025-10-25 02:41:07 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 2034, requested 1 jobs, got 0, n/a
2025-10-25 02:41:09 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 2034, getting new HP set
2025-10-25 02:41:21 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 2034, requested 1 jobs, got 0, n/a
2025-10-25 02:41:22 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 2034, getting new HP set
2025-10-25 02:41:36 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 2034, requested 1 jobs, got 0, n/a
2025-10-25 02:41:37 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 2034, getting new HP set
2025-10-25 02:41:52 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 2034, requested 1 jobs, got 0, n/a
2025-10-25 02:41:54 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 2034, getting new HP set
2025-10-25 02:42:07 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 2034, requested 1 jobs, got 0, n/a
2025-10-25 02:42:10 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 2034, getting new HP set
2025-10-25 02:42:25 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 2034, requested 1 jobs, got 0, n/a
2025-10-25 02:42:26 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 2034, getting new HP set
2025-10-25 02:42:41 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 2034, requested 1 jobs, got 0, n/a
2025-10-25 02:42:42 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 2034, getting new HP set
2025-10-25 02:42:55 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 2034, requested 1 jobs, got 0, n/a
2025-10-25 02:42:56 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 2034, getting new HP set
2025-10-25 02:43:07 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 2034, requested 1 jobs, got 0, n/a
2025-10-25 02:43:08 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 2034, found 2 zero-jobs (max: 3)
2025-10-25 02:43:09 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 2034, getting new HP set
2025-10-25 02:43:26 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 2034, requested 1 jobs, got 0, n/a
2025-10-25 02:43:28 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 2034, getting new HP set
2025-10-25 02:43:40 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 2034, requested 1 jobs, got 0, n/a
2025-10-25 02:43:41 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 2034, getting new HP set
2025-10-25 02:43:53 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 2034, requested 1 jobs, got 0, n/a
2025-10-25 02:44:00 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 2034, getting new HP set
2025-10-25 02:44:11 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 2034, requested 1 jobs, got 0, n/a
2025-10-25 02:44:13 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 2034, getting new HP set
2025-10-25 02:44:26 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 2034, requested 1 jobs, got 0, n/a
2025-10-25 02:44:28 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 2034, getting new HP set
2025-10-25 02:44:41 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 2034, requested 1 jobs, got 0, n/a
2025-10-25 02:44:42 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 2034, getting new HP set
2025-10-25 02:44:54 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 2034, requested 1 jobs, got 0, n/a
2025-10-25 02:44:55 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 2034, getting new HP set
2025-10-25 02:45:09 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 2034, requested 1 jobs, got 0, n/a
2025-10-25 02:45:09 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 2034, getting new HP set
2025-10-25 02:45:25 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 2034, requested 1 jobs, got 0, n/a
2025-10-25 02:45:26 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 2034, getting new HP set
2025-10-25 02:45:42 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 2034, requested 1 jobs, got 0, n/a
2025-10-25 02:45:44 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 2034, found 3 zero-jobs (max: 3)
2025-10-25 02:45:44 (9290641b-4a6d-43aa-a9cd-594824c25062): SOBOL, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 2034, 3 empty jobs (>= 3)
