⚠ It seems like the program that was about to be run didn't have 'RESULT: ' in it's output string.
Error: Raw data for an arm is expected to either be a tuple of numerical mean and SEM or just a numerical mean. Got: None for metric 'RESULT'.
Job-result: {'RESULT': None}
It seems like the search space was exhausted. You were able to get 21% of the jobs you requested (got: 5, submitted: 18, failed: 13, requested: 23) after main ran
========================================================================
To cancel, press CTRLc, then run 'scancel 1211573'
⠋Importing logging...⠋Importing warnings...⠋Importing argparse...⠋Importing datetime...⠋Importing dataclass...⠋Importing socket...⠋Importing stat...⠋Importing pwd...⠋Importing base64...⠋Importing json...⠋Importing yaml...⠋Importing toml...⠋Importing csv...⠋Importing ast...⠋Importing rich.table...⠋Importing rich print...⠋Importing rich.pretty...⠋Importing pformat...⠋Importing rich.prompt...⠋Importing types.FunctionType...⠋Importing typing...⠋Importing ThreadPoolExecutor...⠋Importing submitit.LocalExecutor...⠋Importing submitit.Job...⠋Importing importlib.util...⠋Importing platform...⠋Importing inspect frame info...⠋Importing pathlib.Path...⠋Importing uuid...⠋Importing cowsay...⠋Importing shutil...⠋Importing itertools.combinations...⠋Importing os.listdir...⠋Importing os.path...⠋Importing PIL.Image...⠋Importing sixel...⠋Importing subprocess...⠋Importing tqdm...⠋Importing beartype...⠋Importing statistics...⠋Trying to import pyfiglet...⠋Importing helpers...⠋Importing pareto...⠋Parsing arguments...⠹Importing torch...⠋Importing numpy...
[WARNING 11-03 15:08:37] ax.service.utils.with_db_settings_base: Ax currently requires a sqlalchemy version below 2.0. This will be addressed in a future release. Disabling SQL storage in Ax for now, if you would like to use SQL storage please install Ax with mysql extras via `pip install ax-platform[mysql]`.
⠧Importing ax...⠋Importing ax.core.generator_run...⠋Importing Cont_X_trans and Y_trans from ax.adapter.registry...⠋Importing ax.core.arm...⠋Importing ax.core.objective...⠋Importing ax.core.Metric...⠋Importing ax.exceptions.core...⠋Importing ax.exceptions.generation_strategy...⠋Importing CORE_DECODER_REGISTRY...⠋Trying ax.generation_strategy.generation_node...⠋Importing GenerationStep, GenerationStrategy from generation_strategy...⠋Importing GenerationNode from generation_node...⠋Importing ExternalGenerationNode...⠋Importing MaxTrials...⠋Importing GeneratorSpec...⠋Importing Models from ax.generation_strategy.registry...⠋Importing get_pending_observation_features...⠋Importing load_experiment...⠋Importing save_experiment...⠋Importing save_experiment_to_db...⠋Importing TrialStatus...⠋Importing Data...⠋Importing Experiment...⠋Importing parameter types...⠋Importing TParameterization...⠋Importing pandas...⠋Importing AxClient and ObjectiveProperties...⠋Importing RandomForestRegressor...⠋Importing botorch...⠋Importing submitit...⠋Importing ax logger...⠋Importing SQL-Storage-Stuff...
Run-UUID: cbbf192f-844a-49fb-bd78-73c478aef2be
.88888. oo .88888. dP d8888b.
d8' `8b d8' `8b 88 `88
88 88 88d8b.d8b. 88d888b. dP 88 88 88d888b. d8888P .aaadP'
88 88 88'`88'`88 88' `88 88 88 88 88' `88 88 88'
Y8. .8P 88 88 88 88 88 88 Y8. .8P 88. .88 88 88.
`8888P' dP dP dP dP dP dP `8888P' 88Y888P' dP Y88888P
88
dP
⠋Writing worker creation log...
omniopt --max_nr_of_zero_results 3 --live_share --send_anonymized_usage_stats --partition=alpha --gpus=1 --experiment_name=test_wronggoing_stuff --mem_gb=1 --time=120 --worker_timeout=1 --max_eval=23 --num_parallel_jobs=10 --run_program=Li8udGVzdHMvdGVzdF93cm9uZ2dvaW5nX3N0dWZmLmJpbi9iaW4vJShwcm9ncmFtKQ== --parameter program choice divide_by_0,simple_ok,perl,exit_code_137,result_but_exit_code_stdout_stderr,exit_code_stdout,signal_but_has_output,exit_code_no_output,exit_code_stdout_stderr,module_not_found,signal,empty,file_does_not_exist,sleep_10_and_result_exit_252,no_chmod_x,no_shebang,perl_module_fail,segfault,wrong_arch,python_name_error,syntax_error,tensorflow_syntax_error,force_keyboard_interrupt --num_random_steps=1 --follow
⠋Disabling logging...⠋Setting run folder...⠋Creating folder /home/h8/s3811141/test/randomtest_93382/OmniOpt/runs/test_wronggoing_stuff/0...⠋Writing revert_to_random_when_seemingly_exhausted file ...⠋Writing username state file...⠋Writing result names file...⠋Writing result min/max file...⠋Saving state files...Run-folder: /home/h8/s3811141/test/randomtest_93382/OmniOpt/runs/test_wronggoing_stuff/0⠋Writing live_share file if it is present...⠋Writing job_start_time file...⠸Writing git information⠋Checking max_eval...Warning: --num_random_steps 1 is smaller than --num_parallel_jobs 10. It's recommended that --num_parallel_jobs is the same as or a multiple of --num_random_steps⠋Calculating number of steps...⠋Adding excluded nodes...⠋Initializing ax_client...⠋Setting orchestrator...See https://imageseg.scads.de/omniax/share?user_id=s3811141&experiment_name=test_wronggoing_stuff&run_nr=5 for live-results.You have 1 CPUs available for the main process.Using CUDA device NVIDIA H100.Generation strategy: SOBOL for 1 step and then BOTORCH_MODULAR for 22 steps.
Run-Program: ./.tests/test_wronggoing_stuff.bin/bin/%(program)
Experiment parameters
┏━━━━━━━━━┳━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┓
┃Name ┃Type ┃Values ┃
┡━━━━━━━━━╇━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┩
│program│choice│divide_by_0, simple_ok, perl, exit_code_137, result_but_exit_code_stdout_stderr, exit_code_stdout, signal_but_has_output, exit_code_no_output, exit_code_stdout_stderr, │
│││module_not_found, signal, empty, file_does_not_exist, sleep_10_and_result_exit_252, no_chmod_x, no_shebang, perl_module_fail, segfault, wrong_arch, python_name_error, │
│││syntax_error, tensorflow_syntax_error, force_keyboard_interrupt │
└─────────┴────────┴───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘
Result-Names
┏━━━━━━━━━━━━━┳━━━━━━━━━━━━━┓
┃Result-Name┃Min or max?┃
┡━━━━━━━━━━━━━╇━━━━━━━━━━━━━┩
│RESULT │ min│
└─────────────┴─────────────┘
⠋Write files and show overview
SOBOL, running/completed/unknown 2/1/1∑4 (30%/10), started new job : 0%|░░░░░░░░░░| 0/23 [00:24
⚠ It seems like the program that was about to be run didn't have 'RESULT: ' in it's output string.
Error: Raw data for an arm is expected to either be a tuple of numerical mean and SEM or just a numerical mean. Got: None for metric 'RESULT'.
Job-result: {'RESULT': None}
BOTORCH_MODULAR, failed: 13 ('RESULT: ' not found), best RESULT: 1127, found 3 zero-jobs (max: 3) : 22%|██░░░░░░░░| 5/23 [09:34<34:29, 114.96s/it]
It seems like the search space was exhausted. You were able to get 21% of the jobs you requested (got: 5, submitted: 18, failed: 13, requested: 23) after main ran Best RESULT, min (total: 5, failed: 13)
┏━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━┳━━━━━━━━┓
┃OO_Info_SLURM_JOB_ID┃program ┃RESULT┃
┡━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━╇━━━━━━━━┩
│1211574 │exit_code_stdout│1127.0│
└──────────────────────┴──────────────────┴────────┘
Runtime Infos
┏━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━┳━━━━━━━━━━━━┳━━━━━━━━━━━━━━┳━━━━━━━━━━━━━┓
┃Number of evaluations┃Min time ┃ Max time ┃Average time┃Median time┃
┡━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━╇━━━━━━━━━━━━╇━━━━━━━━━━━━━━╇━━━━━━━━━━━━━┩
│ 18 │ 0.00 sec │ 12.00 sec │ 4.00 sec │ 6.00 sec │
└───────────────────────┴───────────┴────────────┴──────────────┴─────────────┘
2025-11-03 15:08:44 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): SOBOL, Started OmniOpt2 run...
2025-11-03 15:08:44 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): SOBOL, getting new HP set
2025-11-03 15:08:44 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): SOBOL, requested 1 jobs, got 1, 0.11 s/job
2025-11-03 15:08:45 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): SOBOL, eval #1/1 start
2025-11-03 15:08:46 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): SOBOL, starting new job
2025-11-03 15:08:46 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): SOBOL, unknown 1∑1 (10%/10), started new job
2025-11-03 15:08:46 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): SOBOL, unknown 1∑1 (10%/10), getting new HP set
2025-11-03 15:08:46 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): SOBOL, unknown 1∑1 (10%/10), requested 1 jobs, got 1, 0.05 s/job
2025-11-03 15:08:46 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): SOBOL, unknown 1∑1 (10%/10), eval #1/1 start
2025-11-03 15:08:46 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): SOBOL, unknown 1∑1 (10%/10), starting new job
2025-11-03 15:08:52 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): SOBOL, pending/unknown 1/1∑2 (20%/10), started new job
2025-11-03 15:08:52 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): SOBOL, pending/unknown 1/1∑2 (20%/10), getting new HP set
2025-11-03 15:08:52 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): SOBOL, pending/unknown 1/1∑2 (20%/10), requested 1 jobs, got 1, 0.05 s/job
2025-11-03 15:08:52 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): SOBOL, pending/unknown 1/1∑2 (20%/10), eval #1/1 start
2025-11-03 15:08:52 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): SOBOL, pending/unknown 1/1∑2 (20%/10), starting new job
2025-11-03 15:09:02 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): SOBOL, running/unknown 2/1∑3 (30%/10), started new job
2025-11-03 15:09:03 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): SOBOL, running/unknown 2/1∑3 (30%/10), getting new HP set
2025-11-03 15:09:03 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): SOBOL, running/unknown 2/1∑3 (30%/10), requested 1 jobs, got 1, 0.05 s/job
2025-11-03 15:09:03 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): SOBOL, running/unknown 2/1∑3 (30%/10), eval #1/1 start
2025-11-03 15:09:03 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): SOBOL, running/unknown 2/1∑3 (30%/10), starting new job
2025-11-03 15:09:08 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): SOBOL, running/completed/unknown 2/1/1∑4 (30%/10), started new job
2025-11-03 15:09:08 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): SOBOL, running/completed/unknown 2/1/1∑4 (30%/10), job_failed
2025-11-03 15:09:08 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): SOBOL, failed: 1 ('RESULT: <FLOAT>' not found), running/unknown 2/1∑3 (30%/10), finishing jobs (get_next_trials), finished 1 job
2025-11-03 15:09:08 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): SOBOL, failed: 1 ('RESULT: <FLOAT>' not found), running/unknown 2/1∑3 (30%/10), getting new HP set
2025-11-03 15:09:08 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): SOBOL, failed: 1 ('RESULT: <FLOAT>' not found), running/unknown 2/1∑3 (30%/10), requested 1 jobs, got 1, 0.09 s/job
2025-11-03 15:09:09 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): SOBOL, failed: 1 ('RESULT: <FLOAT>' not found), running/unknown 2/1∑3 (30%/10), eval #1/1 start
2025-11-03 15:09:09 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): SOBOL, failed: 1 ('RESULT: <FLOAT>' not found), running/unknown 2/1∑3 (30%/10), starting new job
2025-11-03 15:09:14 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): SOBOL, failed: 1 ('RESULT: <FLOAT>' not found), completed/pending/unknown 2/1/1∑4 (30%/10), started new job
2025-11-03 15:09:14 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): SOBOL, failed: 1 ('RESULT: <FLOAT>' not found), completed/pending/unknown 2/1/1∑4 (30%/10), new result: RESULT: 1127.000000
2025-11-03 15:09:14 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): SOBOL, failed: 1 ('RESULT: <FLOAT>' not found), completed/pending/unknown 2/1/1∑4 (30%/10), new result: RESULT: 7188.000000
2025-11-03 15:09:17 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): SOBOL, failed: 1 ('RESULT: <FLOAT>' not found), best RESULT: 1127, pending 2∑2 (30%/10), finishing jobs (get_next_trials), finished 2 jobs
2025-11-03 15:09:19 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 1 ('RESULT: <FLOAT>' not found), best RESULT: 1127, pending 2∑2 (20%/10), getting new HP set
2025-11-03 15:09:19 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 1 ('RESULT: <FLOAT>' not found), best RESULT: 1127, pending 2∑2 (20%/10), requested 1 jobs, got 1, 1.67 s/job
2025-11-03 15:09:19 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 1 ('RESULT: <FLOAT>' not found), best RESULT: 1127, pending 2∑2 (20%/10), eval #1/1 start
2025-11-03 15:09:19 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 1 ('RESULT: <FLOAT>' not found), best RESULT: 1127, pending 2∑2 (20%/10), starting new job
2025-11-03 15:09:29 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 1 ('RESULT: <FLOAT>' not found), best RESULT: 1127, completed/running/unknown 1/1/1∑3 (30%/10), started new job
2025-11-03 15:09:29 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 1 ('RESULT: <FLOAT>' not found), best RESULT: 1127, completed/running/unknown 1/1/1∑3 (30%/10), job_failed
2025-11-03 15:09:29 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 2 ('RESULT: <FLOAT>' not found), best RESULT: 1127, running/unknown 1/1∑2 (30%/10), finishing jobs (get_next_trials), finished 1 job
2025-11-03 15:09:31 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 2 ('RESULT: <FLOAT>' not found), best RESULT: 1127, running/unknown 1/1∑2 (30%/10), getting new HP set
2025-11-03 15:09:31 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 2 ('RESULT: <FLOAT>' not found), best RESULT: 1127, running/unknown 1/1∑2 (30%/10), requested 1 jobs, got 1, 1.49 s/job
2025-11-03 15:09:31 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 2 ('RESULT: <FLOAT>' not found), best RESULT: 1127, running/unknown 1/1∑2 (30%/10), eval #1/1 start
2025-11-03 15:09:31 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 2 ('RESULT: <FLOAT>' not found), best RESULT: 1127, running/unknown 1/1∑2 (30%/10), starting new job
2025-11-03 15:09:31 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 2 ('RESULT: <FLOAT>' not found), best RESULT: 1127, running/unknown 1/2∑3 (30%/10), started new job
2025-11-03 15:09:33 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 2 ('RESULT: <FLOAT>' not found), best RESULT: 1127, running/unknown 1/2∑3 (30%/10), getting new HP set
2025-11-03 15:09:35 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 2 ('RESULT: <FLOAT>' not found), best RESULT: 1127, running 3∑3 (30%/10), getting new HP set
2025-11-03 15:09:39 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 2 ('RESULT: <FLOAT>' not found), best RESULT: 1127, completed/running 2/1∑3 (10%/10), getting new HP set
2025-11-03 15:09:59 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 2 ('RESULT: <FLOAT>' not found), best RESULT: 1127, completed/running 2/1∑3 (0%/10), getting new HP set
2025-11-03 15:10:02 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 2 ('RESULT: <FLOAT>' not found), best RESULT: 1127, completed/running 2/1∑3 (0%/10), requested 1 jobs, got 0, n/a
2025-11-03 15:10:03 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 2 ('RESULT: <FLOAT>' not found), best RESULT: 1127, completed/running 2/1∑3 (0%/10), job_failed
2025-11-03 15:10:03 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 2 ('RESULT: <FLOAT>' not found), best RESULT: 1127, completed/running 2/1∑3 (0%/10), new result: RESULT: 23113.000000
2025-11-03 15:10:03 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 2 ('RESULT: <FLOAT>' not found), best RESULT: 1127, completed/running 2/1∑3 (0%/10), job_failed
2025-11-03 15:10:07 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 4 ('RESULT: <FLOAT>' not found), best RESULT: 1127, finishing jobs (get_next_trials), finished 3 jobs
2025-11-03 15:10:08 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 4 ('RESULT: <FLOAT>' not found), best RESULT: 1127, getting new HP set
2025-11-03 15:10:09 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 4 ('RESULT: <FLOAT>' not found), best RESULT: 1127, requested 1 jobs, got 1, 1.45 s/job
2025-11-03 15:10:09 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 4 ('RESULT: <FLOAT>' not found), best RESULT: 1127, eval #1/1 start
2025-11-03 15:10:09 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 4 ('RESULT: <FLOAT>' not found), best RESULT: 1127, starting new job
2025-11-03 15:10:09 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 4 ('RESULT: <FLOAT>' not found), best RESULT: 1127, unknown 1∑1 (10%/10), started new job
2025-11-03 15:10:11 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 4 ('RESULT: <FLOAT>' not found), best RESULT: 1127, unknown 1∑1 (10%/10), getting new HP set
2025-11-03 15:10:12 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 4 ('RESULT: <FLOAT>' not found), best RESULT: 1127, pending 1∑1 (10%/10), getting new HP set
2025-11-03 15:10:41 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 4 ('RESULT: <FLOAT>' not found), best RESULT: 1127, pending 1∑1 (0%/10), getting new HP set
2025-11-03 15:10:42 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 4 ('RESULT: <FLOAT>' not found), best RESULT: 1127, completed 1∑1 (0%/10), getting new HP set
2025-11-03 15:10:48 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 4 ('RESULT: <FLOAT>' not found), best RESULT: 1127, completed 1∑1 (0%/10), requested 1 jobs, got 0, n/a
2025-11-03 15:10:48 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 4 ('RESULT: <FLOAT>' not found), best RESULT: 1127, completed 1∑1 (0%/10), new result: RESULT: 15283.000000
2025-11-03 15:10:50 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 4 ('RESULT: <FLOAT>' not found), best RESULT: 1127, finishing jobs, finished 1 job
2025-11-03 15:10:51 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 4 ('RESULT: <FLOAT>' not found), best RESULT: 1127, found 1 zero-jobs (max: 3)
2025-11-03 15:10:53 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 4 ('RESULT: <FLOAT>' not found), best RESULT: 1127, getting new HP set
2025-11-03 15:10:53 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 4 ('RESULT: <FLOAT>' not found), best RESULT: 1127, requested 1 jobs, got 1, 1.90 s/job
2025-11-03 15:10:56 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 4 ('RESULT: <FLOAT>' not found), best RESULT: 1127, eval #1/1 start
2025-11-03 15:10:57 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 4 ('RESULT: <FLOAT>' not found), best RESULT: 1127, starting new job
2025-11-03 15:10:57 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 4 ('RESULT: <FLOAT>' not found), best RESULT: 1127, unknown 1∑1 (10%/10), started new job
2025-11-03 15:10:59 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 4 ('RESULT: <FLOAT>' not found), best RESULT: 1127, unknown 1∑1 (10%/10), getting new HP set
2025-11-03 15:11:06 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 4 ('RESULT: <FLOAT>' not found), best RESULT: 1127, running 1∑1 (10%/10), getting new HP set
2025-11-03 15:11:16 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 4 ('RESULT: <FLOAT>' not found), best RESULT: 1127, completed 1∑1 (10%/10), getting new HP set
2025-11-03 15:11:17 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 4 ('RESULT: <FLOAT>' not found), best RESULT: 1127, completed 1∑1 (0%/10), getting new HP set
2025-11-03 15:11:34 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 4 ('RESULT: <FLOAT>' not found), best RESULT: 1127, completed 1∑1 (0%/10), requested 1 jobs, got 0, n/a
2025-11-03 15:11:35 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 4 ('RESULT: <FLOAT>' not found), best RESULT: 1127, completed 1∑1 (0%/10), job_failed
2025-11-03 15:11:35 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 5 ('RESULT: <FLOAT>' not found), best RESULT: 1127, finishing jobs (get_next_trials), finished 1 job
2025-11-03 15:11:38 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 5 ('RESULT: <FLOAT>' not found), best RESULT: 1127, getting new HP set
2025-11-03 15:11:38 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 5 ('RESULT: <FLOAT>' not found), best RESULT: 1127, requested 1 jobs, got 1, 2.69 s/job
2025-11-03 15:11:38 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 5 ('RESULT: <FLOAT>' not found), best RESULT: 1127, eval #1/1 start
2025-11-03 15:11:38 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 5 ('RESULT: <FLOAT>' not found), best RESULT: 1127, starting new job
2025-11-03 15:11:39 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 5 ('RESULT: <FLOAT>' not found), best RESULT: 1127, unknown 1∑1 (10%/10), started new job
2025-11-03 15:11:40 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 5 ('RESULT: <FLOAT>' not found), best RESULT: 1127, unknown 1∑1 (10%/10), getting new HP set
2025-11-03 15:11:42 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 5 ('RESULT: <FLOAT>' not found), best RESULT: 1127, pending 1∑1 (10%/10), getting new HP set
2025-11-03 15:11:48 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 5 ('RESULT: <FLOAT>' not found), best RESULT: 1127, running 1∑1 (10%/10), getting new HP set
2025-11-03 15:11:57 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 5 ('RESULT: <FLOAT>' not found), best RESULT: 1127, completed 1∑1 (10%/10), getting new HP set
2025-11-03 15:12:00 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 5 ('RESULT: <FLOAT>' not found), best RESULT: 1127, completed 1∑1 (0%/10), getting new HP set
2025-11-03 15:12:17 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 5 ('RESULT: <FLOAT>' not found), best RESULT: 1127, completed 1∑1 (0%/10), requested 1 jobs, got 0, n/a
2025-11-03 15:12:17 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 5 ('RESULT: <FLOAT>' not found), best RESULT: 1127, completed 1∑1 (0%/10), job_failed
2025-11-03 15:12:18 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 6 ('RESULT: <FLOAT>' not found), best RESULT: 1127, finishing jobs (get_next_trials), finished 1 job
2025-11-03 15:12:19 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 6 ('RESULT: <FLOAT>' not found), best RESULT: 1127, getting new HP set
2025-11-03 15:12:19 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 6 ('RESULT: <FLOAT>' not found), best RESULT: 1127, requested 1 jobs, got 1, 0.92 s/job
2025-11-03 15:12:19 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 6 ('RESULT: <FLOAT>' not found), best RESULT: 1127, eval #1/1 start
2025-11-03 15:12:19 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 6 ('RESULT: <FLOAT>' not found), best RESULT: 1127, starting new job
2025-11-03 15:12:19 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 6 ('RESULT: <FLOAT>' not found), best RESULT: 1127, unknown 1∑1 (10%/10), started new job
2025-11-03 15:12:21 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 6 ('RESULT: <FLOAT>' not found), best RESULT: 1127, unknown 1∑1 (10%/10), getting new HP set
2025-11-03 15:12:23 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 6 ('RESULT: <FLOAT>' not found), best RESULT: 1127, pending 1∑1 (10%/10), getting new HP set
2025-11-03 15:12:28 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 6 ('RESULT: <FLOAT>' not found), best RESULT: 1127, running 1∑1 (10%/10), getting new HP set
2025-11-03 15:12:38 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 6 ('RESULT: <FLOAT>' not found), best RESULT: 1127, completed 1∑1 (10%/10), getting new HP set
2025-11-03 15:12:40 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 6 ('RESULT: <FLOAT>' not found), best RESULT: 1127, completed 1∑1 (0%/10), getting new HP set
2025-11-03 15:12:56 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 6 ('RESULT: <FLOAT>' not found), best RESULT: 1127, completed 1∑1 (0%/10), requested 1 jobs, got 0, n/a
2025-11-03 15:12:57 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 6 ('RESULT: <FLOAT>' not found), best RESULT: 1127, completed 1∑1 (0%/10), job_failed
2025-11-03 15:12:58 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 1127, finishing jobs (get_next_trials), finished 1 job
2025-11-03 15:12:58 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 1127, getting new HP set
2025-11-03 15:12:59 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 1127, requested 1 jobs, got 1, 0.56 s/job
2025-11-03 15:12:59 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 1127, eval #1/1 start
2025-11-03 15:12:59 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 1127, starting new job
2025-11-03 15:12:59 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 1127, unknown 1∑1 (10%/10), started new job
2025-11-03 15:13:01 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 1127, unknown 1∑1 (10%/10), getting new HP set
2025-11-03 15:13:03 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 1127, running 1∑1 (10%/10), getting new HP set
2025-11-03 15:13:07 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 1127, completed 1∑1 (10%/10), getting new HP set
2025-11-03 15:13:09 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 1127, completed 1∑1 (0%/10), getting new HP set
2025-11-03 15:13:39 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 1127, completed 1∑1 (0%/10), requested 1 jobs, got 0, n/a
2025-11-03 15:13:39 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 7 ('RESULT: <FLOAT>' not found), best RESULT: 1127, completed 1∑1 (0%/10), job_failed
2025-11-03 15:13:40 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 8 ('RESULT: <FLOAT>' not found), best RESULT: 1127, finishing jobs (get_next_trials), finished 1 job
2025-11-03 15:13:42 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 8 ('RESULT: <FLOAT>' not found), best RESULT: 1127, getting new HP set
2025-11-03 15:13:43 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 8 ('RESULT: <FLOAT>' not found), best RESULT: 1127, requested 1 jobs, got 1, 2.84 s/job
2025-11-03 15:13:43 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 8 ('RESULT: <FLOAT>' not found), best RESULT: 1127, eval #1/1 start
2025-11-03 15:13:43 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 8 ('RESULT: <FLOAT>' not found), best RESULT: 1127, starting new job
2025-11-03 15:13:43 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 8 ('RESULT: <FLOAT>' not found), best RESULT: 1127, unknown 1∑1 (10%/10), started new job
2025-11-03 15:13:45 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 8 ('RESULT: <FLOAT>' not found), best RESULT: 1127, unknown 1∑1 (10%/10), getting new HP set
2025-11-03 15:13:47 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 8 ('RESULT: <FLOAT>' not found), best RESULT: 1127, pending 1∑1 (10%/10), getting new HP set
2025-11-03 15:13:51 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 8 ('RESULT: <FLOAT>' not found), best RESULT: 1127, running 1∑1 (10%/10), getting new HP set
2025-11-03 15:13:59 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 8 ('RESULT: <FLOAT>' not found), best RESULT: 1127, running 1∑1 (0%/10), getting new HP set
2025-11-03 15:14:01 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 8 ('RESULT: <FLOAT>' not found), best RESULT: 1127, completed 1∑1 (0%/10), getting new HP set
2025-11-03 15:14:20 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 8 ('RESULT: <FLOAT>' not found), best RESULT: 1127, completed 1∑1 (0%/10), requested 1 jobs, got 0, n/a
2025-11-03 15:14:21 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 8 ('RESULT: <FLOAT>' not found), best RESULT: 1127, completed 1∑1 (0%/10), job_failed
2025-11-03 15:14:21 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 9 ('RESULT: <FLOAT>' not found), best RESULT: 1127, finishing jobs, finished 1 job
2025-11-03 15:14:22 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 9 ('RESULT: <FLOAT>' not found), best RESULT: 1127, found 2 zero-jobs (max: 3)
2025-11-03 15:14:25 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 9 ('RESULT: <FLOAT>' not found), best RESULT: 1127, getting new HP set
2025-11-03 15:14:25 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 9 ('RESULT: <FLOAT>' not found), best RESULT: 1127, requested 1 jobs, got 1, 2.82 s/job
2025-11-03 15:14:26 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 9 ('RESULT: <FLOAT>' not found), best RESULT: 1127, eval #1/1 start
2025-11-03 15:14:26 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 9 ('RESULT: <FLOAT>' not found), best RESULT: 1127, starting new job
2025-11-03 15:14:26 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 9 ('RESULT: <FLOAT>' not found), best RESULT: 1127, unknown 1∑1 (10%/10), started new job
2025-11-03 15:14:28 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 9 ('RESULT: <FLOAT>' not found), best RESULT: 1127, unknown 1∑1 (10%/10), getting new HP set
2025-11-03 15:14:29 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 9 ('RESULT: <FLOAT>' not found), best RESULT: 1127, running 1∑1 (10%/10), getting new HP set
2025-11-03 15:14:32 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 9 ('RESULT: <FLOAT>' not found), best RESULT: 1127, completed 1∑1 (10%/10), getting new HP set
2025-11-03 15:14:36 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 9 ('RESULT: <FLOAT>' not found), best RESULT: 1127, completed 1∑1 (0%/10), getting new HP set
2025-11-03 15:15:08 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 9 ('RESULT: <FLOAT>' not found), best RESULT: 1127, completed 1∑1 (0%/10), requested 1 jobs, got 0, n/a
2025-11-03 15:15:08 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 9 ('RESULT: <FLOAT>' not found), best RESULT: 1127, completed 1∑1 (0%/10), job_failed
2025-11-03 15:15:09 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 10 ('RESULT: <FLOAT>' not found), best RESULT: 1127, finishing jobs (get_next_trials), finished 1 job
2025-11-03 15:15:11 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 10 ('RESULT: <FLOAT>' not found), best RESULT: 1127, getting new HP set
2025-11-03 15:15:11 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 10 ('RESULT: <FLOAT>' not found), best RESULT: 1127, requested 1 jobs, got 1, 2.19 s/job
2025-11-03 15:15:14 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 10 ('RESULT: <FLOAT>' not found), best RESULT: 1127, eval #1/1 start
2025-11-03 15:15:14 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 10 ('RESULT: <FLOAT>' not found), best RESULT: 1127, starting new job
2025-11-03 15:15:14 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 10 ('RESULT: <FLOAT>' not found), best RESULT: 1127, unknown 1∑1 (10%/10), started new job
2025-11-03 15:15:16 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 10 ('RESULT: <FLOAT>' not found), best RESULT: 1127, unknown 1∑1 (10%/10), getting new HP set
2025-11-03 15:15:23 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 10 ('RESULT: <FLOAT>' not found), best RESULT: 1127, pending 1∑1 (10%/10), getting new HP set
2025-11-03 15:15:33 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 10 ('RESULT: <FLOAT>' not found), best RESULT: 1127, completed 1∑1 (10%/10), getting new HP set
2025-11-03 15:15:38 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 10 ('RESULT: <FLOAT>' not found), best RESULT: 1127, completed 1∑1 (0%/10), getting new HP set
2025-11-03 15:15:59 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 10 ('RESULT: <FLOAT>' not found), best RESULT: 1127, completed 1∑1 (0%/10), requested 1 jobs, got 0, n/a
2025-11-03 15:15:59 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 10 ('RESULT: <FLOAT>' not found), best RESULT: 1127, completed 1∑1 (0%/10), job_failed
2025-11-03 15:16:00 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 11 ('RESULT: <FLOAT>' not found), best RESULT: 1127, finishing jobs (get_next_trials), finished 1 job
2025-11-03 15:16:03 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 11 ('RESULT: <FLOAT>' not found), best RESULT: 1127, getting new HP set
2025-11-03 15:16:03 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 11 ('RESULT: <FLOAT>' not found), best RESULT: 1127, requested 1 jobs, got 1, 2.17 s/job
2025-11-03 15:16:03 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 11 ('RESULT: <FLOAT>' not found), best RESULT: 1127, eval #1/1 start
2025-11-03 15:16:03 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 11 ('RESULT: <FLOAT>' not found), best RESULT: 1127, starting new job
2025-11-03 15:16:04 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 11 ('RESULT: <FLOAT>' not found), best RESULT: 1127, unknown 1∑1 (10%/10), started new job
2025-11-03 15:16:06 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 11 ('RESULT: <FLOAT>' not found), best RESULT: 1127, unknown 1∑1 (10%/10), getting new HP set
2025-11-03 15:16:10 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 11 ('RESULT: <FLOAT>' not found), best RESULT: 1127, running 1∑1 (10%/10), getting new HP set
2025-11-03 15:16:19 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 11 ('RESULT: <FLOAT>' not found), best RESULT: 1127, completed 1∑1 (10%/10), getting new HP set
2025-11-03 15:16:21 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 11 ('RESULT: <FLOAT>' not found), best RESULT: 1127, completed 1∑1 (0%/10), getting new HP set
2025-11-03 15:16:45 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 11 ('RESULT: <FLOAT>' not found), best RESULT: 1127, completed 1∑1 (0%/10), requested 1 jobs, got 0, n/a
2025-11-03 15:16:45 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 11 ('RESULT: <FLOAT>' not found), best RESULT: 1127, completed 1∑1 (0%/10), job_failed
2025-11-03 15:16:47 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 12 ('RESULT: <FLOAT>' not found), best RESULT: 1127, finishing jobs (get_next_trials), finished 1 job
2025-11-03 15:16:48 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 12 ('RESULT: <FLOAT>' not found), best RESULT: 1127, getting new HP set
2025-11-03 15:16:48 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 12 ('RESULT: <FLOAT>' not found), best RESULT: 1127, requested 1 jobs, got 1, 1.42 s/job
2025-11-03 15:16:49 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 12 ('RESULT: <FLOAT>' not found), best RESULT: 1127, eval #1/1 start
2025-11-03 15:16:49 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 12 ('RESULT: <FLOAT>' not found), best RESULT: 1127, starting new job
2025-11-03 15:16:49 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 12 ('RESULT: <FLOAT>' not found), best RESULT: 1127, unknown 1∑1 (10%/10), started new job
2025-11-03 15:16:51 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 12 ('RESULT: <FLOAT>' not found), best RESULT: 1127, unknown 1∑1 (10%/10), getting new HP set
2025-11-03 15:16:53 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 12 ('RESULT: <FLOAT>' not found), best RESULT: 1127, completed 1∑1 (10%/10), getting new HP set
2025-11-03 15:16:55 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 12 ('RESULT: <FLOAT>' not found), best RESULT: 1127, completed 1∑1 (0%/10), getting new HP set
2025-11-03 15:17:34 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 12 ('RESULT: <FLOAT>' not found), best RESULT: 1127, completed 1∑1 (0%/10), requested 1 jobs, got 0, n/a
2025-11-03 15:17:35 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 12 ('RESULT: <FLOAT>' not found), best RESULT: 1127, completed 1∑1 (0%/10), job_failed
2025-11-03 15:17:35 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 13 ('RESULT: <FLOAT>' not found), best RESULT: 1127, finishing jobs (get_next_trials), finished 1 job
2025-11-03 15:17:36 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 13 ('RESULT: <FLOAT>' not found), best RESULT: 1127, getting new HP set
2025-11-03 15:17:36 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 13 ('RESULT: <FLOAT>' not found), best RESULT: 1127, requested 1 jobs, got 1, 0.67 s/job
2025-11-03 15:17:37 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 13 ('RESULT: <FLOAT>' not found), best RESULT: 1127, eval #1/1 start
2025-11-03 15:17:37 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 13 ('RESULT: <FLOAT>' not found), best RESULT: 1127, starting new job
2025-11-03 15:17:38 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 13 ('RESULT: <FLOAT>' not found), best RESULT: 1127, unknown 1∑1 (10%/10), started new job
2025-11-03 15:17:39 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 13 ('RESULT: <FLOAT>' not found), best RESULT: 1127, unknown 1∑1 (10%/10), getting new HP set
2025-11-03 15:17:42 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 13 ('RESULT: <FLOAT>' not found), best RESULT: 1127, pending 1∑1 (10%/10), getting new HP set
2025-11-03 15:17:57 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 13 ('RESULT: <FLOAT>' not found), best RESULT: 1127, running 1∑1 (10%/10), getting new HP set
2025-11-03 15:18:08 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 13 ('RESULT: <FLOAT>' not found), best RESULT: 1127, running 1∑1 (0%/10), getting new HP set
2025-11-03 15:18:13 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 13 ('RESULT: <FLOAT>' not found), best RESULT: 1127, running 1∑1 (0%/10), requested 1 jobs, got 0, n/a
2025-11-03 15:18:14 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 13 ('RESULT: <FLOAT>' not found), best RESULT: 1127, running 1∑1 (0%/10), new result: RESULT: 1234.000000
2025-11-03 15:18:17 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 13 ('RESULT: <FLOAT>' not found), best RESULT: 1127, finishing jobs, finished 1 job
2025-11-03 15:18:18 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 13 ('RESULT: <FLOAT>' not found), best RESULT: 1127, found 3 zero-jobs (max: 3)
2025-11-03 15:18:18 (cc8a7e8a-542d-425e-bd3c-fae9c930644f): BOTORCH_MODULAR, failed: 13 ('RESULT: <FLOAT>' not found), best RESULT: 1127, 3 empty jobs (>= 3)
