trial_index,submit_time,queue_time,worker_generator_uuid,start_time,end_time,run_time,program_string,exit_code,signal,hostname,OO_Info_int_param,OO_Info_int_param_two,OO_Info_float_param,OO_Info_choice_param,OO_Info_SLURM_JOB_ID,arm_name,trial_status,generation_node,RESULT,int_param,float_param,int_param_two,choice_param
0,1755043877,34,83d01d84-0263-4272-891e-9f47d738ca5b,1755043911,1755043917,6,./.tests/optimization_example --int_param='5' --float_param='-47.53395378589630126953' --choice_param='1' --int_param_two='-24' --nr_results=1,0,,i8022,5,-24,-47.53395378589630126953125,1,1786797,0_0,COMPLETED,SOBOL,-36094.283003786898916587233543395996,5,-47.53395378589630126953125,-24,1
1,,,,,,,,,,,,,,,,1_0,RUNNING,BOTORCH_MODULAR,,-85,-0.539402664858241176482067658071,-77,hallo
========================================================================
To cancel, press CTRL c, then run 'scancel 1786794'
โ Importing logging...
โ Importing warnings...
โ Importing argparse...
โ Importing datetime...
โ Importing dataclass...
โ Importing socket...
โ Importing stat...
โ Importing pwd...
โ Importing signal...
โ Importing base64...
โ Importing json...
โ Importing yaml...
โ Importing toml...
โ Importing csv...
โ Importing ast...
โ Importing rich.table...
โ Importing rich print...
โ Importing rich.pretty...
โ Importing rich.prompt...
โ Importing types.FunctionType...
โ Importing typing...
โ Importing ThreadPoolExecutor...
โ Importing submitit.LocalExecutor...
โ Importing submitit.Job...
โ Importing importlib.util...
โ Importing inspect...
โ Importing platform...
โ Importing inspect frame info...
โ Importing pathlib.Path...
โ Importing uuid...
โ Importing traceback...
โ Importing cowsay...
โ Importing psutil...
โ Importing shutil...
โ Importing itertools.combinations...
โ Importing os.listdir...
โ Importing os.path...
โ Importing PIL.Image...
โ Importing sixel...
โ Importing subprocess...
โ Importing tqdm...
โ ฆ Importing beartype...
โ Importing statistics...
โ Trying to import pyfiglet...
โ ผ Importing helpers...
โ Parsing arguments...
โ ฆ Importing torch...
โ Importing numpy...
โ ด Importing ax...
โ Importing ax.core.generator_run...
โ Importing Cont_X_trans and Y_trans from ax.adapter.registry...
โ Importing ax.core.arm...
โ Importing ax.core.objective...
โ Importing ax.core.Metric...
โ Importing ax.exceptions.core...
โ Importing ax.exceptions.generation_strategy...
โ Importing CORE_DECODER_REGISTRY...
โ Trying ax.generation_strategy.generation_node...
โ Importing GenerationStep, GenerationStrategy from generation_strategy...
โ Importing GenerationNode from generation_node...
โ Importing ExternalGenerationNode...
โ Importing MaxTrials...
โ Importing GeneratorSpec...
โ Importing Models from ax.generation_strategy.registry...
โ Importing get_pending_observation_features...
โ Importing load_experiment...
โ Importing save_experiment...
โ Importing save_experiment_to_db...
โ Importing TrialStatus...
โ Importing Data...
โ Importing Experiment...
โ Importing parameter types...
โ Importing TParameterization...
โ Importing pandas...
โ Importing AxClient and ObjectiveProperties...
โ Importing RandomForestRegressor...
โ Importing botorch...
โ Importing submitit...
โ Importing ax logger...
โ Importing SQL-Storage-Stuff...
Run-UUID: f2aa838f-dfbf-49ee-8c64-290e44ff854a
/home/h8/s3811141/test/randomtest_93382/OmniOpt/.omniopt.py:10801: RuntimeWarning:
coroutine 'start_logging_daemon' was never awaited
_________________________________________________
/ \
| OmniOpt2 - Grid search? Please, Iโm doing ballet |
| through parameter space. |
\ /
=================================================
\
\
\
.--.
|o_o |
|:_/ |
// \ \
(| | )
/'\_ _/`\
\___)=(___/
โ Writing worker creation log...
omniopt --live_share --send_anonymized_usage_stats --partition alpha --experiment_name=adding_old_jobs_to_new_jobs --mem_gb=4 --time=60 --worker_timeout=5 --max_eval 2 --num_parallel_jobs 1 --gpus=1 --run_program Li8udGVzdHMvb3B0aW1pemF0aW9uX2V4YW1wbGUgLS1pbnRfcGFyYW09JyUoaW50X3BhcmFtKScgLS1mbG9hdF9wYXJhbT0nJShmbG9hdF9wYXJhbSknIC0tY2hvaWNlX3BhcmFtPSclKGNob2ljZV9wYXJhbSknICAtLWludF9wYXJhbV90d289JyUoaW50X3BhcmFtX3R3byknIC0tbnJfcmVzdWx0cz0x --parameter int_param range -100 10 int --parameter float_param range -100 10 float --parameter choice_param choice 1,2,4,8,16,hallo --parameter int_param_two range -100 10 int --follow --num_random_steps 1 --model BOTORCH_MODULAR --auto_exclude_defective_hosts
โ Disabling logging...
โ Setting run folder...
โ Creating folder /home/h8/s3811141/test/randomtest_93382/OmniOpt/runs/adding_old_jobs_to_new_jobs/1...
โ Writing revert_to_random_when_seemingly_exhausted file ...
โ Writing username state file...
โ Writing result names file...
โ Writing result min/max file...
โ Saving state files...
Run-folder: /home/h8/s3811141/test/randomtest_93382/OmniOpt/runs/adding_old_jobs_to_new_jobs/1
โ Printing run info...
โ Initializing NVIDIA-Logs...
โ Writing ui_url file if it is present...
โ Writing live_share file if it is present...
โ Writing job_start_time file...
โ Checking max_eval...
โ Calculating number of steps...
โ Adding excluded nodes...
โ Handling random steps...
โ Initializing ax_client...
โ Setting orchestrator...
See https://imageseg.scads.de/omniax/share?user_id=s3811141&experiment_name=adding_old_jobs_to_new_jobs&run_nr=1 for live-results.
โ Initializing live share...
โโโโโโโย โโย โโย โโโย โโโโโโโโย โโโโโโย โโโโโโโ
โย โโโย โย โโโโย ย โโย ย โโย โย ย ย โโโโโโโย ย โย โโโย โ
โย โโโย โย โโย โย ย โโโโโโโย โโโโโโโโโโโย โย โโโย โ
โโโโโโโย โย โย โย โย โย โโโโโโโย โย โย โโโย โโโโโโโ
โโโโโโโโโโโโโโโย โโโโโย โโโโโย โโโโโโโโโโย โโ
ย โโโโโโโย ย โโโโโโโโโย โโโโโโโโโโโโโย โโโโย ย ย
โโโโย โโโย โโย โย โโโโโโโโโโโโโโโย ย โโย ย โโโโย โ
โโโโโโโโโย ย ย โย โโโย โย โโโโย ย โโโย โโย โย โย โย โย
ย ย ย โโโโโโโโย ย โโโโโโโโโโโย โโโโโโโย โโโโโโโโ
โโโย โโโโโโโย โย โโโย โย โโโย โโย โโโย โโย โโโโย ย ย
โโโโโย โโโย ย ย โย โโโย โย โโย ย ย โโย โโย โโโโโโโโโโ
ย โย โโโโโโโโโโโย ย โย โโโโโโโย โโโย โโโย โโโโย โย
โโโโย โโย โย โโย โโย ย โโโโย โโโโโโย โย โโโโโโย โโโ
โโโย โโโโโโโโโโโโโโโย โย โย โโโโโย โย โย โโย โโโโ
โโโย โโโโโโโโโโโโโย โโโโโโโโย โโโโย โโโโโโโโโ
โย ย โย โโโโโย ย โย โโโย โย โโโย ย ย ย โโโโย โย ย โโโย โย
โย โย ย ย โย โโโโโโโโโโโโโโโโโโย ย โโโย โโโโโย โโโ
โโโโโโโย โโย ย ย ย โโโย โโโโโโโโโโโโย โโย โย โย โย โ
โย โโโย โย โโโย โโโโโย โโโโโโย โโโโโย โโโโโโโโโโ
โย โโโย โย โโโโโย โย โย โโโโย โโโโโโโโย โย โโโโย โย
โโโโโโโย โโโโโโโย โโโโโโโย ย โโย ย โย โย โย โย ย โย ย
โ Initializing live share...
You have 2 CPUs available for the main process. Using CUDA device NVIDIA A100-SXM4-40GB. Generation strategy: SOBOL for 1 step and then BOTORCH_MODULAR for 1 step.
Run-Program: ./.tests/optimization_example --int_param='%(int_param)' --float_param='%(float_param)' --choice_param='%(choice_param)' --int_param_two='%(int_param_two)' --nr_results=1
Experiment parameters
โโโโโโโโโโโโโโโโโณโโโโโโโโโณโโโโโโโโโโโโโโณโโโโโโโโโโโโโโณโโโโโโโโโโโโโโโโโโโโโโโโณโโโโโโโโณโโโโโโโโโโโโโ
โ Name โ Type โ Lower bound โ Upper bound โ Values โ Type โ Log Scale? โ
โกโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโฉ
โ int_param โ range โ -100 โ 10 โ โ int โ No โ
โ float_param โ range โ -100 โ 10 โ โ float โ No โ
โ choice_param โ choice โ โ โ 1, 2, 4, 8, 16, hallo โ โ โ
โ int_param_two โ range โ -100 โ 10 โ โ int โ No โ
โโโโโโโโโโโโโโโโโดโโโโโโโโโดโโโโโโโโโโโโโโดโโโโโโโโโโโโโโดโโโโโโโโโโโโโโโโโโโโโโโโดโโโโโโโโดโโโโโโโโโโโโโ
Result-Names
โโโโโโโโโโโโโโโณโโโโโโโโโโโโโโ
โ Result-Name โ Min or max? โ
โกโโโโโโโโโโโโโโโโโโโโโโโโโโโโฉ
โ RESULT โ min โ
โโโโโโโโโโโโโโโดโโโโโโโโโโโโโโ
โ Starting generator workers
SOBOL, best RESULT: -36094.2830037869, running 1, waiting for 1 job : 50%|โโโโโโโโโโ| 1/2 [00:47<00:40, 40.57s/it]
2025-08-13 02:11:17 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, Started OmniOpt2 run...
2025-08-13 02:11:17 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, getting new HP set
2025-08-13 02:11:17 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, requested 1 jobs, got 1, 0.12 s/job
2025-08-13 02:11:17 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, eval #1/1 start
2025-08-13 02:11:17 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, starting new job
2025-08-13 02:11:20 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, unknown 1, started new job
2025-08-13 02:11:21 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, pending 1, waiting for 1 job
2025-08-13 02:11:22 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, pending 1, waiting for 1 job
2025-08-13 02:11:22 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, pending 1, waiting for 1 job
2025-08-13 02:11:23 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, pending 1, waiting for 1 job
2025-08-13 02:11:24 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, pending 1, waiting for 1 job
2025-08-13 02:11:24 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, pending 1, waiting for 1 job
2025-08-13 02:11:25 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, pending 1, waiting for 1 job
2025-08-13 02:11:25 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, pending 1, waiting for 1 job
2025-08-13 02:11:26 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, pending 1, waiting for 1 job
2025-08-13 02:11:27 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, pending 1, waiting for 1 job
2025-08-13 02:11:27 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, pending 1, waiting for 1 job
2025-08-13 02:11:28 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, pending 1, waiting for 1 job
2025-08-13 02:11:28 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, pending 1, waiting for 1 job
2025-08-13 02:11:31 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, pending 1, waiting for 1 job
2025-08-13 02:11:31 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, pending 1, waiting for 1 job
2025-08-13 02:11:32 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, pending 1, waiting for 1 job
2025-08-13 02:11:32 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, pending 1, waiting for 1 job
2025-08-13 02:11:33 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, pending 1, waiting for 1 job
2025-08-13 02:11:34 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, pending 1, waiting for 1 job
2025-08-13 02:11:34 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, pending 1, waiting for 1 job
2025-08-13 02:11:35 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, pending 1, waiting for 1 job
2025-08-13 02:11:35 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, pending 1, waiting for 1 job
2025-08-13 02:11:36 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, pending 1, waiting for 1 job
2025-08-13 02:11:36 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, pending 1, waiting for 1 job
2025-08-13 02:11:37 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, pending 1, waiting for 1 job
2025-08-13 02:11:38 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, pending 1, waiting for 1 job
2025-08-13 02:11:38 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, pending 1, waiting for 1 job
2025-08-13 02:11:39 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, pending 1, waiting for 1 job
2025-08-13 02:11:41 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, pending 1, waiting for 1 job
2025-08-13 02:11:42 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, pending 1, waiting for 1 job
2025-08-13 02:11:43 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, pending 1, waiting for 1 job
2025-08-13 02:11:44 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, pending 1, waiting for 1 job
2025-08-13 02:11:45 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, pending 1, waiting for 1 job
2025-08-13 02:11:46 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, running 1, waiting for 1 job
2025-08-13 02:11:47 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, running 1, waiting for 1 job
2025-08-13 02:11:48 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, running 1, waiting for 1 job
2025-08-13 02:11:48 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, running 1, waiting for 1 job
2025-08-13 02:11:49 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, running 1, waiting for 1 job
2025-08-13 02:11:51 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, running 1, waiting for 1 job
2025-08-13 02:11:51 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, running 1, waiting for 1 job
2025-08-13 02:11:52 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, running 1, waiting for 1 job
2025-08-13 02:11:52 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, running 1, waiting for 1 job
2025-08-13 02:11:53 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, running 1, waiting for 1 job
2025-08-13 02:11:54 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, running 1, waiting for 1 job
2025-08-13 02:11:54 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, running 1, waiting for 1 job
2025-08-13 02:11:55 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, running 1, waiting for 1 job
2025-08-13 02:11:55 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, running 1, waiting for 1 job
2025-08-13 02:11:56 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, running 1, waiting for 1 job
2025-08-13 02:11:56 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, running 1, waiting for 1 job
2025-08-13 02:11:57 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, running 1, waiting for 1 job
2025-08-13 02:11:58 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, running 1, new result: -36094.2830037869
2025-08-13 02:11:58 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, best RESULT: -36094.2830037869, waiting for 1 job, finished 1 job
2025-08-13 02:11:59 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, best RESULT: -36094.2830037869, getting new HP set
2025-08-13 02:11:59 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, best RESULT: -36094.2830037869, requested 1 jobs, got 1, 0.83 s/job
2025-08-13 02:11:59 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, best RESULT: -36094.2830037869, eval #1/1 start
2025-08-13 02:11:59 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, best RESULT: -36094.2830037869, starting new job
2025-08-13 02:11:59 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, best RESULT: -36094.2830037869, unknown 1, started new job
2025-08-13 02:12:02 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, best RESULT: -36094.2830037869, pending 1, waiting for 1 job
2025-08-13 02:12:02 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, best RESULT: -36094.2830037869, pending 1, waiting for 1 job
2025-08-13 02:12:03 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, best RESULT: -36094.2830037869, pending 1, waiting for 1 job
2025-08-13 02:12:04 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, best RESULT: -36094.2830037869, pending 1, waiting for 1 job
2025-08-13 02:12:04 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, best RESULT: -36094.2830037869, pending 1, waiting for 1 job
2025-08-13 02:12:05 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, best RESULT: -36094.2830037869, running 1, waiting for 1 job
2025-08-13 02:12:05 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, best RESULT: -36094.2830037869, running 1, waiting for 1 job
2025-08-13 02:12:06 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, best RESULT: -36094.2830037869, running 1, waiting for 1 job
2025-08-13 02:12:07 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, best RESULT: -36094.2830037869, running 1, waiting for 1 job
2025-08-13 02:12:07 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, best RESULT: -36094.2830037869, running 1, waiting for 1 job
2025-08-13 02:12:08 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, best RESULT: -36094.2830037869, running 1, waiting for 1 job
2025-08-13 02:12:08 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, best RESULT: -36094.2830037869, running 1, waiting for 1 job
2025-08-13 02:12:09 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, best RESULT: -36094.2830037869, running 1, waiting for 1 job
2025-08-13 02:12:11 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, best RESULT: -36094.2830037869, running 1, waiting for 1 job
2025-08-13 02:12:12 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, best RESULT: -36094.2830037869, running 1, waiting for 1 job
2025-08-13 02:12:12 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, best RESULT: -36094.2830037869, running 1, waiting for 1 job
2025-08-13 02:12:13 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, best RESULT: -36094.2830037869, running 1, waiting for 1 job
2025-08-13 02:12:14 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, best RESULT: -36094.2830037869, running 1, waiting for 1 job
2025-08-13 02:12:14 (83d01d84-0263-4272-891e-9f47d738ca5b): SOBOL, best RESULT: -36094.2830037869, running 1, waiting for 1 job
timestamp,ram_usage_mb,cpu_usage_percent
1755043877,763.56640625,16.6
1755043877,763.71484375,20.0
1755043877,763.71484375,14.6