⚠ Job 2119696 (task: 0) with path /home/h8/s3811141/test/randomtest_93382/OmniOpt/runs/multi_results_2_results_UNIFORM/1/single_runs/2119696/2119696_0_result.pkl
has not produced any output (state: NODE_FAIL)
No output/error stream produced ! Check: /home/h8/s3811141/test/randomtest_93382/OmniOpt/runs/multi_results_2_results_UNIFORM/1/single_runs/2119696/2119696_0_log.out
⚠ Job 2119695 (task: 0) with path /home/h8/s3811141/test/randomtest_93382/OmniOpt/runs/multi_results_2_results_UNIFORM/1/single_runs/2119695/2119695_0_result.pkl
has not produced any output (state: NODE_FAIL)
No output/error stream produced ! Check: /home/h8/s3811141/test/randomtest_93382/OmniOpt/runs/multi_results_2_results_UNIFORM/1/single_runs/2119695/2119695_0_log.out
get_program_code_from_out_file: /home/h8/s3811141/test/randomtest_93382/OmniOpt/runs/multi_results_2_results_UNIFORM/1/single_runs/2119695/2119695_0_log.out not found
get_program_code_from_out_file: /home/h8/s3811141/test/randomtest_93382/OmniOpt/runs/multi_results_2_results_UNIFORM/1/single_runs/2119696/2119696_0_log.out not found
get_program_code_from_out_file: /home/h8/s3811141/test/randomtest_93382/OmniOpt/runs/multi_results_2_results_UNIFORM/1/single_runs/2119695/2119695_0_log.err not found
get_program_code_from_out_file: /home/h8/s3811141/test/randomtest_93382/OmniOpt/runs/multi_results_2_results_UNIFORM/1/single_runs/2119696/2119696_0_log.err not found
========================================================================
To cancel, press CTRLc, then run 'scancel 2119692'
⠋Importing logging...⠋Importing warnings...⠋Importing argparse...⠋Importing datetime...⠋Importing dataclass...⠋Importing socket...⠋Importing stat...⠋Importing pwd...⠋Importing base64...⠋Importing json...⠋Importing yaml...⠋Importing toml...⠋Importing csv...⠋Importing ast...⠋Importing rich.table...⠋Importing rich print...⠋Importing rich.pretty...⠋Importing pformat...⠋Importing rich.prompt...⠋Importing types.FunctionType...⠋Importing typing...⠋Importing ThreadPoolExecutor...⠋Importing submitit.LocalExecutor...⠋Importing submitit.Job...⠋Importing importlib.util...⠋Importing platform...⠋Importing inspect frame info...⠋Importing pathlib.Path...⠋Importing uuid...⠋Importing cowsay...⠋Importing shutil...⠋Importing itertools.combinations...⠋Importing os.listdir...⠋Importing os.path...⠋Importing PIL.Image...⠋Importing sixel...⠋Importing subprocess...⠋Importing tqdm...⠋Importing beartype...
[WARNING 12-29 13:58:58] ax.service.utils.with_db_settings_base: Ax currently requires a sqlalchemy version below 2.0. This will be addressed in a future release. Disabling SQL storage in Ax for now, if you would like to use SQL storage please install Ax with mysql extras via `pip install ax-platform[mysql]`.
⠼Importing rendering stuff...⠋Importing statistics...⠋Trying to import pyfiglet...⠙Importing helpers...⠋Importing pareto...⠋Parsing arguments...⠋Importing torch...⠋Importing numpy...⠋Importing ax...⠋Importing ax.core.generator_run...⠋Importing Cont_X_trans and Y_trans from ax.adapter.registry...⠋Importing ax.core.arm...⠋Importing ax.core.objective...⠋Importing ax.core.Metric...⠋Importing ax.exceptions.core...⠋Importing ax.exceptions.generation_strategy...⠋Importing CORE_DECODER_REGISTRY...⠋Trying ax.generation_strategy.generation_node...⠋Importing GenerationStep, GenerationStrategy from generation_strategy...⠋Importing GenerationNode from generation_node...⠋Importing ExternalGenerationNode...⠋Importing MinTrials...⠋Importing GeneratorSpec...⠋Importing Generators from ax.generation_strategy.registry...⠋Importing get_pending_observation_features...⠋Importing load_experiment...⠋Importing save_experiment...⠋Importing save_experiment_to_db...⠋Importing TrialStatus...⠋Importing Data...⠋Importing Experiment...⠋Importing parameter types...⠋Importing TParameterization...⠋Importing pandas...⠋Importing AxClient and ObjectiveProperties...⠋Importing RandomForestRegressor...⠋Importing botorch...⠋Importing submitit...⠋Importing ax logger...⠋Importing SQL-Storage-Stuff...Using old run's --time: 60Using old run's --gpus: 1Using old run's --max_eval: 2
Run-UUID: 2c8569ba-c05d-4c2d-a8ee-a581950a5b12
___________________________________
| OmniOpt2 - Turning dials like a DJ! |
===================================
\
\
\
.--.
|o_o |
|:_/ |
// \ \
(| | )
/'\_ _/`\
\___)=(___/
⠋Writing worker creation log...
omniopt --continue runs/multi_results_2_results_UNIFORM/0 --live_share --mem_gb=4 --live_share
⠋Disabling logging...⠋Setting run folder...⠋Creating folder /home/h8/s3811141/test/randomtest_93382/OmniOpt/runs/multi_results_2_results_UNIFORM/1...⠋Writing revert_to_random_when_seemingly_exhausted file ...⠋Writing username state file...⠋Writing result names file...⠋Writing result min/max file...⠋Saving state files...Run-folder: /home/h8/s3811141/test/randomtest_93382/OmniOpt/runs/multi_results_2_results_UNIFORM/1
Continuation from runs/multi_results_2_results_UNIFORM/0
⠋Writing live_share file if it is present...⠋Writing job_start_time file...⠼Writing git information⠋Checking max_eval...You have less --max_eval 2 than --num_random_steps 20. Switched both.Warning: --num_random_steps 2 is smaller than --num_parallel_jobs 20. It's recommended that --num_parallel_jobs is the same as or a multiple of --num_random_steps⠋Calculating number of steps...⠋Adding excluded nodes...⠋Initializing ax_client...⠋Setting orchestrator...See https://imageseg.scads.de/omniax/share?user_id=s3811141&experiment_name=multi_results_2_results_UNIFORM&run_nr=7 for live-results.You have 1 CPUs available for the main process.Using CUDA device NVIDIA H100.Generation strategy: UNIFORM for 4 steps.
Run-Program: ./.tests/optimization_example --int_param='%(int_param)' --float_param='%(float_param)' --choice_param='%(choice_param)' --int_param_two='%(int_param_two)' --nr_results=2
Experiment parameters
┏━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━┳━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━┳━━━━━━━━━━━━┓
┃Name ┃Type ┃Lower bound┃Upper bound┃Values ┃Type ┃Log Scale?┃
┡━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━╇━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━╇━━━━━━━━━━━━┩
│int_param │rangeparameter │-100 │10 ││int │No │
│float_param │rangeparameter │-100 │10 ││float│No │
│choice_param │choiceparameter│││1, 2, 4, 8, 16, hallo│││
│int_param_two│rangeparameter │-100 │10 ││int │No │
└───────────────┴─────────────────┴─────────────┴─────────────┴───────────────────────┴───────┴────────────┘
Result-Names
┏━━━━━━━━━━━━━┳━━━━━━━━━━━━━┓
┃Result-Name┃Min or max?┃
┡━━━━━━━━━━━━━╇━━━━━━━━━━━━━┩
│RESULT1 │ min│
│RESULT2 │ min│
└─────────────┴─────────────┘
⠋Write files and show overview
UNIFORM, running 2∑2 (10%/20), waiting for 2 jobs : 50%|█████░░░░░| 2/4 [00:14<00:14, 7.07s/it]
⚠ Job 2119695 (task: 0) with path /home/h8/s3811141/test/randomtest_93382/OmniOpt/runs/multi_results_2_results_UNIFORM/1/single_runs/2119695/2119695_0_result.pkl
has not produced any output (state: NODE_FAIL)
No output/error stream produced ! Check: /home/h8/s3811141/test/randomtest_93382/OmniOpt/runs/multi_results_2_results_UNIFORM/1/single_runs/2119695/2119695_0_log.out
⚠ Job 2119696 (task: 0) with path /home/h8/s3811141/test/randomtest_93382/OmniOpt/runs/multi_results_2_results_UNIFORM/1/single_runs/2119696/2119696_0_result.pkl
has not produced any output (state: NODE_FAIL)
No output/error stream produced ! Check: /home/h8/s3811141/test/randomtest_93382/OmniOpt/runs/multi_results_2_results_UNIFORM/1/single_runs/2119696/2119696_0_log.out
UNIFORM, node_fail 2∑2 (10%/20), job_failed : 50%|█████░░░░░| 2/4 [03:02<03:02, 91.47s/it]
get_program_code_from_out_file: /home/h8/s3811141/test/randomtest_93382/OmniOpt/runs/multi_results_2_results_UNIFORM/1/single_runs/2119695/2119695_0_log.out not found
get_program_code_from_out_file: /home/h8/s3811141/test/randomtest_93382/OmniOpt/runs/multi_results_2_results_UNIFORM/1/single_runs/2119696/2119696_0_log.out not found
get_program_code_from_out_file: /home/h8/s3811141/test/randomtest_93382/OmniOpt/runs/multi_results_2_results_UNIFORM/1/single_runs/2119695/2119695_0_log.err not found
get_program_code_from_out_file: /home/h8/s3811141/test/randomtest_93382/OmniOpt/runs/multi_results_2_results_UNIFORM/1/single_runs/2119696/2119696_0_log.err not found
UNIFORM, failed: 2, 4 done, waiting for 1 job, finished 1 job : 100%|██████████| 4/4 [03:54<00:00, 58.67s/it]
Pareto-Front for RESULT1/RESULT2:
┏━━━━━━━━━━━━━┳━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━┓
┃trial_index┃int_param┃ float_param ┃int_param_two┃choice_param┃ RESULT1 ┃ RESULT2 ┃
┡━━━━━━━━━━━━━╇━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━┩
│ 0 │ -99 │-30.91522455215454 │ -69 │ 4 │1.1146229164│2.7491889741│
├─────────────┼───────────┼─────────────────────┼───────────────┼──────────────┼──────────────┼──────────────┤
│ 1 │ -11 │-26.947778105764016│ -29 │ 4 │1.1317316206│2.2029953989│
├─────────────┼───────────┼─────────────────────┼───────────────┼──────────────┼──────────────┼──────────────┤
│ 4 │ -56 │-24.108539102679458│ -50 │ 4 │1.2913777813│2.1585628303│
└─────────────┴───────────┴─────────────────────┴───────────────┴──────────────┴──────────────┴──────────────┘
Runtime Infos
┏━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━┳━━━━━━━━━━━┳━━━━━━━━━━━━━━┳━━━━━━━━━━━━━┓
┃Number of evaluations┃Min time ┃Max time ┃Average time┃Median time┃
┡━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━╇━━━━━━━━━━━╇━━━━━━━━━━━━━━╇━━━━━━━━━━━━━┩
│ 2 │ 6.00 sec │ 7.00 sec │ 6.50 sec │ 6.50 sec │
└───────────────────────┴───────────┴───────────┴──────────────┴─────────────┘