Current git-hash: c9639b0c4f870bca3a4f5aaabebfd604020ebb5f (version: 8953)
⠋ Importing logging...
⠋ Importing warnings...
⠋ Importing argparse...
⠋ Importing datetime...
⠋ Importing dataclass...
⠋ Importing socket...
⠋ Importing stat...
⠋ Importing pwd...
⠋ Importing base64...
⠋ Importing json...
⠋ Importing yaml...
⠋ Importing toml...
⠋ Importing csv...
⠋ Importing ast...
⠋ Importing rich.table...
⠋ Importing rich print...
⠋ Importing rich.pretty...
⠋ Importing pformat...
⠋ Importing rich.prompt...
⠋ Importing types.FunctionType...
⠋ Importing typing...
⠋ Importing ThreadPoolExecutor...
⠋ Importing submitit.LocalExecutor...
⠋ Importing submitit.Job...
⠋ Importing importlib.util...
⠋ Importing platform...
⠋ Importing inspect frame info...
⠋ Importing pathlib.Path...
⠋ Importing uuid...
⠋ Importing cowsay...
⠋ Importing shutil...
⠋ Importing itertools.combinations...
⠋ Importing os.listdir...
⠋ Importing os.path...
⠋ Importing PIL.Image...
⠋ Importing sixel...
⠋ Importing subprocess...
⠋ Importing tqdm...
⠋ Importing beartype...
⠋ Importing statistics...
⠋ Trying to import pyfiglet...
⠙ Importing helpers...
⠋ Importing pareto...
⠋ Parsing arguments...
⠹ Importing torch...
⠋ Importing numpy...
[WARNING 10-31 16:51:29] ax.service.utils.with_db_settings_base: Ax currently requires a sqlalchemy version below 2.0. This will be addressed in a future release. Disabling SQL storage in Ax for now, if you would like to use SQL storage please install Ax with mysql extras via `pip install ax-platform[mysql]`.
⠦ Importing ax...
⠋ Importing ax.core.generator_run...
⠋ Importing Cont_X_trans and Y_trans from ax.adapter.registry...
⠋ Importing ax.core.arm...
⠋ Importing ax.core.objective...
⠋ Importing ax.core.Metric...
⠋ Importing ax.exceptions.core...
⠋ Importing ax.exceptions.generation_strategy...
⠋ Importing CORE_DECODER_REGISTRY...
⠋ Trying ax.generation_strategy.generation_node...
⠋ Importing GenerationStep, GenerationStrategy from generation_strategy...
⠋ Importing GenerationNode from generation_node...
⠋ Importing ExternalGenerationNode...
⠋ Importing MaxTrials...
⠋ Importing GeneratorSpec...
⠋ Importing Models from ax.generation_strategy.registry...
⠋ Importing get_pending_observation_features...
⠋ Importing load_experiment...
⠋ Importing save_experiment...
⠋ Importing save_experiment_to_db...
⠋ Importing TrialStatus...
⠋ Importing Data...
⠋ Importing Experiment...
⠋ Importing parameter types...
⠋ Importing TParameterization...
⠋ Importing pandas...
⠋ Importing AxClient and ObjectiveProperties...
⠋ Importing RandomForestRegressor...
⠋ Importing botorch...
⠋ Importing submitit...
⠋ Importing ax logger...
⠋ Importing SQL-Storage-Stuff...
Run-UUID: dc46e78b-9b9c-4fbc-840a-c32e090eabed
______ .___ ___. .__ __. __ ______ .______ .___________.___
/ __ \ | \/ | | \ | | | | / __ \ | _ \ | |__ \
| | | | | \ / | | \| | | | | | | | | |_) | `---| |----` ) |
| | | | | |\/| | | . ` | | | | | | | | ___/ | | / /
| `--' | | | | | | |\ | | | | `--' | | | | | / /_
\______/ |__| |__| |__| \__| |__| \______/ | _| |__| |____|
⠋ Writing worker creation log...
./omniopt --live_share --send_anonymized_usage_stats --partition alpha --experiment_name=__main__tests__BOTORCH_MODULAR___nogridsearch --mem_gb=1 --time=60 --worker_timeout=5 --max_eval 4 --num_parallel_jobs 2 --gpus=0 --run_program Li8udGVzdHMvb3B0aW1pemF0aW9uX2V4YW1wbGUgIC0taW50X3BhcmFtPSclKGludF9wYXJhbSknIC0tZmxvYXRfcGFyYW09JyUoZmxvYXRfcGFyYW0pJyAtLWNob2ljZV9wYXJhbT0nJShjaG9pY2VfcGFyYW0pJyAtLWludF9wYXJhbV90d289JyUoaW50X3BhcmFtX3R3byknIC0tbnJfcmVzdWx0cz0x --parameter int_param range -100 10 int --parameter float_param range -100 10 float --parameter choice_param choice 1,2,4,8,16,hallo --parameter int_param_two range -100 10 int --num_random_steps 2 --model BOTORCH_MODULAR --auto_exclude_defective_hosts --generate_all_jobs_at_once --follow --show_generate_time_table
⠋ Disabling logging...
⠋ Setting run folder...
⠋ Creating folder /home/norman/repos/OmniOpt/runs/__main__tests__BOTORCH_MODULAR___nogridsearch/3...
⠋ Writing revert_to_random_when_seemingly_exhausted file ...
⠋ Writing username state file...
⠋ Writing result names file...
⠋ Writing result min/max file...
⠋ Saving state files...
Run-folder: /home/norman/repos/OmniOpt/runs/__main__tests__BOTORCH_MODULAR___nogridsearch/3
⠋ Writing live_share file if it is present...
⠋ Writing job_start_time file...
⠋ Writing git information
⠋ Checking max_eval...
⠋ Calculating number of steps...
⠋ Adding excluded nodes...
File "/home/norman/repos/OmniOpt/.omniopt.py", line 11540, in
main_wrapper()
File "/home/norman/repos/OmniOpt/.omniopt.py", line 11456, in main_wrapper
main()
File "/home/norman/repos/OmniOpt/.omniopt.py", line 10732, in main
set_global_generation_strategy()
File "/home/norman/repos/OmniOpt/.omniopt.py", line 9369, in set_global_generation_strategy
setup_default_generation_strategy()
File "/home/norman/repos/OmniOpt/.omniopt.py", line 9400, in setup_default_generation_strategy
add_sobol_node_if_needed(generation_strategy_nodes, generation_strategy_names, chosen_model)
File "/home/norman/repos/OmniOpt/.omniopt.py", line 9425, in add_sobol_node_if_needed
nodes.append(create_node("SOBOL", random_steps, next_node_name))
File "/home/norman/repos/OmniOpt/.omniopt.py", line 9337, in create_node
res = GenerationNode(
File "/home/norman/.omniax_venvs/Python_3.11.2/x86_64/lib/python3.11/site-packages/ax/generation_strategy/generation_node.py", line 170, in __init__
traceback.print_stack()
File "/home/norman/repos/OmniOpt/.omniopt.py", line 11540, in
main_wrapper()
File "/home/norman/repos/OmniOpt/.omniopt.py", line 11456, in main_wrapper
main()
File "/home/norman/repos/OmniOpt/.omniopt.py", line 10732, in main
set_global_generation_strategy()
File "/home/norman/repos/OmniOpt/.omniopt.py", line 9369, in set_global_generation_strategy
setup_default_generation_strategy()
File "/home/norman/repos/OmniOpt/.omniopt.py", line 9404, in setup_default_generation_strategy
add_main_node_if_needed(generation_strategy_nodes, generation_strategy_names, chosen_model, remaining)
File "/home/norman/repos/OmniOpt/.omniopt.py", line 9431, in add_main_node_if_needed
node = create_node(chosen_model, remaining, None)
File "/home/norman/repos/OmniOpt/.omniopt.py", line 9337, in create_node
res = GenerationNode(
File "/home/norman/.omniax_venvs/Python_3.11.2/x86_64/lib/python3.11/site-packages/ax/generation_strategy/generation_node.py", line 170, in __init__
traceback.print_stack()
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! GENERATION NODE: SHOULD DEDUPLICATE: False
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! GENERATION NODE: SHOULD DEDUPLICATE: False
⠋ Initializing ax_client...
⠋ Setting orchestrator...
This logs the CPU and RAM usage of the main worker process.
timestamp,ram_usage_mb,cpu_usage_percent
1761925889,782.5546875,33.2