ERROR while trying to mark job as failure: Can only mark failed a trial that is currently running.
โ Exception in parallel job handling: Can only mark failed a trial that is currently running.
ERROR while trying to mark job as failure: Can only mark failed a trial that is currently running.
โ Exception in parallel job handling: Can only mark failed a trial that is currently running.
ERROR while trying to mark job as failure: Can only mark failed a trial that is currently running.
โ Exception in parallel job handling: Can only mark failed a trial that is currently running.
It seems like the search space was exhausted. You were able to get 4% of the jobs you requested (got: 1, submitted: 4, failed: 0, requested: 23) after main ran
========================================================================
Current git-hash: 66ac2725ecc1eb717e503e919d1181624d20068b (last fully tested stable version 7 commits ago [9043d91dbe370183252bdf120ecb2c226402839d, 8689])
Using coverage run -p because $RUN_WITH_COVERAGE is set
[WARNING 10-21 08:30:16] ax.service.utils.with_db_settings_base: Ax currently requires a sqlalchemy version below 2.0. This will be addressed in a future release. Disabling SQL storage in Ax for now, if you would like to use SQL storage please install Ax with mysql extras via `pip install ax-platform[mysql]`.
Run-UUID: ce057487-7111-48de-ab09-56484d4a53e4
_____ _____ __ ___
/\ __`\ __/\ __`\ /\ \__ /'___`\
\ \ \/\ \ ___ ___ ___ /\_\ \ \/\ \ _____\ \ ,_\/\_\ /\ \
\ \ \ \ \ /' __` __`\ /' _ `\/\ \ \ \ \ \/\ '__`\ \ \/\/_/// /__
\ \ \_\ \/\ \/\ \/\ \/\ \/\ \ \ \ \ \_\ \ \ \L\ \ \ \_ // /_\ \
\ \_____\ \_\ \_\ \_\ \_\ \_\ \_\ \_____\ \ ,__/\ \__\/\______/
\/_____/\/_/\/_/\/_/\/_/\/_/\/_/\/_____/\ \ \/ \/__/\/_____/
\ \_\
\/_/
omniopt --max_nr_of_zero_results 3 --live_share --send_anonymized_usage_stats --partition=alpha --gpus=0 --experiment_name=test_wronggoing_stuff --mem_gb=1 --time=120 --worker_timeout=1 --max_eval=23 --num_parallel_jobs=10 --run_program=Li8udGVzdHMvdGVzdF93cm9uZ2dvaW5nX3N0dWZmLmJpbi9iaW4vJShwcm9ncmFtKQ== --parameter program choice divide_by_0,simple_ok,perl,exit_code_137,result_but_exit_code_stdout_stderr,exit_code_stdout,signal_but_has_output,exit_code_no_output,exit_code_stdout_stderr,module_not_found,signal,empty,file_does_not_exist,sleep_10_and_result_exit_252,no_chmod_x,no_shebang,perl_module_fail,segfault,wrong_arch,python_name_error,syntax_error,tensorflow_syntax_error,force_keyboard_interrupt --num_random_steps=1 --follow
Run-folder: /home/runner/work/OmniOpt/OmniOpt/runs/test_wronggoing_stuff/0See https://imageseg.scads.de/omniax/share?user_id=runner&experiment_name=test_wronggoing_stuff&run_nr=12 for live-results.You have 4 CPUs available for the main process.No CUDA devices found.Generation strategy: SOBOL for 1 step and then BOTORCH_MODULAR for 22 steps.
Run-Program: ./.tests/test_wronggoing_stuff.bin/bin/%(program)
Experiment parameters
โโโโโโโโโโโณโโโโโโโโโณโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
โName โType โValues โ
โกโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโฉ
โprogramโchoiceโdivide_by_0, simple_ok, perl, exit_code_137, result_but_exit_code_stdout_stderr, exit_code_stdout, signal_but_has_output, exit_code_no_output, exit_code_stdout_stderr, โ
โโโmodule_not_found, signal, empty, file_does_not_exist, sleep_10_and_result_exit_252, no_chmod_x, no_shebang, perl_module_fail, segfault, wrong_arch, python_name_error, โ
โโโsyntax_error, tensorflow_syntax_error, force_keyboard_interrupt โ
โโโโโโโโโโโดโโโโโโโโโดโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
Result-Names
โโโโโโโโโโโโโโโณโโโโโโโโโโโโโโ
โResult-NameโMin or max?โ
โกโโโโโโโโโโโโโโโโโโโโโโโโโโโโฉ
โRESULT โ minโ
โโโโโโโโโโโโโโโดโโโโโโโโโโโโโโ
ERROR while trying to mark job as failure: Can only mark failed a trial that is currently running.โ Exception in parallel job handling: Can only mark failed a trial that is currently running.
ERROR while trying to mark job as failure: Can only mark failed a trial that is currently running.โ Exception in parallel job handling: Can only mark failed a trial that is currently running.
ERROR while trying to mark job as failure: Can only mark failed a trial that is currently running.โ Exception in parallel job handling: Can only mark failed a trial that is currently running.
It seems like the search space was exhausted. You were able to get 4% of the jobs you requested (got: 1, submitted: 4, failed: 0, requested: 23) after main ran Failed Jobs parameters
โโโโโโโโโโณโโโโโโโโโณโโโโโโโโโณโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
โparam1โparam2โparam3โerror_description โ
โกโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโฉ
โvalue1โvalue2โvalue3โSome error occurred during execution (this is not a real error!).โ
โโโโโโโโโโดโโโโโโโโโดโโโโโโโโโดโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
Best RESULT, min (total: 1)
โโโโโโโโโโโโโณโโโโโโโโโ
โprogram โRESULTโ
โกโโโโโโโโโโโโโโโโโโโโโฉ
โsimple_okโ8956.0โ
โโโโโโโโโโโโโดโโโโโโโโโ
Not printing sixel graphics in CI
Runtime Infos
โโโโโโโโโโโโโโโโโโโโโโโโโณโโโโโโโโโโโโณโโโโโโโโโโโโณโโโโโโโโโโโโโโโณโโโโโโโโโโโโโโ
โNumber of evaluationsโMin time โMax time โAverage timeโMedian timeโ
โกโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโฉ
โ 4 โ 6.00 sec โ 6.00 sec โ 6.00 sec โ 6.00 sec โ
โโโโโโโโโโโโโโโโโโโโโโโโโดโโโโโโโโโโโโดโโโโโโโโโโโโดโโโโโโโโโโโโโโโดโโโโโโโโโโโโโโ
2025-10-21 08:30:18 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, Started OmniOpt2 run...
2025-10-21 08:30:18 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, getting new HP set (no sbatch)
2025-10-21 08:30:18 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, requested 1 jobs, got 1, 0.05 s/job
2025-10-21 08:30:18 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, eval #1/1 start
2025-10-21 08:30:18 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, starting new job
2025-10-21 08:30:18 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, started new job
2025-10-21 08:30:27 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, job_failed
2025-10-21 08:30:27 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, getting new HP set (no sbatch)
2025-10-21 08:30:27 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, requested 1 jobs, got 1, 0.04 s/job
2025-10-21 08:30:27 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, eval #1/1 start
2025-10-21 08:30:27 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, starting new job
2025-10-21 08:30:27 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, started new job
2025-10-21 08:30:36 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, job_failed
2025-10-21 08:30:36 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, getting new HP set (no sbatch)
2025-10-21 08:30:36 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, requested 1 jobs, got 1, 0.04 s/job
2025-10-21 08:30:36 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, eval #1/1 start
2025-10-21 08:30:36 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, starting new job
2025-10-21 08:30:36 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, started new job
2025-10-21 08:30:45 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, new result: 8956.0
2025-10-21 08:30:47 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, finishing jobs, finished 1 job
2025-10-21 08:30:47 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, getting new HP set (no sbatch)
2025-10-21 08:30:47 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, requested 1 jobs, got 1, 0.39 s/job
2025-10-21 08:30:47 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, eval #1/1 start
2025-10-21 08:30:47 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, starting new job
2025-10-21 08:30:47 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, started new job
2025-10-21 08:30:56 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, job_failed
2025-10-21 08:30:57 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, getting new HP set (no sbatch)
2025-10-21 08:30:57 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, getting new HP set (no sbatch)
2025-10-21 08:30:57 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, getting new HP set (no sbatch)
2025-10-21 08:30:58 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, getting new HP set (no sbatch)
2025-10-21 08:30:58 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, getting new HP set (no sbatch)
2025-10-21 08:30:58 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, getting new HP set (no sbatch)
2025-10-21 08:30:58 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, getting new HP set (no sbatch)
2025-10-21 08:30:59 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, getting new HP set (no sbatch)
2025-10-21 08:30:59 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, getting new HP set (no sbatch)
2025-10-21 08:30:59 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, getting new HP set (no sbatch)
2025-10-21 08:31:00 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, getting new HP set (no sbatch)
2025-10-21 08:31:00 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, getting new HP set (no sbatch)
2025-10-21 08:31:00 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, getting new HP set (no sbatch)
2025-10-21 08:31:01 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, getting new HP set (no sbatch)
2025-10-21 08:31:01 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, getting new HP set (no sbatch)
2025-10-21 08:31:01 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, getting new HP set (no sbatch)
2025-10-21 08:31:02 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, getting new HP set (no sbatch)
2025-10-21 08:31:02 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, getting new HP set (no sbatch)
2025-10-21 08:31:02 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, getting new HP set (no sbatch)
2025-10-21 08:31:02 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, getting new HP set (no sbatch)
2025-10-21 08:31:02 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, requested 1 jobs, got 0, n/a
2025-10-21 08:31:02 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, found 1 zero-jobs (max: 3)
2025-10-21 08:31:03 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, getting new HP set (no sbatch)
2025-10-21 08:31:03 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, getting new HP set (no sbatch)
2025-10-21 08:31:03 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, getting new HP set (no sbatch)
2025-10-21 08:31:04 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, getting new HP set (no sbatch)
2025-10-21 08:31:04 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, getting new HP set (no sbatch)
2025-10-21 08:31:04 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, getting new HP set (no sbatch)
2025-10-21 08:31:04 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, getting new HP set (no sbatch)
2025-10-21 08:31:05 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, getting new HP set (no sbatch)
2025-10-21 08:31:05 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, getting new HP set (no sbatch)
2025-10-21 08:31:05 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, getting new HP set (no sbatch)
2025-10-21 08:31:06 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, getting new HP set (no sbatch)
2025-10-21 08:31:06 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, getting new HP set (no sbatch)
2025-10-21 08:31:06 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, getting new HP set (no sbatch)
2025-10-21 08:31:06 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, getting new HP set (no sbatch)
2025-10-21 08:31:07 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, getting new HP set (no sbatch)
2025-10-21 08:31:07 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, getting new HP set (no sbatch)
2025-10-21 08:31:07 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, getting new HP set (no sbatch)
2025-10-21 08:31:08 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, getting new HP set (no sbatch)
2025-10-21 08:31:08 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, getting new HP set (no sbatch)
2025-10-21 08:31:08 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, getting new HP set (no sbatch)
2025-10-21 08:31:08 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, requested 1 jobs, got 0, n/a
2025-10-21 08:31:08 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, found 2 zero-jobs (max: 3)
2025-10-21 08:31:08 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, getting new HP set (no sbatch)
2025-10-21 08:31:09 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, getting new HP set (no sbatch)
2025-10-21 08:31:09 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, getting new HP set (no sbatch)
2025-10-21 08:31:09 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, getting new HP set (no sbatch)
2025-10-21 08:31:10 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, getting new HP set (no sbatch)
2025-10-21 08:31:10 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, getting new HP set (no sbatch)
2025-10-21 08:31:10 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, getting new HP set (no sbatch)
2025-10-21 08:31:10 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, getting new HP set (no sbatch)
2025-10-21 08:31:11 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, getting new HP set (no sbatch)
2025-10-21 08:31:11 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, getting new HP set (no sbatch)
2025-10-21 08:31:11 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, getting new HP set (no sbatch)
2025-10-21 08:31:12 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, getting new HP set (no sbatch)
2025-10-21 08:31:12 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, getting new HP set (no sbatch)
2025-10-21 08:31:12 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, getting new HP set (no sbatch)
2025-10-21 08:31:12 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, getting new HP set (no sbatch)
2025-10-21 08:31:13 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, getting new HP set (no sbatch)
2025-10-21 08:31:13 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, getting new HP set (no sbatch)
2025-10-21 08:31:13 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, getting new HP set (no sbatch)
2025-10-21 08:31:14 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, getting new HP set (no sbatch)
2025-10-21 08:31:14 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, getting new HP set (no sbatch)
2025-10-21 08:31:14 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, requested 1 jobs, got 0, n/a
2025-10-21 08:31:14 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, found 3 zero-jobs (max: 3)
2025-10-21 08:31:14 (1d0213b3-ef1b-49d7-a292-8d884257830b): SOBOL, best RESULT: 8956, 3 empty jobs (>= 3)