ERROR while trying to mark job as failure: Can only mark failed a trial that is currently running.
โ Exception in parallel job handling: Can only mark failed a trial that is currently running.
It seems like the search space was exhausted. You were able to get 0% of the jobs you requested (got: 0, submitted: 1, failed: 0, requested: 1) after main ran
========================================================================
Current git-hash: 3bc86dcb6d9e1e752cf34d003103a8f1015b5b05 (last fully tested stable version 6 commits ago [9043d91dbe370183252bdf120ecb2c226402839d, 8689])
Using coverage run -p because $RUN_WITH_COVERAGE is set
[WARNING 10-21 08:30:29] ax.service.utils.with_db_settings_base: Ax currently requires a sqlalchemy version below 2.0. This will be addressed in a future release. Disabling SQL storage in Ax for now, if you would like to use SQL storage please install Ax with mysql extras via `pip install ax-platform[mysql]`.
Run-UUID: fdf63f91-d01f-4895-95b2-fbb3a0ceb7eb
_____________________________________
| OmniOpt2 - When it clicks, it sticks! |
=====================================
\
\
\
\
. .
/ `. .' \
.---. < > < > .---.
| \ \ - ~ ~ - / / |
_____ ~-..-~ ~-..-~
| | \~~~\.' `./~~~/
--------- \__/ \__/
.' O \ / / \ "
(_____, `._.' | } \/~~~/
`----. / } | / \__/
`-. | / | / `. ,~~|
~-.__| /_ - ~ ^| /- _ `..-' f: f:
| / | / ~-. `-. _|| _||_
|_____| |_____| ~ - . _ _ _ _ __>
omniopt --max_nr_of_zero_results 3 --live_share --send_anonymized_usage_stats --partition=alpha --gpus=0 --experiment_name=test_wronggoing_stuff_nosuccess --mem_gb=1 --time=120 --worker_timeout=1 --max_eval=1 --num_parallel_jobs=10 --run_program=Li8udGVzdHMvdGVzdF93cm9uZ2dvaW5nX3N0dWZmLmJpbi9iaW4vJShwcm9ncmFtKQ== --parameter program choice divide_by_0 --num_random_steps=1 --follow
Run-folder: /home/runner/work/OmniOpt/OmniOpt/runs/test_wronggoing_stuff_nosuccess/0See https://imageseg.scads.de/omniax/share?user_id=runner&experiment_name=test_wronggoing_stuff_nosuccess&run_nr=11 for live-results.You have 4 CPUs available for the main process.No CUDA devices found.Generation strategy: SOBOL for 1 step.
Run-Program: ./.tests/test_wronggoing_stuff.bin/bin/%(program)
Experiment parameters
โโโโโโโโโโโณโโโโโโโโณโโโโโโโโโโโโโโ
โName โType โValues โ
โกโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโฉ
โprogramโfixedโdivide_by_0โ
โโโโโโโโโโโดโโโโโโโโดโโโโโโโโโโโโโโ
Result-Names
โโโโโโโโโโโโโโโณโโโโโโโโโโโโโโ
โResult-NameโMin or max?โ
โกโโโโโโโโโโโโโโโโโโโโโโโโโโโโฉ
โRESULT โ minโ
โโโโโโโโโโโโโโโดโโโโโโโโโโโโโโ
ERROR while trying to mark job as failure: Can only mark failed a trial that is currently running.โ Exception in parallel job handling: Can only mark failed a trial that is currently running.
It seems like the search space was exhausted. You were able to get 0% of the jobs you requested (got: 0, submitted: 1, failed: 0, requested: 1) after main ran Failed Jobs parameters
โโโโโโโโโโณโโโโโโโโโณโโโโโโโโโณโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
โparam1โparam2โparam3โerror_description โ
โกโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโฉ
โvalue1โvalue2โvalue3โSome error occurred during execution (this is not a real error!).โ
โโโโโโโโโโดโโโโโโโโโดโโโโโโโโโดโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
Runtime Infos
โโโโโโโโโโโโโโโโโโโโโโโโโณโโโโโโโโโโโโณโโโโโโโโโโโโณโโโโโโโโโโโโโโโณโโโโโโโโโโโโโโ
โNumber of evaluationsโMin time โMax time โAverage timeโMedian timeโ
โกโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโฉ
โ 1 โ 6.00 sec โ 6.00 sec โ 6.00 sec โ 6.00 sec โ
โโโโโโโโโโโโโโโโโโโโโโโโโดโโโโโโโโโโโโดโโโโโโโโโโโโดโโโโโโโโโโโโโโโดโโโโโโโโโโโโโโ
2025-10-21 08:30:31 (0e3e5568-5567-49a7-b1c5-ecd4a42faac0): SOBOL, Started OmniOpt2 run...
2025-10-21 08:30:31 (0e3e5568-5567-49a7-b1c5-ecd4a42faac0): SOBOL, getting new HP set (no sbatch)
2025-10-21 08:30:31 (0e3e5568-5567-49a7-b1c5-ecd4a42faac0): SOBOL, requested 1 jobs, got 1, 0.03 s/job
2025-10-21 08:30:31 (0e3e5568-5567-49a7-b1c5-ecd4a42faac0): SOBOL, eval #1/1 start
2025-10-21 08:30:31 (0e3e5568-5567-49a7-b1c5-ecd4a42faac0): SOBOL, starting new job
2025-10-21 08:30:31 (0e3e5568-5567-49a7-b1c5-ecd4a42faac0): SOBOL, started new job
2025-10-21 08:30:40 (0e3e5568-5567-49a7-b1c5-ecd4a42faac0): SOBOL, job_failed
2025-10-21 08:30:40 (0e3e5568-5567-49a7-b1c5-ecd4a42faac0): SOBOL, found 1 zero-jobs (max: 3)
2025-10-21 08:30:40 (0e3e5568-5567-49a7-b1c5-ecd4a42faac0): SOBOL, found 2 zero-jobs (max: 3)
2025-10-21 08:30:40 (0e3e5568-5567-49a7-b1c5-ecd4a42faac0): SOBOL, found 3 zero-jobs (max: 3)
2025-10-21 08:30:40 (0e3e5568-5567-49a7-b1c5-ecd4a42faac0): SOBOL, 3 empty jobs (>= 3)
Job submission durations
โโโโโโโโโโโณโโโโโโโโโโณโโโโโโโณโโโโโโโโโโโโโโโ
โ Batch โ Seconds โ Jobs โ Time per job โ
โกโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโฉ
โ 1 โ 0.215 โ 1 โ 0.215 โ
โโโโโโโโโโโผโโโโโโโโโโผโโโโโโโผโโโโโโโโโโโโโโโค
โ Average โ 0.215 โ โ โ
โ Median โ 0.215 โ โ โ
โ Total โ 0.215 โ โ โ
โ Max โ 0.215 โ โ โ
โ Min โ 0.215 โ โ โ
โโโโโโโโโโโดโโโโโโโโโโดโโโโโโโดโโโโโโโโโโโโโโโ
Model generation times
โโโโโโโโโโโโโณโโโโโโโโโโณโโโโโโโณโโโโโโโโโโโโโโโ
โ Iteration โ Seconds โ Jobs โ Time per job โ
โกโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโฉ
โ 1 โ 0.031 โ 1 โ 0.031 โ
โโโโโโโโโโโโโผโโโโโโโโโโผโโโโโโโผโโโโโโโโโโโโโโโค
โ Average โ 0.031 โ โ โ
โ Median โ 0.031 โ โ โ
โ Total โ 0.031 โ โ โ
โ Max โ 0.031 โ โ โ
โ Min โ 0.031 โ โ โ
โโโโโโโโโโโโโดโโโโโโโโโโดโโโโโโโดโโโโโโโโโโโโโโโ
/home/runner/.omniax_venvs/Python_3.12.3/x86_64/lib/python3.12/site-packages/submitit/core/plugins.py:24: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
import pkg_resources
submitit INFO (2025-10-21 08:30:32,091) - Starting with JobEnvironment(job_id=118535, hostname=runnervmwhb2z, local_rank=0(1), node=0(1), global_rank=0(1))
submitit INFO (2025-10-21 08:30:32,091) - Loading pickle: /home/runner/work/OmniOpt/OmniOpt/runs/test_wronggoing_stuff_nosuccess/0/single_runs/118535/118535_submitted.pkl
Trial-Index: 0
Illegal division by zero at ./.tests/test_wronggoing_stuff.bin/bin/divide_by_0 line 3.
Parameters: {"program": "divide_by_0"}
Debug-Infos:
========
DEBUG INFOS START:
Program-Code: ./.tests/test_wronggoing_stuff.bin/bin/divide_by_0
pwd: /home/runner/work/OmniOpt/OmniOpt
File: ./.tests/test_wronggoing_stuff.bin/bin/divide_by_0
UID: 1001
GID: 1001
Status-Change-Time: 1761033844.392661
Size: 24 Bytes
Permissions: -rwxr-xr-x
Owner: runner
Last access: 1761035433.6499379
Last modification: 1761033844.392661
Hostname: runnervmwhb2z
========
DEBUG INFOS END
./.tests/test_wronggoing_stuff.bin/bin/divide_by_0
stdout was empty
stderr:
Illegal division by zero at ./.tests/test_wronggoing_stuff.bin/bin/divide_by_0 line 3.
Result: {'RESULT': None}
Final-results: {'RESULT': None}
EXIT_CODE: 255
submitit INFO (2025-10-21 08:30:39,666) - Job completed successfully
submitit INFO (2025-10-21 08:30:39,666) - Exiting after successful completion