ERROR while trying to mark job as failure: Can only mark failed a trial that is currently running.
โ Exception in parallel job handling: Can only mark failed a trial that is currently running.
It seems like the search space was exhausted. You were able to get 0% of the jobs you requested (got: 0, submitted: 1, failed: 0, requested: 1) after main ran
========================================================================
Current git-hash: 66ac2725ecc1eb717e503e919d1181624d20068b (last fully tested stable version 7 commits ago [9043d91dbe370183252bdf120ecb2c226402839d, 8689])
Using coverage run -p because $RUN_WITH_COVERAGE is set
[WARNING 10-21 08:31:30] ax.service.utils.with_db_settings_base: Ax currently requires a sqlalchemy version below 2.0. This will be addressed in a future release. Disabling SQL storage in Ax for now, if you would like to use SQL storage please install Ax with mysql extras via `pip install ax-platform[mysql]`.
Run-UUID: 56e48918-3da3-472e-a1e2-c59afd198b57
_________________________________
| OmniOpt2 - Tuning up for success! |
=================================
\
\
\
\
.-=-==--==--.
..-==" ,'o`) `.
,' `"' \
: ( `.__...._
| ) / `-=-.
: ,vv.-._ / / `---==-._
\/\/\/VV ^ d88`;' / `.
`` ^/d88P!' / , `._
^/ !' ,. , / "-,,__,,--'""""-.
^/ !' ,' \ . .( ( _ ) ) ) ) ))_,-.\
^(__ ,!',"' ;:+.:%:a. \:.. . ,' ) ) ) ) ,"' '
',,,'',' /o:::":%:%a. \:.:.: . ) ) _,'
"""' ;':::'' `+%%%a._ \%:%| ;.). _,-""
,-='_.-' ``:%::) )%:| /:._,"
(/(/" ," ,'_,'%%%: (_,'
( (//(`.___; \
\ \ ` `
`. `. `. :
\. . .\ : . . . :
\. . .: `.. . .:
`..:.:\ \:...\
;:.:.; ::...:
):%:: :::::;
__,::%:( :::::
,;:%%%%%%%: ;:%::
;,--""-.`\ ,=--':%:%:\
/" "| /-".:%%%%%%%\
;,-"'`)%%)
/" "|
omniopt --max_nr_of_zero_results 3 --live_share --send_anonymized_usage_stats --partition=alpha --gpus=0 --experiment_name=test_wronggoing_stuff_nosuccess --mem_gb=1 --time=120 --worker_timeout=1 --max_eval=1 --num_parallel_jobs=10 --run_program=Li8udGVzdHMvdGVzdF93cm9uZ2dvaW5nX3N0dWZmLmJpbi9iaW4vJShwcm9ncmFtKQ== --parameter program choice divide_by_0 --num_random_steps=1 --follow
Run-folder: /home/runner/work/OmniOpt/OmniOpt/runs/test_wronggoing_stuff_nosuccess/0See https://imageseg.scads.de/omniax/share?user_id=runner&experiment_name=test_wronggoing_stuff_nosuccess&run_nr=12 for live-results.You have 4 CPUs available for the main process.No CUDA devices found.Generation strategy: SOBOL for 1 step.
Run-Program: ./.tests/test_wronggoing_stuff.bin/bin/%(program)
Experiment parameters
โโโโโโโโโโโณโโโโโโโโณโโโโโโโโโโโโโโ
โName โType โValues โ
โกโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโฉ
โprogramโfixedโdivide_by_0โ
โโโโโโโโโโโดโโโโโโโโดโโโโโโโโโโโโโโ
Result-Names
โโโโโโโโโโโโโโโณโโโโโโโโโโโโโโ
โResult-NameโMin or max?โ
โกโโโโโโโโโโโโโโโโโโโโโโโโโโโโฉ
โRESULT โ minโ
โโโโโโโโโโโโโโโดโโโโโโโโโโโโโโ
ERROR while trying to mark job as failure: Can only mark failed a trial that is currently running.โ Exception in parallel job handling: Can only mark failed a trial that is currently running.
It seems like the search space was exhausted. You were able to get 0% of the jobs you requested (got: 0, submitted: 1, failed: 0, requested: 1) after main ran Failed Jobs parameters
โโโโโโโโโโณโโโโโโโโโณโโโโโโโโโณโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
โparam1โparam2โparam3โerror_description โ
โกโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโฉ
โvalue1โvalue2โvalue3โSome error occurred during execution (this is not a real error!).โ
โโโโโโโโโโดโโโโโโโโโดโโโโโโโโโดโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
Runtime Infos
โโโโโโโโโโโโโโโโโโโโโโโโโณโโโโโโโโโโโโณโโโโโโโโโโโโณโโโโโโโโโโโโโโโณโโโโโโโโโโโโโโ
โNumber of evaluationsโMin time โMax time โAverage timeโMedian timeโ
โกโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโฉ
โ 1 โ 6.00 sec โ 6.00 sec โ 6.00 sec โ 6.00 sec โ
โโโโโโโโโโโโโโโโโโโโโโโโโดโโโโโโโโโโโโดโโโโโโโโโโโโดโโโโโโโโโโโโโโโดโโโโโโโโโโโโโโ
2025-10-21 08:31:32 (7fbe231e-5a2c-4eef-b233-908a1a478acc): SOBOL, Started OmniOpt2 run...
2025-10-21 08:31:32 (7fbe231e-5a2c-4eef-b233-908a1a478acc): SOBOL, getting new HP set (no sbatch)
2025-10-21 08:31:32 (7fbe231e-5a2c-4eef-b233-908a1a478acc): SOBOL, requested 1 jobs, got 1, 0.03 s/job
2025-10-21 08:31:32 (7fbe231e-5a2c-4eef-b233-908a1a478acc): SOBOL, eval #1/1 start
2025-10-21 08:31:32 (7fbe231e-5a2c-4eef-b233-908a1a478acc): SOBOL, starting new job
2025-10-21 08:31:32 (7fbe231e-5a2c-4eef-b233-908a1a478acc): SOBOL, started new job
2025-10-21 08:31:41 (7fbe231e-5a2c-4eef-b233-908a1a478acc): SOBOL, job_failed
2025-10-21 08:31:41 (7fbe231e-5a2c-4eef-b233-908a1a478acc): SOBOL, found 1 zero-jobs (max: 3)
2025-10-21 08:31:41 (7fbe231e-5a2c-4eef-b233-908a1a478acc): SOBOL, found 2 zero-jobs (max: 3)
2025-10-21 08:31:41 (7fbe231e-5a2c-4eef-b233-908a1a478acc): SOBOL, found 3 zero-jobs (max: 3)
2025-10-21 08:31:41 (7fbe231e-5a2c-4eef-b233-908a1a478acc): SOBOL, 3 empty jobs (>= 3)
Job submission durations
โโโโโโโโโโโณโโโโโโโโโโณโโโโโโโณโโโโโโโโโโโโโโโ
โ Batch โ Seconds โ Jobs โ Time per job โ
โกโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโฉ
โ 1 โ 0.218 โ 1 โ 0.218 โ
โโโโโโโโโโโผโโโโโโโโโโผโโโโโโโผโโโโโโโโโโโโโโโค
โ Average โ 0.218 โ โ โ
โ Median โ 0.218 โ โ โ
โ Total โ 0.218 โ โ โ
โ Max โ 0.218 โ โ โ
โ Min โ 0.218 โ โ โ
โโโโโโโโโโโดโโโโโโโโโโดโโโโโโโดโโโโโโโโโโโโโโโ
Model generation times
โโโโโโโโโโโโโณโโโโโโโโโโณโโโโโโโณโโโโโโโโโโโโโโโ
โ Iteration โ Seconds โ Jobs โ Time per job โ
โกโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโฉ
โ 1 โ 0.030 โ 1 โ 0.030 โ
โโโโโโโโโโโโโผโโโโโโโโโโผโโโโโโโผโโโโโโโโโโโโโโโค
โ Average โ 0.030 โ โ โ
โ Median โ 0.030 โ โ โ
โ Total โ 0.030 โ โ โ
โ Max โ 0.030 โ โ โ
โ Min โ 0.030 โ โ โ
โโโโโโโโโโโโโดโโโโโโโโโโดโโโโโโโดโโโโโโโโโโโโโโโ
/home/runner/.omniax_venvs/Python_3.12.3/x86_64/lib/python3.12/site-packages/submitit/core/plugins.py:24: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
import pkg_resources
submitit INFO (2025-10-21 08:31:32,909) - Starting with JobEnvironment(job_id=118514, hostname=runnervmwhb2z, local_rank=0(1), node=0(1), global_rank=0(1))
submitit INFO (2025-10-21 08:31:32,909) - Loading pickle: /home/runner/work/OmniOpt/OmniOpt/runs/test_wronggoing_stuff_nosuccess/0/single_runs/118514/118514_submitted.pkl
Trial-Index: 0
Illegal division by zero at ./.tests/test_wronggoing_stuff.bin/bin/divide_by_0 line 3.
Parameters: {"program": "divide_by_0"}
Debug-Infos:
========
DEBUG INFOS START:
Program-Code: ./.tests/test_wronggoing_stuff.bin/bin/divide_by_0
pwd: /home/runner/work/OmniOpt/OmniOpt
File: ./.tests/test_wronggoing_stuff.bin/bin/divide_by_0
UID: 1001
GID: 1001
Status-Change-Time: 1761033927.689677
Size: 24 Bytes
Permissions: -rwxr-xr-x
Owner: runner
Last access: 1761035494.5043194
Last modification: 1761033927.689677
Hostname: runnervmwhb2z
========
DEBUG INFOS END
./.tests/test_wronggoing_stuff.bin/bin/divide_by_0
stdout was empty
stderr:
Illegal division by zero at ./.tests/test_wronggoing_stuff.bin/bin/divide_by_0 line 3.
Result: {'RESULT': None}
Final-results: {'RESULT': None}
EXIT_CODE: 255
submitit INFO (2025-10-21 08:31:40,520) - Job completed successfully
submitit INFO (2025-10-21 08:31:40,520) - Exiting after successful completion