ERROR while trying to mark job as failure: Can only mark failed a trial that is currently running.
⚠ Exception in parallel job handling: Can only mark failed a trial that is currently running.
It seems like the search space was exhausted. You were able to get 0% of the jobs you requested (got: 0, submitted: 1, failed: 0, requested: 1) after main ran
========================================================================
Current git-hash: 92cf40fe87120c8d418b1477cfad43a49740618b (last fully tested stable version 5 commits ago [9043d91dbe370183252bdf120ecb2c226402839d, 8689])
Using coverage run -p because $RUN_WITH_COVERAGE is set
[WARNING 10-21 07:53:00] ax.service.utils.with_db_settings_base: Ax currently requires a sqlalchemy version below 2.0. This will be addressed in a future release. Disabling SQL storage in Ax for now, if you would like to use SQL storage please install Ax with mysql extras via `pip install ax-platform[mysql]`.
Run-UUID: 9c40f99a-6285-4567-a740-84d856a33688
____ _ ____ _ ___
/ __ \ (_)/ __ \ | | |__ \
| | | |_ __ ___ _ __ _| | | |_ __ | |_ ) |
| | | | '_ ` _ \| '_ \| | | | | '_ \| __| / /
| |__| | | | | | | | | | | |__| | |_) | |_ / /_
\____/|_| |_| |_|_| |_|_|\____/| .__/ \__|____|
| |
|_|
omniopt --max_nr_of_zero_results 3 --live_share --send_anonymized_usage_stats --partition=alpha --gpus=0 --experiment_name=test_wronggoing_stuff_nosuccess --mem_gb=1 --time=120 --worker_timeout=1 --max_eval=1 --num_parallel_jobs=10 --run_program=Li8udGVzdHMvdGVzdF93cm9uZ2dvaW5nX3N0dWZmLmJpbi9iaW4vJShwcm9ncmFtKQ== --parameter program choice divide_by_0 --num_random_steps=1 --follow
Run-folder: /home/runner/work/OmniOpt/OmniOpt/runs/test_wronggoing_stuff_nosuccess/0See https://imageseg.scads.de/omniax/share?user_id=runner&experiment_name=test_wronggoing_stuff_nosuccess&run_nr=6 for live-results.You have 4 CPUs available for the main process.No CUDA devices found.Generation strategy: SOBOL for 1 step.
Run-Program: ./.tests/test_wronggoing_stuff.bin/bin/%(program)
Experiment parameters
┏━━━━━━━━━┳━━━━━━━┳━━━━━━━━━━━━━┓
┃Name ┃Type ┃Values ┃
┡━━━━━━━━━╇━━━━━━━╇━━━━━━━━━━━━━┩
│program│fixed│divide_by_0│
└─────────┴───────┴─────────────┘
Result-Names
┏━━━━━━━━━━━━━┳━━━━━━━━━━━━━┓
┃Result-Name┃Min or max?┃
┡━━━━━━━━━━━━━╇━━━━━━━━━━━━━┩
│RESULT │ min│
└─────────────┴─────────────┘
ERROR while trying to mark job as failure: Can only mark failed a trial that is currently running.⚠ Exception in parallel job handling: Can only mark failed a trial that is currently running.
It seems like the search space was exhausted. You were able to get 0% of the jobs you requested (got: 0, submitted: 1, failed: 0, requested: 1) after main ran Failed Jobs parameters
┏━━━━━━━━┳━━━━━━━━┳━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┓
┃param1┃param2┃param3┃error_description ┃
┡━━━━━━━━╇━━━━━━━━╇━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┩
│value1│value2│value3│Some error occurred during execution (this is not a real error!).│
└────────┴────────┴────────┴───────────────────────────────────────────────────────────────────┘
Runtime Infos
┏━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━┳━━━━━━━━━━━┳━━━━━━━━━━━━━━┳━━━━━━━━━━━━━┓
┃Number of evaluations┃Min time ┃Max time ┃Average time┃Median time┃
┡━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━╇━━━━━━━━━━━╇━━━━━━━━━━━━━━╇━━━━━━━━━━━━━┩
│ 1 │ 6.00 sec │ 6.00 sec │ 6.00 sec │ 6.00 sec │
└───────────────────────┴───────────┴───────────┴──────────────┴─────────────┘
2025-10-21 07:53:02 (81c8dccb-759e-4bea-a73e-fef2b3aa9d2a): SOBOL, Started OmniOpt2 run...
2025-10-21 07:53:02 (81c8dccb-759e-4bea-a73e-fef2b3aa9d2a): SOBOL, getting new HP set (no sbatch)
2025-10-21 07:53:02 (81c8dccb-759e-4bea-a73e-fef2b3aa9d2a): SOBOL, requested 1 jobs, got 1, 0.02 s/job
2025-10-21 07:53:02 (81c8dccb-759e-4bea-a73e-fef2b3aa9d2a): SOBOL, eval #1/1 start
2025-10-21 07:53:02 (81c8dccb-759e-4bea-a73e-fef2b3aa9d2a): SOBOL, starting new job
2025-10-21 07:53:02 (81c8dccb-759e-4bea-a73e-fef2b3aa9d2a): SOBOL, started new job
2025-10-21 07:53:11 (81c8dccb-759e-4bea-a73e-fef2b3aa9d2a): SOBOL, job_failed
2025-10-21 07:53:11 (81c8dccb-759e-4bea-a73e-fef2b3aa9d2a): SOBOL, found 1 zero-jobs (max: 3)
2025-10-21 07:53:11 (81c8dccb-759e-4bea-a73e-fef2b3aa9d2a): SOBOL, found 2 zero-jobs (max: 3)
2025-10-21 07:53:11 (81c8dccb-759e-4bea-a73e-fef2b3aa9d2a): SOBOL, found 3 zero-jobs (max: 3)
2025-10-21 07:53:11 (81c8dccb-759e-4bea-a73e-fef2b3aa9d2a): SOBOL, 3 empty jobs (>= 3)
Job submission durations
┏━━━━━━━━━┳━━━━━━━━━┳━━━━━━┳━━━━━━━━━━━━━━┓
┃ Batch ┃ Seconds ┃ Jobs ┃ Time per job ┃
┡━━━━━━━━━╇━━━━━━━━━╇━━━━━━╇━━━━━━━━━━━━━━┩
│ 1 │ 0.095 │ 1 │ 0.095 │
├─────────┼─────────┼──────┼──────────────┤
│ Average │ 0.095 │ │ │
│ Median │ 0.095 │ │ │
│ Total │ 0.095 │ │ │
│ Max │ 0.095 │ │ │
│ Min │ 0.095 │ │ │
└─────────┴─────────┴──────┴──────────────┘
Model generation times
┏━━━━━━━━━━━┳━━━━━━━━━┳━━━━━━┳━━━━━━━━━━━━━━┓
┃ Iteration ┃ Seconds ┃ Jobs ┃ Time per job ┃
┡━━━━━━━━━━━╇━━━━━━━━━╇━━━━━━╇━━━━━━━━━━━━━━┩
│ 1 │ 0.019 │ 1 │ 0.019 │
├───────────┼─────────┼──────┼──────────────┤
│ Average │ 0.019 │ │ │
│ Median │ 0.019 │ │ │
│ Total │ 0.019 │ │ │
│ Max │ 0.019 │ │ │
│ Min │ 0.019 │ │ │
└───────────┴─────────┴──────┴──────────────┘
