2025-04-02 20:35:42: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for old jobs to finish (30 left)
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303423/16303423_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303427/16303427_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303432/16303432_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303441/16303441_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303437/16303437_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303450/16303450_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303454/16303454_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303446/16303446_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303464/16303464_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303459/16303459_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303474/16303474_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303469/16303469_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303483/16303483_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303479/16303479_0_log.err not found
⚠ Job 16303493 (task: 0) with path /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303493/16303493_0_result.pkl
has not produced any output (state: FAILED)
No error stream produced. Look at stdout: /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303493/16303493_0_log.out
----------------------------------------
Traceback (most recent call last):
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/runpy.py", line 86, in _run_code
exec(code, run_globals)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/_submit.py", line 7, in
from submitit.core.submission import submitit_main
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/submission.py", line 16, in
import numpy # type: ignore # noqa
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/numpy/__init__.py", line 181, in
from . import lib
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/numpy/lib/__init__.py", line 23, in
from . import _index_tricks_impl
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/numpy/lib/_index_tricks_impl.py", line 12, in
import numpy.matrixlib as matrixlib
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/numpy/matrixlib/__init__.py", line 4, in
from . import defmatrix
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/numpy/matrixlib/defmatrix.py", line 12, in
from numpy.linalg import matrix_power
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/numpy/linalg/__init__.py", line 88, in
from . import _linalg
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/numpy/linalg/_linalg.py", line 41, in
from numpy._typing import NDArray
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/numpy/_typing/__init__.py", line 19, in
from ._nbit import (
File "", line 1027, in _find_and_load
File "", line 1006, in _find_and_load_unlocked
File "", line 688, in _load_unlocked
File "", line 879, in exec_module
File "", line 975, in get_code
File "", line 1073, in get_data
KeyboardInterrupt
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303493/16303493_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303488/16303488_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303502/16303502_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303498/16303498_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303515/16303515_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303506/16303506_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303509/16303509_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303512/16303512_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303521/16303521_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303523/16303523_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303518/16303518_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303535/16303535_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303526/16303526_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303532/16303532_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303529/16303529_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303538/16303538_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303951/16303951_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303962/16303962_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303970/16303970_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303975/16303975_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303983/16303983_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303987/16303987_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303990/16303990_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303993/16303993_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303995/16303995_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303998/16303998_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16304005/16304005_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16304000/16304000_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16304002/16304002_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16304008/16304008_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16304011/16304011_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16304015/16304015_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16304018/16304018_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16304022/16304022_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16304025/16304025_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16304028/16304028_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16304031/16304031_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16304034/16304034_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16304036/16304036_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16304048/16304048_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16304052/16304052_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16304055/16304055_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16304060/16304060_0_log.err not found
Job SlurmJob, state not in ['early_stopped', 'abandoned', 'cancelled', 'timeout', 'interrupted'], which would be removed from the job list, or ['completed', 'unknown', 'pending', 'running', 'completing'], which would be ignored: failed
Job SlurmJob, state not in ['early_stopped', 'abandoned', 'cancelled', 'timeout', 'interrupted'], which would be removed from the job list, or ['completed', 'unknown', 'pending', 'running', 'completing'], which would be ignored: failed
Job SlurmJob, state not in ['early_stopped', 'abandoned', 'cancelled', 'timeout', 'interrupted'], which would be removed from the job list, or ['completed', 'unknown', 'pending', 'running', 'completing'], which would be ignored: failed
Job SlurmJob, state not in ['early_stopped', 'abandoned', 'cancelled', 'timeout', 'interrupted'], which would be removed from the job list, or ['completed', 'unknown', 'pending', 'running', 'completing'], which would be ignored: failed
Job SlurmJob, state not in ['early_stopped', 'abandoned', 'cancelled', 'timeout', 'interrupted'], which would be removed from the job list, or ['completed', 'unknown', 'pending', 'running', 'completing'], which would be ignored: failed
Job SlurmJob, state not in ['early_stopped', 'abandoned', 'cancelled', 'timeout', 'interrupted'], which would be removed from the job list, or ['completed', 'unknown', 'pending', 'running', 'completing'], which would be ignored: failed
⚠ Job 16304039 (task: 0) with path /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16304039/16304039_0_result.pkl
has not produced any output (state: FAILED)
No error stream produced. Look at stdout: /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16304039/16304039_0_log.out
----------------------------------------
Traceback (most recent call last):
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/runpy.py", line 86, in _run_code
exec(code, run_globals)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/_submit.py", line 11, in
submitit_main()
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/submission.py", line 76, in submitit_main
process_job(args.folder)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/submission.py", line 37, in process_job
env = job_environment.JobEnvironment()
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/job_environment.py", line 44, in __new__
return plugins.get_job_environment()
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/plugins.py", line 71, in get_job_environment
envs = get_job_environments()
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/plugins.py", line 88, in get_job_environments
return {env.name(): env for env in _get_plugins()[1]}
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/plugins.py", line 24, in _get_plugins
import pkg_resources
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/pkg_resources/__init__.py", line 78, in
__import__('pkg_resources.extern.packaging.requirements')
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/pkg_resources/_vendor/packaging/requirements.py", line 9, in
from pkg_resources.extern.pyparsing import stringStart, stringEnd, originalTextFor, ParseException
File "", line 1027, in _find_and_load
File "", line 1006, in _find_and_load_unlocked
File "", line 674, in _load_unlocked
File "", line 571, in module_from_spec
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/pkg_resources/extern/__init__.py", line 52, in create_module
return self.load_module(spec.name)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/pkg_resources/extern/__init__.py", line 37, in load_module
__import__(extant)
File "", line 1027, in _find_and_load
File "", line 1006, in _find_and_load_unlocked
File "", line 688, in _load_unlocked
File "", line 879, in exec_module
File "", line 1012, in get_code
File "", line 672, in _compile_bytecode
KeyboardInterrupt
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16304039/16304039_0_log.err not found
⚠ Job 16304041 (task: 0) with path /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16304041/16304041_0_result.pkl
has not produced any output (state: FAILED)
No error stream produced. Look at stdout: /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16304041/16304041_0_log.out
----------------------------------------
Traceback (most recent call last):
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/runpy.py", line 86, in _run_code
exec(code, run_globals)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/_submit.py", line 11, in
submitit_main()
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/submission.py", line 76, in submitit_main
process_job(args.folder)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/submission.py", line 37, in process_job
env = job_environment.JobEnvironment()
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/job_environment.py", line 44, in __new__
return plugins.get_job_environment()
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/plugins.py", line 71, in get_job_environment
envs = get_job_environments()
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/plugins.py", line 88, in get_job_environments
return {env.name(): env for env in _get_plugins()[1]}
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/plugins.py", line 24, in _get_plugins
import pkg_resources
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/pkg_resources/__init__.py", line 78, in
__import__('pkg_resources.extern.packaging.requirements')
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/pkg_resources/_vendor/packaging/requirements.py", line 9, in
from pkg_resources.extern.pyparsing import stringStart, stringEnd, originalTextFor, ParseException
File "", line 1027, in _find_and_load
File "", line 1006, in _find_and_load_unlocked
File "", line 674, in _load_unlocked
File "", line 571, in module_from_spec
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/pkg_resources/extern/__init__.py", line 52, in create_module
return self.load_module(spec.name)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/pkg_resources/extern/__init__.py", line 37, in load_module
__import__(extant)
File "", line 1027, in _find_and_load
File "", line 1006, in _find_and_load_unlocked
File "", line 688, in _load_unlocked
File "", line 879, in exec_module
File "", line 1012, in get_code
File "", line 672, in _compile_bytecode
KeyboardInterrupt
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16304041/16304041_0_log.err not found
⚠ Job 16304045 (task: 0) with path /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16304045/16304045_0_result.pkl
has not produced any output (state: FAILED)
No error stream produced. Look at stdout: /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16304045/16304045_0_log.out
----------------------------------------
Traceback (most recent call last):
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/runpy.py", line 86, in _run_code
exec(code, run_globals)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/_submit.py", line 11, in
submitit_main()
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/submission.py", line 76, in submitit_main
process_job(args.folder)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/submission.py", line 37, in process_job
env = job_environment.JobEnvironment()
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/job_environment.py", line 44, in __new__
return plugins.get_job_environment()
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/plugins.py", line 71, in get_job_environment
envs = get_job_environments()
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/plugins.py", line 88, in get_job_environments
return {env.name(): env for env in _get_plugins()[1]}
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/plugins.py", line 24, in _get_plugins
import pkg_resources
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/pkg_resources/__init__.py", line 78, in
__import__('pkg_resources.extern.packaging.requirements')
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/pkg_resources/_vendor/packaging/requirements.py", line 9, in
from pkg_resources.extern.pyparsing import stringStart, stringEnd, originalTextFor, ParseException
File "", line 1027, in _find_and_load
File "", line 1006, in _find_and_load_unlocked
File "", line 674, in _load_unlocked
File "", line 571, in module_from_spec
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/pkg_resources/extern/__init__.py", line 52, in create_module
return self.load_module(spec.name)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/pkg_resources/extern/__init__.py", line 37, in load_module
__import__(extant)
File "", line 1027, in _find_and_load
File "", line 1006, in _find_and_load_unlocked
File "", line 688, in _load_unlocked
File "", line 879, in exec_module
File "", line 1012, in get_code
File "", line 672, in _compile_bytecode
KeyboardInterrupt
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16304045/16304045_0_log.err not found
Current git-hash: 748be6af2e38a3c47ed5b1c8cc0139d9175bbc80 (version: 5373)
Runtime (end): 45 seconds, PID: 3392277
To cancel, press CTRLc, then run 'scancel 16303402'
⠹Loading base modules...⠋Loading rich_argparse...⠋Loading torch...⠋Loading numpy...⠦Loading ax...⠋Loading botorch...⠋Loading submitit...⠋Loading ax logger...
Run-UUID: 277d8296-2be9-4a02-85a1-6e8e841904bf
_________________________________________________
/ \
| OmniOpt2 - Optimizing like Schrödinger’s cat—unti |
| l you look, it's both perfect and terrible. |
\ /
=================================================
\
\
\
\
.-=-==--==--.
..-==" ,'o`) `.
,' `"' \
: ( `.__...._
| ) / `-=-.
: ,vv.-._ / / `---==-._
\/\/\/VV ^ d88`;' / `.
`` ^/d88P!' / , `._
^/ !' ,. , / "-,,__,,--'""""-.
^/ !' ,' \ . .( ( _ ) ) ) ) ))_,-.\
^(__ ,!',"' ;:+.:%:a. \:.. . ,' ) ) ) ) ,"' '
',,,'',' /o:::":%:%a. \:.:.: . ) ) _,'
"""' ;':::'' `+%%%a._ \%:%| ;.). _,-""
,-='_.-' ``:%::) )%:| /:._,"
(/(/" ," ,'_,'%%%: (_,'
( (//(`.___; \
\ \ ` `
`. `. `. :
\. . .\ : . . . :
\. . .: `.. . .:
`..:.:\ \:...\
;:.:.; ::...:
):%:: :::::;
__,::%:( :::::
,;:%%%%%%%: ;:%::
;,--""-.`\ ,=--':%:%:\
/" "| /-".:%%%%%%%\
;,-"'`)%%)
/" "|
omniopt --partition=romeo --experiment_name=BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME --result_names ACCURACY=max RUNTIME=min --mem_gb=32 --time=1440 --worker_timeout=60 --max_eval=500 --num_parallel_jobs=30 --revert_to_random_when_seemingly_exhausted --generate_all_jobs_at_once --decimalrounding=12 --gpus=0 --num_random_steps=20 --send_anonymized_usage_stats --run_program=bW9kdWxlIGxvYWQgR0NDY29yZS8xMC4zLjAgUHl0aG9uICYmIHNvdXJjZSAvZGF0YS9ob3JzZS93cy9zNDEyMjQ4NS1jb21wUGVyZkREL2JlbmNobWFyay92ZW52L2Jpbi9hY3RpdmF0ZSAmJiBweXRob24gL2RhdGEvaG9yc2Uvd3MvczQxMjI0ODUtY29tcFBlcmZERC9iZW5jaG1hcmsvZGZraS9iZW5jaG1hcmtkZC9tYWluLnB5IDEgMSAwIFBva2VySGFuZCAyMDAwIEhvZWZmZGluZ1RyZWVDbGFzc2lmaWVyIEJORE0gcmVjZW50X3NhbXBsZXNfc2l6ZSAlKHJlY2VudF9zYW1wbGVzX3NpemUpIG5fc2FtcGxlcyAlKG5fc2FtcGxlcykgY29uc3QgJShjb25zdCkgbWF4X2RlcHRoICUobWF4X2RlcHRoKSB0aHJlc2hvbGQgJSh0aHJlc2hvbGQp --cpus_per_task=1 --model=BOTORCH_MODULAR --run_mode=local --live_share --parameter recent_samples_size range 1 5000 int --parameter n_samples range 1 5000 int --parameter const range 0.001 10.0 float --parameter max_depth range 1 20 int --parameter threshold range 0.001 0.999 float
Run-folder: runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0
Warning: --num_random_steps is smaller than --num_parallel_jobs. It's recommended that --num_parallel_jobs is the same as or a multiple of --num_random_stepsYou have 2 CPUs available for the main process.No CUDA devices found.Generation strategy: Sobol for 30 trials, BoTorch for subsequent trials.
Run-Program: module load GCCcore/10.3.0 Python && source /data/horse/ws/s4122485-compPerfDD/benchmark/venv/bin/activate && python /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/main.py 1 1 0 PokerHand 2000 HoeffdingTreeClassifier BNDM recent_samples_size %(recent_samples_size) n_samples %(n_samples) const %(const) max_depth %(max_depth) threshold %(threshold)
Experiment parameters:
┏━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━┳━━━━━━━━━━━━━┳━━━━━━━━━━━━━┳━━━━━━━┳━━━━━━━━━━━━┓
┃Name ┃Type ┃Lower bound┃Upper bound┃Type ┃Log Scale?┃
┡━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━╇━━━━━━━━━━━━━╇━━━━━━━━━━━━━╇━━━━━━━╇━━━━━━━━━━━━┩
│recent_samples_size│range│1 │5000 │int │No │
│n_samples │range│1 │5000 │int │No │
│const │range│0.001 │10 │float│No │
│max_depth │range│1 │20 │int │No │
│threshold │range│0.001 │0.999 │float│No │
└─────────────────────┴───────┴─────────────┴─────────────┴───────┴────────────┘
Result-Names:
┏━━━━━━━━━━━━━┳━━━━━━━━━━━━━┓
┃Result-Name┃Min or max?┃
┡━━━━━━━━━━━━━╇━━━━━━━━━━━━━┩
│ACCURACY │ max│
│RUNTIME │ min│
└─────────────┴─────────────┘
See https://imageseg.scads.de/omniax/share?user_id=s4122485&experiment_name=BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME&run_nr=0 for live-results.
█▀▀▀▀▀█ █▄▀▀▀▄█▄ ▀ ▀██ ▀▄ ▀█ ▀▀▀ █ ▄▀ █▀▀▀▀▀█
█ ███ █ █ ████ █▀▀ ███▀▀ ▄▄▀█▄▄▄▀▀ █▄ █ ███ █
█ ▀▀▀ █ ▄ █▀ ▀ ▀▄▀▄▄█▀▀▀█ █▀ ▀▀▄▀▄▀▀▀ █ ▀▀▀ █
▀▀▀▀▀▀▀ ▀▄█ █ █ ▀▄▀▄█ ▀ █ ▀ ▀▄█ █▄█ ▀ ▀▀▀▀▀▀▀
██▄▄██▀▄ █ █▀▄▄▄▄ █▀█▀▀▀█ ▄█▄██ ██▀▄▄ ▄█ ██▀▀
▀ █▄██▀ ▀ ▀█▀█▀▀ █ ▀▀▄█ █▄▄██▀█▀▄▄▀▄██▀ ▀
█▀▄▄▀▄▀██▀▄▄▀▄▀▀▀█▄█▀█ ▄█▀▄██ ▀▄ ▄▄ ▄▀ ▀▄▄▀
▄▀▄▄▀ █▄ ▀▄▄ ▄█▄▀▀▄▀▄▄▀▀▀█▀ ▄▄▄▀█▄▀█ ▀ █▄
█ █▄▄▀▀█▄ ▄▄ ▀█▀ ▀▄▀▄▀▀ █ █▄ ██ ▀█ █▄ ▄█ ▀▄▀
█▀ ██▀▄▀ ▀▀▀█ ▄█ █▀█▄ ██ █ ▀███▄▀█▄▀▄▄▀▀▀
█▀▄▄█▀▀▀██▀▄█▀▀█ █▀▀█▀▀▀█ ██ ██ ▀▄▀▄█▀▀▀█ █▄▀
█▄▀█ ▀ ██▀▄▄▀█▀█▀ ██ ▀ █▀ ▄▀▄█ ▄▀▄▄█ ▀ █▄▀█▄
▀█████▀▀███▀█▄▄▄▄▄█▀███▀▀▀▄▀▄ █ ▀▄ ▀█▀██▀▀
██▀█▄█▀█▀██▄ █▀▀ █▄ ██▀ ▀▀ ▀██▀██ ▄ ▀▄ ▀ ▀
█▀█ ▀ ██▄██▀▀▀▀▀█▄█▀▀▄█▄▄▄ ██ ▄ █▄▀ █
▀▄▀ ▄▀█▄ ▄ ▄▄ ▀ ▄█▄██▀▀ █▄▀▀ ▄ ▄█▄▀▄█▄▄▀█▀▀
▄▄▀▀█▄▀██ █▄▀▀█▀ ▀▄ ▄▄▄▄█ ▄█ █▄▀█▀▀ ▀▄▀█ ▄█▀
▄▄▄█ ▀▄▄ ▀▀█ ▄▄█▀▀ █▄▀▄▀██ █▀▄▀▄▀▄▀▄▀█ ▀
▀ ▀▀ ▀▀▄▀█▄█▄█▄▀▀▀ █▀▀▀█ ██▄█▄▄██ ▄█▀▀▀█▄ ▀▄
█▀▀▀▀▀█ ▄██▀ ▀█ █▀ ▄█ ▀ █ ▄█▀█ ▀█▀▀▀█ ▀ █▄▀█▄
█ ███ █ ▀▀█▀█▄▄▄▄▄██▀█▀▀█ █▀ █▄▄█▄▀ ▀██▀█▄ ▄▄
█ ▀▀▀ █ ▄ ▄▄ ▀█▀ ▀██▀▄ ▄██▄█▀▀▄█▄▄▄█▀ ▀▀▀ ▀
▀▀▀▀▀▀▀ ▀ ▀ ▀ ▀▀▀▀▀ ▀▀▀ ▀ ▀▀ ▀▀▀▀▀▀ ▀▀ ▀
Failed jobs: 26 ('ACCURACY: ' not found in output, 'RUNTIME: ' not found in output), SobolGenerator, pending 4 (13%/30), job_failed: 0%|░░░░░░░░░░| 0/500 [06:24
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303423/16303423_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303427/16303427_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303432/16303432_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303441/16303441_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303437/16303437_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303450/16303450_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303454/16303454_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303446/16303446_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303464/16303464_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303459/16303459_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303474/16303474_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303469/16303469_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303483/16303483_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303479/16303479_0_log.err not found
⚠ Job 16303493 (task: 0) with path /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303493/16303493_0_result.pkl
has not produced any output (state: FAILED)
No error stream produced. Look at stdout: /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303493/16303493_0_log.out
----------------------------------------
Traceback (most recent call last):
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/runpy.py", line 86, in _run_code
exec(code, run_globals)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/_submit.py", line 7, in
from submitit.core.submission import submitit_main
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/submission.py", line 16, in
import numpy # type: ignore # noqa
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/numpy/__init__.py", line 181, in
from . import lib
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/numpy/lib/__init__.py", line 23, in
from . import _index_tricks_impl
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/numpy/lib/_index_tricks_impl.py", line 12, in
import numpy.matrixlib as matrixlib
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/numpy/matrixlib/__init__.py", line 4, in
from . import defmatrix
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/numpy/matrixlib/defmatrix.py", line 12, in
from numpy.linalg import matrix_power
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/numpy/linalg/__init__.py", line 88, in
from . import _linalg
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/numpy/linalg/_linalg.py", line 41, in
from numpy._typing import NDArray
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/numpy/_typing/__init__.py", line 19, in
from ._nbit import (
File "", line 1027, in _find_and_load
File "", line 1006, in _find_and_load_unlocked
File "", line 688, in _load_unlocked
File "", line 879, in exec_module
File "", line 975, in get_code
File "", line 1073, in get_data
KeyboardInterrupt
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303493/16303493_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303488/16303488_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303502/16303502_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303498/16303498_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303515/16303515_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303506/16303506_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303509/16303509_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303512/16303512_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303521/16303521_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303523/16303523_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303518/16303518_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303535/16303535_0_log.err not foundFailed jobs: 30 ('ACCURACY: ' not found in output, 'RUNTIME: ' not found in output), SobolGenerator, finished 0 jobs: 0%|░░░░░░░░░░| 0/500 [07:09
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303526/16303526_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303532/16303532_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303529/16303529_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303538/16303538_0_log.err not foundFailed jobs: 57 ('ACCURACY: ' not found in output, 'RUNTIME: ' not found in output), SobolGenerator, failed 3 (10%/30), waiting for old jobs to finish (3 left): 0%|░░░░░░░░░░| 0/500 [36:29
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303951/16303951_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303962/16303962_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303970/16303970_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303975/16303975_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303983/16303983_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303987/16303987_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303990/16303990_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303993/16303993_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303995/16303995_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16303998/16303998_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16304005/16304005_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16304000/16304000_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16304002/16304002_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16304008/16304008_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16304011/16304011_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16304015/16304015_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16304018/16304018_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16304022/16304022_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16304025/16304025_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16304028/16304028_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16304031/16304031_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16304034/16304034_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16304036/16304036_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16304048/16304048_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16304052/16304052_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16304055/16304055_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16304060/16304060_0_log.err not foundJob SlurmJob, state not in ['early_stopped', 'abandoned', 'cancelled', 'timeout', 'interrupted'], which would be removed from the job list, or ['completed', 'unknown', 'pending', 'running', 'completing'], which would be ignored: failedJob SlurmJob, state not in ['early_stopped', 'abandoned', 'cancelled', 'timeout', 'interrupted'], which would be removed from the job list, or ['completed', 'unknown', 'pending', 'running', 'completing'], which would be ignored: failedJob SlurmJob, state not in ['early_stopped', 'abandoned', 'cancelled', 'timeout', 'interrupted'], which would be removed from the job list, or ['completed', 'unknown', 'pending', 'running', 'completing'], which would be ignored: failedJob SlurmJob, state not in ['early_stopped', 'abandoned', 'cancelled', 'timeout', 'interrupted'], which would be removed from the job list, or ['completed', 'unknown', 'pending', 'running', 'completing'], which would be ignored: failedJob SlurmJob, state not in ['early_stopped', 'abandoned', 'cancelled', 'timeout', 'interrupted'], which would be removed from the job list, or ['completed', 'unknown', 'pending', 'running', 'completing'], which would be ignored: failedJob SlurmJob, state not in ['early_stopped', 'abandoned', 'cancelled', 'timeout', 'interrupted'], which would be removed from the job list, or ['completed', 'unknown', 'pending', 'running', 'completing'], which would be ignored: failedFailed jobs: 58 ('ACCURACY: ' not found in output, 'RUNTIME: ' not found in output), SobolGenerator, failed 2 (7%/30), job_failed: 0%|░░░░░░░░░░| 0/500 [37:08
⚠ Job 16304039 (task: 0) with path /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16304039/16304039_0_result.pkl
has not produced any output (state: FAILED)
No error stream produced. Look at stdout: /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16304039/16304039_0_log.out
----------------------------------------
Traceback (most recent call last):
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/runpy.py", line 86, in _run_code
exec(code, run_globals)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/_submit.py", line 11, in
submitit_main()
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/submission.py", line 76, in submitit_main
process_job(args.folder)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/submission.py", line 37, in process_job
env = job_environment.JobEnvironment()
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/job_environment.py", line 44, in __new__
return plugins.get_job_environment()
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/plugins.py", line 71, in get_job_environment
envs = get_job_environments()
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/plugins.py", line 88, in get_job_environments
return {env.name(): env for env in _get_plugins()[1]}
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/plugins.py", line 24, in _get_plugins
import pkg_resources
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/pkg_resources/__init__.py", line 78, in
__import__('pkg_resources.extern.packaging.requirements')
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/pkg_resources/_vendor/packaging/requirements.py", line 9, in
from pkg_resources.extern.pyparsing import stringStart, stringEnd, originalTextFor, ParseException
File "", line 1027, in _find_and_load
File "", line 1006, in _find_and_load_unlocked
File "", line 674, in _load_unlocked
File "", line 571, in module_from_spec
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/pkg_resources/extern/__init__.py", line 52, in create_module
return self.load_module(spec.name)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/pkg_resources/extern/__init__.py", line 37, in load_module
__import__(extant)
File "", line 1027, in _find_and_load
File "", line 1006, in _find_and_load_unlocked
File "", line 688, in _load_unlocked
File "", line 879, in exec_module
File "", line 1012, in get_code
File "", line 672, in _compile_bytecode
KeyboardInterrupt
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16304039/16304039_0_log.err not found
⚠ Job 16304041 (task: 0) with path /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16304041/16304041_0_result.pkl
has not produced any output (state: FAILED)
No error stream produced. Look at stdout: /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16304041/16304041_0_log.out
----------------------------------------
Traceback (most recent call last):
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/runpy.py", line 86, in _run_code
exec(code, run_globals)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/_submit.py", line 11, in
submitit_main()
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/submission.py", line 76, in submitit_main
process_job(args.folder)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/submission.py", line 37, in process_job
env = job_environment.JobEnvironment()
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/job_environment.py", line 44, in __new__
return plugins.get_job_environment()
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/plugins.py", line 71, in get_job_environment
envs = get_job_environments()
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/plugins.py", line 88, in get_job_environments
return {env.name(): env for env in _get_plugins()[1]}
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/plugins.py", line 24, in _get_plugins
import pkg_resources
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/pkg_resources/__init__.py", line 78, in
__import__('pkg_resources.extern.packaging.requirements')
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/pkg_resources/_vendor/packaging/requirements.py", line 9, in
from pkg_resources.extern.pyparsing import stringStart, stringEnd, originalTextFor, ParseException
File "", line 1027, in _find_and_load
File "", line 1006, in _find_and_load_unlocked
File "", line 674, in _load_unlocked
File "", line 571, in module_from_spec
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/pkg_resources/extern/__init__.py", line 52, in create_module
return self.load_module(spec.name)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/pkg_resources/extern/__init__.py", line 37, in load_module
__import__(extant)
File "", line 1027, in _find_and_load
File "", line 1006, in _find_and_load_unlocked
File "", line 688, in _load_unlocked
File "", line 879, in exec_module
File "", line 1012, in get_code
File "", line 672, in _compile_bytecode
KeyboardInterrupt
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16304041/16304041_0_log.err not foundFailed jobs: 60 ('ACCURACY: ' not found in output, 'RUNTIME: ' not found in output), SobolGenerator, finished 0 jobs: 0%|░░░░░░░░░░| 0/500 [37:32
⚠ Job 16304045 (task: 0) with path /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16304045/16304045_0_result.pkl
has not produced any output (state: FAILED)
No error stream produced. Look at stdout: /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16304045/16304045_0_log.out
----------------------------------------
Traceback (most recent call last):
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/runpy.py", line 86, in _run_code
exec(code, run_globals)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/_submit.py", line 11, in
submitit_main()
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/submission.py", line 76, in submitit_main
process_job(args.folder)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/submission.py", line 37, in process_job
env = job_environment.JobEnvironment()
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/job_environment.py", line 44, in __new__
return plugins.get_job_environment()
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/plugins.py", line 71, in get_job_environment
envs = get_job_environments()
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/plugins.py", line 88, in get_job_environments
return {env.name(): env for env in _get_plugins()[1]}
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/plugins.py", line 24, in _get_plugins
import pkg_resources
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/pkg_resources/__init__.py", line 78, in
__import__('pkg_resources.extern.packaging.requirements')
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/pkg_resources/_vendor/packaging/requirements.py", line 9, in
from pkg_resources.extern.pyparsing import stringStart, stringEnd, originalTextFor, ParseException
File "", line 1027, in _find_and_load
File "", line 1006, in _find_and_load_unlocked
File "", line 674, in _load_unlocked
File "", line 571, in module_from_spec
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/pkg_resources/extern/__init__.py", line 52, in create_module
return self.load_module(spec.name)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/pkg_resources/extern/__init__.py", line 37, in load_module
__import__(extant)
File "", line 1027, in _find_and_load
File "", line 1006, in _find_and_load_unlocked
File "", line 688, in _load_unlocked
File "", line 879, in exec_module
File "", line 1012, in get_code
File "", line 672, in _compile_bytecode
KeyboardInterrupt
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/BNDM_PokerHand_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16304045/16304045_0_log.err not foundFailed jobs: 60 ('ACCURACY: ' not found in output, 'RUNTIME: ' not found in output), SobolGenerator, pending 30 (100%/30), waiting for old jobs to finish (30 left): 0%|░░░░░░░░░░| 0/500 [1:16:56
2025-04-02 19:18:46: Initializing model, Started OmniOpt2 run...
2025-04-02 19:18:46: Initializing model, finished 0 jobs
2025-04-02 19:18:46: Initializing model, trying to get 30 next steps (current done: 0, max: 500)
2025-04-02 19:18:46: Initializing model, finishing jobs (_get_next_trials), finished 0 jobs
2025-04-02 19:18:46: Initializing model, getting new hyperparameter set #1/30
2025-04-02 19:18:47: SobolGenerator, getting new hyperparameter set #2/30 | ETA: 17s
2025-04-02 19:18:47: SobolGenerator, getting new hyperparameter set #3/30 | ETA: 17s
2025-04-02 19:18:48: SobolGenerator, getting new hyperparameter set #4/30 | ETA: 16s
2025-04-02 19:18:48: SobolGenerator, getting new hyperparameter set #5/30 | ETA: 16s
2025-04-02 19:18:49: SobolGenerator, getting new hyperparameter set #6/30 | ETA: 15s
2025-04-02 19:18:50: SobolGenerator, getting new hyperparameter set #7/30 | ETA: 14s
2025-04-02 19:18:50: SobolGenerator, getting new hyperparameter set #8/30 | ETA: 14s
2025-04-02 19:18:51: SobolGenerator, getting new hyperparameter set #9/30 | ETA: 14s
2025-04-02 19:18:52: SobolGenerator, getting new hyperparameter set #10/30 | ETA: 13s
2025-04-02 19:18:52: SobolGenerator, getting new hyperparameter set #11/30 | ETA: 12s
2025-04-02 19:18:53: SobolGenerator, getting new hyperparameter set #12/30 | ETA: 11s
2025-04-02 19:18:54: SobolGenerator, getting new hyperparameter set #13/30 | ETA: 11s
2025-04-02 19:18:54: SobolGenerator, getting new hyperparameter set #14/30 | ETA: 10s
2025-04-02 19:18:55: SobolGenerator, getting new hyperparameter set #15/30 | ETA: 9s
2025-04-02 19:18:55: SobolGenerator, getting new hyperparameter set #16/30 | ETA: 9s
2025-04-02 19:18:56: SobolGenerator, getting new hyperparameter set #17/30 | ETA: 8s
2025-04-02 19:18:56: SobolGenerator, getting new hyperparameter set #18/30 | ETA: 7s
2025-04-02 19:18:57: SobolGenerator, getting new hyperparameter set #19/30 | ETA: 6s
2025-04-02 19:18:57: SobolGenerator, getting new hyperparameter set #20/30 | ETA: 6s
2025-04-02 19:18:57: SobolGenerator, getting new hyperparameter set #21/30 | ETA: 5s
2025-04-02 19:18:58: SobolGenerator, getting new hyperparameter set #22/30 | ETA: 4s
2025-04-02 19:18:58: SobolGenerator, getting new hyperparameter set #23/30 | ETA: 4s
2025-04-02 19:18:59: SobolGenerator, getting new hyperparameter set #24/30 | ETA: 3s
2025-04-02 19:18:59: SobolGenerator, getting new hyperparameter set #25/30 | ETA: 3s
2025-04-02 19:19:00: SobolGenerator, getting new hyperparameter set #26/30 | ETA: 2s
2025-04-02 19:19:00: SobolGenerator, getting new hyperparameter set #27/30 | ETA: 2s
2025-04-02 19:19:01: SobolGenerator, getting new hyperparameter set #28/30 | ETA: 1s
2025-04-02 19:19:01: SobolGenerator, getting new hyperparameter set #29/30 | ETA: 1s
2025-04-02 19:19:01: SobolGenerator, getting new hyperparameter set #30/30 | ETA: 0s
2025-04-02 19:19:02: SobolGenerator, starting parameter set
2025-04-02 19:19:02: SobolGenerator, starting new job
2025-04-02 19:19:04: SobolGenerator, unknown 1 (3%/30), started new job
2025-04-02 19:19:04: SobolGenerator, unknown 1 (3%/30), starting parameter set
2025-04-02 19:19:05: SobolGenerator, unknown 1 (3%/30), starting new job
2025-04-02 19:19:07: SobolGenerator, unknown 2 (7%/30), started new job
2025-04-02 19:19:07: SobolGenerator, unknown 2 (7%/30), starting parameter set
2025-04-02 19:19:08: SobolGenerator, pending 2 (7%/30), starting new job
2025-04-02 19:19:10: SobolGenerator, pending/unknown 2/1 (10%/30), started new job
2025-04-02 19:19:10: SobolGenerator, pending/unknown 2/1 (10%/30), starting parameter set
2025-04-02 19:19:11: SobolGenerator, pending/unknown 2/1 (10%/30), starting new job
2025-04-02 19:19:13: SobolGenerator, pending/unknown 3/1 (13%/30), started new job
2025-04-02 19:19:13: SobolGenerator, pending/unknown 3/1 (13%/30), starting parameter set
2025-04-02 19:19:14: SobolGenerator, pending/unknown 3/1 (13%/30), starting new job
2025-04-02 19:19:16: SobolGenerator, pending/unknown 3/2 (17%/30), started new job
2025-04-02 19:19:16: SobolGenerator, pending/unknown 3/2 (17%/30), starting parameter set
2025-04-02 19:19:17: SobolGenerator, pending/unknown 3/2 (17%/30), starting new job
2025-04-02 19:19:19: SobolGenerator, running/pending/unknown 1/4/1 (20%/30), started new job
2025-04-02 19:19:19: SobolGenerator, running/pending/unknown 1/4/1 (20%/30), starting parameter set
2025-04-02 19:19:19: SobolGenerator, running/pending/unknown 1/4/1 (20%/30), starting new job
2025-04-02 19:19:21: SobolGenerator, running/pending/unknown 1/4/2 (23%/30), started new job
2025-04-02 19:19:21: SobolGenerator, running/pending/unknown 1/4/2 (23%/30), starting parameter set
2025-04-02 19:19:22: SobolGenerator, running/pending/unknown 1/4/2 (23%/30), starting new job
2025-04-02 19:19:23: SobolGenerator, running/pending/unknown 1/6/1 (27%/30), started new job
2025-04-02 19:19:23: SobolGenerator, running/pending/unknown 1/6/1 (27%/30), starting parameter set
2025-04-02 19:19:24: SobolGenerator, running/pending/unknown 1/6/1 (27%/30), starting new job
2025-04-02 19:19:26: SobolGenerator, running/pending/unknown 1/6/2 (30%/30), started new job
2025-04-02 19:19:26: SobolGenerator, running/pending/unknown 1/6/2 (30%/30), starting parameter set
2025-04-02 19:19:27: SobolGenerator, running/pending/unknown 1/6/2 (30%/30), starting new job
2025-04-02 19:19:29: SobolGenerator, running/pending/unknown 1/8/1 (33%/30), started new job
2025-04-02 19:19:29: SobolGenerator, running/pending/unknown 1/8/1 (33%/30), starting parameter set
2025-04-02 19:19:30: SobolGenerator, completed/pending/unknown 1/8/1 (33%/30), starting new job
2025-04-02 19:19:33: SobolGenerator, completed/pending/unknown 1/8/2 (37%/30), started new job
2025-04-02 19:19:33: SobolGenerator, completed/pending/unknown 1/8/2 (37%/30), starting parameter set
2025-04-02 19:19:34: SobolGenerator, completed/pending 1/10 (37%/30), starting new job
2025-04-02 19:19:36: SobolGenerator, completed/pending/unknown 1/10/1 (40%/30), started new job
2025-04-02 19:19:36: SobolGenerator, completed/pending/unknown 1/10/1 (40%/30), starting parameter set
2025-04-02 19:19:36: SobolGenerator, completed/pending/unknown 1/10/1 (40%/30), starting new job
2025-04-02 19:19:38: SobolGenerator, completed/pending/unknown 1/10/2 (43%/30), started new job
2025-04-02 19:19:38: SobolGenerator, completed/pending/unknown 1/10/2 (43%/30), starting parameter set
2025-04-02 19:19:39: SobolGenerator, completed/pending/unknown 1/10/2 (43%/30), starting new job
2025-04-02 19:19:41: SobolGenerator, completed/pending/unknown 1/11/2 (47%/30), started new job
2025-04-02 19:19:41: SobolGenerator, completed/pending/unknown 1/11/2 (47%/30), starting parameter set
2025-04-02 19:19:42: SobolGenerator, completed/pending/unknown 1/11/2 (47%/30), starting new job
2025-04-02 19:19:44: SobolGenerator, completed/pending/unknown 1/11/3 (50%/30), started new job
2025-04-02 19:19:44: SobolGenerator, completed/pending/unknown 1/11/3 (50%/30), starting parameter set
2025-04-02 19:19:44: SobolGenerator, completed/pending/unknown 1/11/3 (50%/30), starting new job
2025-04-02 19:19:46: SobolGenerator, completed/pending/unknown 1/13/2 (53%/30), started new job
2025-04-02 19:19:46: SobolGenerator, completed/pending/unknown 1/13/2 (53%/30), starting parameter set
2025-04-02 19:19:47: SobolGenerator, completed/pending/unknown 1/13/2 (53%/30), starting new job
2025-04-02 19:19:49: SobolGenerator, completed/running/pending/unknown 1/2/11/3 (57%/30), started new job
2025-04-02 19:19:49: SobolGenerator, completed/running/pending/unknown 1/2/11/3 (57%/30), starting parameter set
2025-04-02 19:19:50: SobolGenerator, completed/running/pending/unknown 1/2/13/1 (57%/30), starting new job
2025-04-02 19:19:53: SobolGenerator, completed/running/pending/unknown 1/2/13/2 (60%/30), started new job
2025-04-02 19:19:53: SobolGenerator, completed/running/pending/unknown 1/2/13/2 (60%/30), starting parameter set
2025-04-02 19:19:54: SobolGenerator, completed/running/pending 1/2/15 (60%/30), starting new job
2025-04-02 19:19:56: SobolGenerator, completed/running/pending/unknown 1/2/15/1 (63%/30), started new job
2025-04-02 19:19:56: SobolGenerator, completed/running/pending/unknown 1/2/15/1 (63%/30), starting parameter set
2025-04-02 19:19:56: SobolGenerator, completed/running/pending/unknown 1/2/15/1 (63%/30), starting new job
2025-04-02 19:19:58: SobolGenerator, completed/running/pending/unknown 1/2/15/2 (67%/30), started new job
2025-04-02 19:19:58: SobolGenerator, completed/running/pending/unknown 1/2/15/2 (67%/30), starting parameter set
2025-04-02 19:19:59: SobolGenerator, completed/running/pending/unknown 1/2/15/2 (67%/30), starting new job
2025-04-02 19:20:01: SobolGenerator, completed/running/pending/unknown 1/2/17/1 (70%/30), started new job
2025-04-02 19:20:01: SobolGenerator, completed/running/pending/unknown 1/2/17/1 (70%/30), starting parameter set
2025-04-02 19:20:01: SobolGenerator, completed/running/pending/unknown 1/2/17/1 (70%/30), starting new job
2025-04-02 19:20:03: SobolGenerator, completed/running/pending/unknown 1/2/17/2 (73%/30), started new job
2025-04-02 19:20:03: SobolGenerator, completed/running/pending/unknown 1/2/17/2 (73%/30), starting parameter set
2025-04-02 19:20:03: SobolGenerator, completed/running/pending/unknown 1/2/17/2 (73%/30), starting new job
2025-04-02 19:20:06: SobolGenerator, completed/running/pending/unknown 1/2/19/1 (77%/30), started new job
2025-04-02 19:20:06: SobolGenerator, completed/running/pending/unknown 1/2/19/1 (77%/30), starting parameter set
2025-04-02 19:20:06: SobolGenerator, completed/running/pending/unknown 1/2/19/1 (77%/30), starting new job
2025-04-02 19:20:09: SobolGenerator, completed/running/pending/unknown 1/2/19/2 (80%/30), started new job
2025-04-02 19:20:09: SobolGenerator, completed/running/pending/unknown 1/2/19/2 (80%/30), starting parameter set
2025-04-02 19:20:10: SobolGenerator, completed/running/pending 2/1/21 (80%/30), starting new job
2025-04-02 19:20:12: SobolGenerator, completed/running/pending/unknown 2/1/21/1 (83%/30), started new job
2025-04-02 19:20:12: SobolGenerator, completed/running/pending/unknown 2/1/21/1 (83%/30), starting parameter set
2025-04-02 19:20:13: SobolGenerator, completed/running/pending 2/1/22 (83%/30), starting new job
2025-04-02 19:20:16: SobolGenerator, completed/running/pending/unknown 2/1/22/1 (87%/30), started new job
2025-04-02 19:20:16: SobolGenerator, completed/running/pending/unknown 2/1/22/1 (87%/30), starting parameter set
2025-04-02 19:20:16: SobolGenerator, completed/running/pending/unknown 2/1/22/1 (87%/30), starting new job
2025-04-02 19:20:18: SobolGenerator, completed/running/pending/unknown 2/1/22/2 (90%/30), started new job
2025-04-02 19:20:18: SobolGenerator, completed/running/pending/unknown 2/1/22/2 (90%/30), starting parameter set
2025-04-02 19:20:18: SobolGenerator, completed/running/pending/unknown 2/1/22/2 (90%/30), starting new job
2025-04-02 19:20:20: SobolGenerator, completed/running/pending/unknown 3/2/22/1 (93%/30), started new job
2025-04-02 19:20:20: SobolGenerator, completed/running/pending/unknown 3/2/22/1 (93%/30), starting parameter set
2025-04-02 19:20:21: SobolGenerator, completed/running/pending/unknown 3/2/22/1 (93%/30), starting new job
2025-04-02 19:20:23: SobolGenerator, completed/running/pending/unknown 3/2/22/2 (97%/30), started new job
2025-04-02 19:20:23: SobolGenerator, completed/running/pending/unknown 3/2/22/2 (97%/30), starting parameter set
2025-04-02 19:20:23: SobolGenerator, completed/running/pending/unknown 3/2/22/2 (97%/30), starting new job
2025-04-02 19:20:25: SobolGenerator, completed/running/pending/unknown 3/2/24/1 (100%/30), started new job
2025-04-02 19:20:26: SobolGenerator, completed/running/pending/unknown 3/2/24/1 (100%/30), job_failed
2025-04-02 19:20:28: Failed jobs: 1 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, completed/running/pending/unknown 2/2/24/1 (97%/30), job_failed
2025-04-02 19:20:30: Failed jobs: 2 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, completed/running/pending/unknown 1/2/24/1 (93%/30), job_failed
2025-04-02 19:20:34: Failed jobs: 3 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, running/completed/pending 1/1/25 (90%/30), job_failed
2025-04-02 19:20:50: Failed jobs: 4 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, completed/pending 1/25 (87%/30), finishing jobs after starting them, finished 4 jobs
2025-04-02 19:20:50: Failed jobs: 4 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, completed/pending 1/25 (87%/30), got 30, requested 30
2025-04-02 19:20:50: Failed jobs: 4 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, completed/pending 1/25 (87%/30), job_failed
2025-04-02 19:21:05: Failed jobs: 5 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, running/completed/pending 2/1/22 (83%/30), finishing previous jobs (26), finished 1 job
2025-04-02 19:21:07: Failed jobs: 5 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, running/completed/pending 2/1/22 (83%/30), waiting for old jobs to finish (25 left)
2025-04-02 19:21:13: Failed jobs: 5 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, running/completed/pending 2/1/22 (83%/30), job_failed
2025-04-02 19:21:15: Failed jobs: 6 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, running/completed/pending 1/1/22 (80%/30), job_failed
2025-04-02 19:21:29: Failed jobs: 7 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, running/pending 1/22 (77%/30), waiting for jobs (25 left), finished 2 jobs
2025-04-02 19:21:29: Failed jobs: 7 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, running/pending 1/22 (77%/30), waiting for old jobs to finish (23 left)
2025-04-02 19:21:35: Failed jobs: 7 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, running/pending 1/22 (77%/30), job_failed
2025-04-02 19:21:38: Failed jobs: 8 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, running/completed/pending 1/1/20 (73%/30), job_failed
2025-04-02 19:21:49: Failed jobs: 9 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, running/pending 1/20 (70%/30), waiting for jobs (23 left), finished 2 jobs
2025-04-02 19:21:50: Failed jobs: 9 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, running/pending 1/20 (70%/30), waiting for old jobs to finish (21 left)
2025-04-02 19:21:55: Failed jobs: 9 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, running/pending 1/20 (70%/30), job_failed
2025-04-02 19:21:58: Failed jobs: 10 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 20 (67%/30), job_failed
2025-04-02 19:22:08: Failed jobs: 11 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 19 (63%/30), waiting for jobs (21 left), finished 2 jobs
2025-04-02 19:22:09: Failed jobs: 11 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 19 (63%/30), waiting for old jobs to finish (19 left)
2025-04-02 19:22:22: Failed jobs: 11 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 19 (63%/30), waiting for jobs (19 left), finished 0 jobs
2025-04-02 19:22:23: Failed jobs: 11 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 19 (63%/30), waiting for old jobs to finish (19 left)
2025-04-02 19:22:28: Failed jobs: 11 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 19 (63%/30), job_failed
2025-04-02 19:22:31: Failed jobs: 12 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 18 (60%/30), job_failed
2025-04-02 19:22:44: Failed jobs: 13 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 17 (57%/30), waiting for jobs (19 left), finished 2 jobs
2025-04-02 19:22:44: Failed jobs: 13 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 17 (57%/30), waiting for old jobs to finish (17 left)
2025-04-02 19:22:50: Failed jobs: 13 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, completed/running/failed/pending 1/1/1/14 (57%/30), job_failed
2025-04-02 19:23:08: Failed jobs: 14 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, running/failed/pending 1/1/14 (53%/30), job_failed
2025-04-02 19:23:15: Failed jobs: 15 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, running/pending 1/14 (50%/30), waiting for jobs (17 left), finished 2 jobs
2025-04-02 19:23:16: Failed jobs: 15 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, running/pending 1/14 (50%/30), waiting for old jobs to finish (15 left)
2025-04-02 19:23:21: Failed jobs: 15 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, running/pending 1/14 (50%/30), job_failed
2025-04-02 19:23:31: Failed jobs: 16 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 14 (47%/30), waiting for jobs (15 left), finished 1 job
2025-04-02 19:23:31: Failed jobs: 16 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 14 (47%/30), waiting for old jobs to finish (14 left)
2025-04-02 19:23:37: Failed jobs: 16 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 14 (47%/30), job_failed
2025-04-02 19:23:48: Failed jobs: 17 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 13 (43%/30), waiting for jobs (14 left), finished 1 job
2025-04-02 19:23:48: Failed jobs: 17 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 13 (43%/30), waiting for old jobs to finish (13 left)
2025-04-02 19:23:53: Failed jobs: 17 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 13 (43%/30), job_failed
2025-04-02 19:24:00: Failed jobs: 18 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 12 (40%/30), waiting for jobs (13 left), finished 1 job
2025-04-02 19:24:00: Failed jobs: 18 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 12 (40%/30), waiting for old jobs to finish (12 left)
2025-04-02 19:24:08: Failed jobs: 18 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 12 (40%/30), job_failed
2025-04-02 19:24:16: Failed jobs: 19 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 11 (37%/30), waiting for jobs (12 left), finished 1 job
2025-04-02 19:24:16: Failed jobs: 19 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 11 (37%/30), waiting for old jobs to finish (11 left)
2025-04-02 19:24:22: Failed jobs: 19 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 11 (37%/30), job_failed
2025-04-02 19:24:24: Failed jobs: 20 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 10 (33%/30), job_failed
2025-04-02 19:24:27: Failed jobs: 21 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 9 (30%/30), job_failed
2025-04-02 19:24:31: Failed jobs: 22 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 8 (27%/30), job_failed
2025-04-02 19:24:35: Failed jobs: 23 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 7 (23%/30), job_failed
2025-04-02 19:24:41: Failed jobs: 24 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 6 (20%/30), waiting for jobs (11 left), finished 5 jobs
2025-04-02 19:24:41: Failed jobs: 24 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 6 (20%/30), waiting for old jobs to finish (6 left)
2025-04-02 19:24:47: Failed jobs: 24 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 6 (20%/30), job_failed
2025-04-02 19:24:51: Failed jobs: 25 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 5 (17%/30), waiting for jobs (6 left), finished 1 job
2025-04-02 19:24:51: Failed jobs: 25 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 5 (17%/30), waiting for old jobs to finish (5 left)
2025-04-02 19:25:00: Failed jobs: 25 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 5 (17%/30), job_failed
2025-04-02 19:25:04: Failed jobs: 26 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 4 (13%/30), waiting for jobs (5 left), finished 1 job
2025-04-02 19:25:04: Failed jobs: 26 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 4 (13%/30), waiting for old jobs to finish (4 left)
2025-04-02 19:25:10: Failed jobs: 26 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 4 (13%/30), job_failed
2025-04-02 19:25:12: Failed jobs: 27 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 3 (10%/30), job_failed
2025-04-02 19:25:15: Failed jobs: 28 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 2 (7%/30), waiting for jobs (4 left), finished 2 jobs
2025-04-02 19:25:15: Failed jobs: 28 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 2 (7%/30), waiting for old jobs to finish (2 left)
2025-04-02 19:25:22: Failed jobs: 28 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, completed/running 1/1 (7%/30), job_failed
2025-04-02 19:25:26: Failed jobs: 29 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, running 1 (3%/30), waiting for jobs (2 left), finished 1 job
2025-04-02 19:25:26: Failed jobs: 29 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, running 1 (3%/30), waiting for old jobs to finish (1 left)
2025-04-02 19:25:32: Failed jobs: 29 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, running 1 (3%/30), waiting for jobs (1 left), finished 0 jobs
2025-04-02 19:25:32: Failed jobs: 29 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, running 1 (3%/30), waiting for old jobs to finish (1 left)
2025-04-02 19:25:38: Failed jobs: 29 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, running 1 (3%/30), waiting for jobs (1 left), finished 0 jobs
2025-04-02 19:25:38: Failed jobs: 29 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, running 1 (3%/30), waiting for old jobs to finish (1 left)
2025-04-02 19:25:45: Failed jobs: 29 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, running 1 (3%/30), waiting for jobs (1 left), finished 0 jobs
2025-04-02 19:25:45: Failed jobs: 29 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, running 1 (3%/30), waiting for old jobs to finish (1 left)
2025-04-02 19:25:51: Failed jobs: 29 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, running 1 (3%/30), job_failed
2025-04-02 19:25:55: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, waiting for jobs (1 left), finished 1 job
2025-04-02 19:25:55: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, finished 0 jobs
2025-04-02 19:25:55: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, trying to get 30 next steps (current done: 0, max: 500)
2025-04-02 19:25:56: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, finishing jobs (_get_next_trials), finished 0 jobs
2025-04-02 19:25:56: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #1/30
2025-04-02 19:25:56: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #2/30 | ETA: 11s
2025-04-02 19:25:57: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #3/30 | ETA: 11s
2025-04-02 19:25:57: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #4/30 | ETA: 10s
2025-04-02 19:25:57: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #5/30 | ETA: 10s
2025-04-02 19:25:58: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #6/30 | ETA: 10s
2025-04-02 19:25:58: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #7/30 | ETA: 9s
2025-04-02 19:25:59: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #8/30 | ETA: 9s
2025-04-02 19:25:59: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #9/30 | ETA: 8s
2025-04-02 19:26:00: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #10/30 | ETA: 8s
2025-04-02 19:26:00: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #11/30 | ETA: 8s
2025-04-02 19:26:01: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #12/30 | ETA: 7s
2025-04-02 19:26:01: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #13/30 | ETA: 7s
2025-04-02 19:26:02: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #14/30 | ETA: 7s
2025-04-02 19:26:02: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #15/30 | ETA: 6s
2025-04-02 19:26:03: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #16/30 | ETA: 6s
2025-04-02 19:26:03: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #17/30 | ETA: 6s
2025-04-02 19:26:04: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #18/30 | ETA: 5s
2025-04-02 19:26:04: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #19/30 | ETA: 5s
2025-04-02 19:26:05: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #20/30 | ETA: 4s
2025-04-02 19:26:06: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #21/30 | ETA: 4s
2025-04-02 19:26:06: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #22/30 | ETA: 4s
2025-04-02 19:26:07: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #23/30 | ETA: 3s
2025-04-02 19:26:08: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #24/30 | ETA: 3s
2025-04-02 19:26:09: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #25/30 | ETA: 3s
2025-04-02 19:26:10: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #26/30 | ETA: 2s
2025-04-02 19:26:11: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #27/30 | ETA: 2s
2025-04-02 19:26:11: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #28/30 | ETA: 1s
2025-04-02 19:26:12: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #29/30 | ETA: 1s
2025-04-02 19:26:13: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #30/30 | ETA: 0s
2025-04-02 19:26:14: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, starting parameter set
2025-04-02 19:26:15: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, starting new job
2025-04-02 19:26:17: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, unknown 1 (3%/30), started new job
2025-04-02 19:26:17: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, unknown 1 (3%/30), starting parameter set
2025-04-02 19:26:18: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 1 (3%/30), starting new job
2025-04-02 19:26:21: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 1/1 (7%/30), started new job
2025-04-02 19:26:21: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 1/1 (7%/30), starting parameter set
2025-04-02 19:26:21: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 1/1 (7%/30), starting new job
2025-04-02 19:26:23: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 2/1 (10%/30), started new job
2025-04-02 19:26:23: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 2/1 (10%/30), starting parameter set
2025-04-02 19:26:24: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 2/1 (10%/30), starting new job
2025-04-02 19:26:26: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 2/2 (13%/30), started new job
2025-04-02 19:26:26: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 2/2 (13%/30), starting parameter set
2025-04-02 19:26:26: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 2/2 (13%/30), starting new job
2025-04-02 19:26:28: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 4/1 (17%/30), started new job
2025-04-02 19:26:28: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 4/1 (17%/30), starting parameter set
2025-04-02 19:26:29: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 4/1 (17%/30), starting new job
2025-04-02 19:26:31: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 4/2 (20%/30), started new job
2025-04-02 19:26:31: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 4/2 (20%/30), starting parameter set
2025-04-02 19:26:31: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 4/2 (20%/30), starting new job
2025-04-02 19:26:35: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 6/1 (23%/30), started new job
2025-04-02 19:26:35: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 6/1 (23%/30), starting parameter set
2025-04-02 19:26:36: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 6/1 (23%/30), starting new job
2025-04-02 19:26:38: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 7/1 (27%/30), started new job
2025-04-02 19:26:38: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 7/1 (27%/30), starting parameter set
2025-04-02 19:26:39: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 7/1 (27%/30), starting new job
2025-04-02 19:26:42: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 7/2 (30%/30), started new job
2025-04-02 19:26:42: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 7/2 (30%/30), starting parameter set
2025-04-02 19:26:43: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 9 (30%/30), starting new job
2025-04-02 19:26:45: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 9/1 (33%/30), started new job
2025-04-02 19:26:45: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 9/1 (33%/30), starting parameter set
2025-04-02 19:26:46: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 9/1 (33%/30), starting new job
2025-04-02 19:26:48: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 11 (37%/30), started new job
2025-04-02 19:26:48: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 11 (37%/30), starting parameter set
2025-04-02 19:26:48: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 11 (37%/30), starting new job
2025-04-02 19:26:50: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 11/1 (40%/30), started new job
2025-04-02 19:26:50: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 11/1 (40%/30), starting parameter set
2025-04-02 19:26:51: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 11/1 (40%/30), starting new job
2025-04-02 19:26:53: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 11/2 (43%/30), started new job
2025-04-02 19:26:53: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 11/2 (43%/30), starting parameter set
2025-04-02 19:26:53: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 11/2 (43%/30), starting new job
2025-04-02 19:26:55: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 13/1 (47%/30), started new job
2025-04-02 19:26:55: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 13/1 (47%/30), starting parameter set
2025-04-02 19:26:56: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 13/1 (47%/30), starting new job
2025-04-02 19:26:59: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 14/1 (50%/30), started new job
2025-04-02 19:26:59: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 14/1 (50%/30), starting parameter set
2025-04-02 19:27:00: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 14/1 (50%/30), starting new job
2025-04-02 19:27:02: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 14/2 (53%/30), started new job
2025-04-02 19:27:02: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 14/2 (53%/30), starting parameter set
2025-04-02 19:27:03: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 16 (53%/30), starting new job
2025-04-02 19:27:06: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 16/1 (57%/30), started new job
2025-04-02 19:27:06: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 16/1 (57%/30), starting parameter set
2025-04-02 19:27:07: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 16/1 (57%/30), starting new job
2025-04-02 19:27:09: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 17/1 (60%/30), started new job
2025-04-02 19:27:09: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 17/1 (60%/30), starting parameter set
2025-04-02 19:27:10: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 17/1 (60%/30), starting new job
2025-04-02 19:27:12: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 17/2 (63%/30), started new job
2025-04-02 19:27:12: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 17/2 (63%/30), starting parameter set
2025-04-02 19:27:12: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 17/2 (63%/30), starting new job
2025-04-02 19:27:14: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 19/1 (67%/30), started new job
2025-04-02 19:27:14: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 19/1 (67%/30), starting parameter set
2025-04-02 19:27:15: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 19/1 (67%/30), starting new job
2025-04-02 19:27:17: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 19/2 (70%/30), started new job
2025-04-02 19:27:17: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 19/2 (70%/30), starting parameter set
2025-04-02 19:27:17: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 19/2 (70%/30), starting new job
2025-04-02 19:27:19: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 21/1 (73%/30), started new job
2025-04-02 19:27:19: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 21/1 (73%/30), starting parameter set
2025-04-02 19:27:20: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 21/1 (73%/30), starting new job
2025-04-02 19:27:22: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 21/2 (77%/30), started new job
2025-04-02 19:27:22: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 21/2 (77%/30), starting parameter set
2025-04-02 19:27:23: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 23 (77%/30), starting new job
2025-04-02 19:27:26: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 23/1 (80%/30), started new job
2025-04-02 19:27:26: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 23/1 (80%/30), starting parameter set
2025-04-02 19:27:27: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 23/1 (80%/30), starting new job
2025-04-02 19:27:29: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 23/2 (83%/30), started new job
2025-04-02 19:27:29: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 23/2 (83%/30), starting parameter set
2025-04-02 19:27:30: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 25 (83%/30), starting new job
2025-04-02 19:27:33: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 25/1 (87%/30), started new job
2025-04-02 19:27:33: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 25/1 (87%/30), starting parameter set
2025-04-02 19:27:34: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 25/1 (87%/30), starting new job
2025-04-02 19:27:36: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 26/1 (90%/30), started new job
2025-04-02 19:27:36: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 26/1 (90%/30), starting parameter set
2025-04-02 19:27:36: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 26/1 (90%/30), starting new job
2025-04-02 19:27:38: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 26/2 (93%/30), started new job
2025-04-02 19:27:38: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 26/2 (93%/30), starting parameter set
2025-04-02 19:27:39: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 26/2 (93%/30), starting new job
2025-04-02 19:27:41: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 28/1 (97%/30), started new job
2025-04-02 19:27:41: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 28/1 (97%/30), starting parameter set
2025-04-02 19:27:41: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 28/1 (97%/30), starting new job
2025-04-02 19:27:43: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 28/2 (100%/30), started new job
2025-04-02 19:28:23: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), finishing jobs after starting them, finished 0 jobs
2025-04-02 19:28:23: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), got 30, requested 30
2025-04-02 19:29:02: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), finishing previous jobs (30), finished 0 jobs
2025-04-02 19:29:03: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for old jobs to finish (30 left)
2025-04-02 19:29:46: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for jobs (30 left), finished 0 jobs
2025-04-02 19:29:46: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for old jobs to finish (30 left)
2025-04-02 19:30:28: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for jobs (30 left), finished 0 jobs
2025-04-02 19:30:28: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for old jobs to finish (30 left)
2025-04-02 19:31:13: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for jobs (30 left), finished 0 jobs
2025-04-02 19:31:13: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for old jobs to finish (30 left)
2025-04-02 19:31:53: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for jobs (30 left), finished 0 jobs
2025-04-02 19:31:54: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for old jobs to finish (30 left)
2025-04-02 19:32:38: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for jobs (30 left), finished 0 jobs
2025-04-02 19:32:39: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for old jobs to finish (30 left)
2025-04-02 19:33:19: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for jobs (30 left), finished 0 jobs
2025-04-02 19:33:19: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for old jobs to finish (30 left)
2025-04-02 19:34:04: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for jobs (30 left), finished 0 jobs
2025-04-02 19:34:04: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for old jobs to finish (30 left)
2025-04-02 19:34:45: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for jobs (30 left), finished 0 jobs
2025-04-02 19:34:45: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for old jobs to finish (30 left)
2025-04-02 19:35:30: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for jobs (30 left), finished 0 jobs
2025-04-02 19:35:30: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for old jobs to finish (30 left)
2025-04-02 19:36:10: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for jobs (30 left), finished 0 jobs
2025-04-02 19:36:11: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for old jobs to finish (30 left)
2025-04-02 19:36:55: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for jobs (30 left), finished 0 jobs
2025-04-02 19:36:55: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for old jobs to finish (30 left)
2025-04-02 19:37:36: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for jobs (30 left), finished 0 jobs
2025-04-02 19:37:36: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for old jobs to finish (30 left)
2025-04-02 19:38:21: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for jobs (30 left), finished 0 jobs
2025-04-02 19:38:21: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for old jobs to finish (30 left)
2025-04-02 19:39:02: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for jobs (30 left), finished 0 jobs
2025-04-02 19:39:02: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for old jobs to finish (30 left)
2025-04-02 19:39:47: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for jobs (30 left), finished 0 jobs
2025-04-02 19:39:47: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for old jobs to finish (30 left)
2025-04-02 19:40:27: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for jobs (30 left), finished 0 jobs
2025-04-02 19:40:28: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for old jobs to finish (30 left)
2025-04-02 19:41:12: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for jobs (30 left), finished 0 jobs
2025-04-02 19:41:13: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for old jobs to finish (30 left)
2025-04-02 19:41:54: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for jobs (30 left), finished 0 jobs
2025-04-02 19:41:54: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for old jobs to finish (30 left)
2025-04-02 19:42:38: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for jobs (30 left), finished 0 jobs
2025-04-02 19:42:39: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for old jobs to finish (30 left)
2025-04-02 19:43:19: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for jobs (30 left), finished 0 jobs
2025-04-02 19:43:20: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for old jobs to finish (30 left)
2025-04-02 19:44:04: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for jobs (30 left), finished 0 jobs
2025-04-02 19:44:04: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for old jobs to finish (30 left)
2025-04-02 19:44:45: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for jobs (30 left), finished 0 jobs
2025-04-02 19:44:45: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for old jobs to finish (30 left)
2025-04-02 19:45:30: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for jobs (30 left), finished 0 jobs
2025-04-02 19:45:30: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for old jobs to finish (30 left)
2025-04-02 19:46:10: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for jobs (30 left), finished 0 jobs
2025-04-02 19:46:11: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for old jobs to finish (30 left)
2025-04-02 19:46:55: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for jobs (30 left), finished 0 jobs
2025-04-02 19:46:55: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for old jobs to finish (30 left)
2025-04-02 19:47:01: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), job_failed
2025-04-02 19:47:04: Failed jobs: 31 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 29 (97%/30), job_failed
2025-04-02 19:47:39: Failed jobs: 32 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 28 (93%/30), waiting for jobs (30 left), finished 2 jobs
2025-04-02 19:47:40: Failed jobs: 32 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 28 (93%/30), waiting for old jobs to finish (28 left)
2025-04-02 19:47:45: Failed jobs: 32 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 28 (93%/30), job_failed
2025-04-02 19:47:48: Failed jobs: 33 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 27 (90%/30), job_failed
2025-04-02 19:48:23: Failed jobs: 34 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 26 (87%/30), waiting for jobs (28 left), finished 2 jobs
2025-04-02 19:48:23: Failed jobs: 34 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 26 (87%/30), waiting for old jobs to finish (26 left)
2025-04-02 19:48:29: Failed jobs: 34 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 26 (87%/30), job_failed
2025-04-02 19:48:32: Failed jobs: 35 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 25 (83%/30), job_failed
2025-04-02 19:48:35: Failed jobs: 36 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 24 (80%/30), job_failed
2025-04-02 19:48:38: Failed jobs: 37 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 23 (77%/30), job_failed
2025-04-02 19:48:41: Failed jobs: 38 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 22 (73%/30), job_failed
2025-04-02 19:48:46: Failed jobs: 39 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 21 (70%/30), job_failed
2025-04-02 19:48:53: Failed jobs: 40 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 20 (67%/30), job_failed
2025-04-02 19:49:15: Failed jobs: 41 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 19 (63%/30), waiting for jobs (26 left), finished 7 jobs
2025-04-02 19:49:15: Failed jobs: 41 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 19 (63%/30), waiting for old jobs to finish (19 left)
2025-04-02 19:49:21: Failed jobs: 41 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 19 (63%/30), job_failed
2025-04-02 19:49:26: Failed jobs: 42 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 18 (60%/30), job_failed
2025-04-02 19:49:31: Failed jobs: 43 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 17 (57%/30), job_failed
2025-04-02 19:49:36: Failed jobs: 44 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 16 (53%/30), job_failed
2025-04-02 19:49:40: Failed jobs: 45 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 15 (50%/30), job_failed
2025-04-02 19:49:44: Failed jobs: 46 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 14 (47%/30), job_failed
2025-04-02 19:50:01: Failed jobs: 47 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 13 (43%/30), waiting for jobs (19 left), finished 6 jobs
2025-04-02 19:50:02: Failed jobs: 47 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 13 (43%/30), waiting for old jobs to finish (13 left)
2025-04-02 19:50:07: Failed jobs: 47 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 13 (43%/30), job_failed
2025-04-02 19:50:12: Failed jobs: 48 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 12 (40%/30), job_failed
2025-04-02 19:50:17: Failed jobs: 49 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 11 (37%/30), job_failed
2025-04-02 19:50:30: Failed jobs: 50 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 10 (33%/30), waiting for jobs (13 left), finished 3 jobs
2025-04-02 19:50:30: Failed jobs: 50 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 10 (33%/30), waiting for old jobs to finish (10 left)
2025-04-02 19:50:36: Failed jobs: 50 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 10 (33%/30), job_failed
2025-04-02 19:50:41: Failed jobs: 51 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 9 (30%/30), job_failed
2025-04-02 19:50:47: Failed jobs: 52 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 8 (27%/30), job_failed
2025-04-02 19:51:00: Failed jobs: 53 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 7 (23%/30), waiting for jobs (10 left), finished 3 jobs
2025-04-02 19:51:00: Failed jobs: 53 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 7 (23%/30), waiting for old jobs to finish (7 left)
2025-04-02 19:51:08: Failed jobs: 53 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 7 (23%/30), job_failed
2025-04-02 19:51:16: Failed jobs: 54 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 6 (20%/30), waiting for jobs (7 left), finished 1 job
2025-04-02 19:51:17: Failed jobs: 54 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 6 (20%/30), waiting for old jobs to finish (6 left)
2025-04-02 19:51:27: Failed jobs: 54 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 6 (20%/30), job_failed
2025-04-02 19:51:31: Failed jobs: 55 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 5 (17%/30), job_failed
2025-04-02 19:51:36: Failed jobs: 56 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 4 (13%/30), waiting for jobs (6 left), finished 2 jobs
2025-04-02 19:51:36: Failed jobs: 56 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 4 (13%/30), waiting for old jobs to finish (4 left)
2025-04-02 19:51:46: Failed jobs: 56 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 4 (13%/30), waiting for jobs (4 left), finished 0 jobs
2025-04-02 19:51:46: Failed jobs: 56 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 4 (13%/30), waiting for old jobs to finish (4 left)
2025-04-02 19:51:56: Failed jobs: 56 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 4 (13%/30), job_failed
2025-04-02 19:52:02: Failed jobs: 57 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 3 (10%/30), waiting for jobs (4 left), finished 1 job
2025-04-02 19:52:03: Failed jobs: 57 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 3 (10%/30), waiting for old jobs to finish (3 left)
2025-04-02 19:52:12: Failed jobs: 57 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 3 (10%/30), waiting for jobs (3 left), finished 0 jobs
2025-04-02 19:52:12: Failed jobs: 57 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 3 (10%/30), waiting for old jobs to finish (3 left)
2025-04-02 19:52:21: Failed jobs: 57 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 3 (10%/30), waiting for jobs (3 left), finished 0 jobs
2025-04-02 19:52:21: Failed jobs: 57 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 3 (10%/30), waiting for old jobs to finish (3 left)
2025-04-02 19:52:32: Failed jobs: 57 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 3 (10%/30), waiting for jobs (3 left), finished 0 jobs
2025-04-02 19:52:32: Failed jobs: 57 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 3 (10%/30), waiting for old jobs to finish (3 left)
2025-04-02 19:52:43: Failed jobs: 57 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 3 (10%/30), waiting for jobs (3 left), finished 0 jobs
2025-04-02 19:52:44: Failed jobs: 57 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 3 (10%/30), waiting for old jobs to finish (3 left)
2025-04-02 19:52:52: Failed jobs: 57 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 3 (10%/30), waiting for jobs (3 left), finished 0 jobs
2025-04-02 19:52:52: Failed jobs: 57 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 3 (10%/30), waiting for old jobs to finish (3 left)
2025-04-02 19:53:02: Failed jobs: 57 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 3 (10%/30), waiting for jobs (3 left), finished 0 jobs
2025-04-02 19:53:02: Failed jobs: 57 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 3 (10%/30), waiting for old jobs to finish (3 left)
2025-04-02 19:53:14: Failed jobs: 57 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 3 (10%/30), waiting for jobs (3 left), finished 0 jobs
2025-04-02 19:53:14: Failed jobs: 57 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 3 (10%/30), waiting for old jobs to finish (3 left)
2025-04-02 19:53:23: Failed jobs: 57 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 3 (10%/30), waiting for jobs (3 left), finished 0 jobs
2025-04-02 19:53:23: Failed jobs: 57 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 3 (10%/30), waiting for old jobs to finish (3 left)
2025-04-02 19:53:32: Failed jobs: 57 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 3 (10%/30), waiting for jobs (3 left), finished 0 jobs
2025-04-02 19:53:32: Failed jobs: 57 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 3 (10%/30), waiting for old jobs to finish (3 left)
2025-04-02 19:53:44: Failed jobs: 57 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 3 (10%/30), waiting for jobs (3 left), finished 0 jobs
2025-04-02 19:53:44: Failed jobs: 57 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 3 (10%/30), waiting for old jobs to finish (3 left)
2025-04-02 19:53:54: Failed jobs: 57 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 3 (10%/30), waiting for jobs (3 left), finished 0 jobs
2025-04-02 19:53:54: Failed jobs: 57 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 3 (10%/30), waiting for old jobs to finish (3 left)
2025-04-02 19:54:03: Failed jobs: 57 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 3 (10%/30), waiting for jobs (3 left), finished 0 jobs
2025-04-02 19:54:03: Failed jobs: 57 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 3 (10%/30), waiting for old jobs to finish (3 left)
2025-04-02 19:54:14: Failed jobs: 57 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 3 (10%/30), waiting for jobs (3 left), finished 0 jobs
2025-04-02 19:54:14: Failed jobs: 57 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 3 (10%/30), waiting for old jobs to finish (3 left)
2025-04-02 19:54:25: Failed jobs: 57 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 3 (10%/30), waiting for jobs (3 left), finished 0 jobs
2025-04-02 19:54:25: Failed jobs: 57 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 3 (10%/30), waiting for old jobs to finish (3 left)
2025-04-02 19:54:34: Failed jobs: 57 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 3 (10%/30), waiting for jobs (3 left), finished 0 jobs
2025-04-02 19:54:34: Failed jobs: 57 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 3 (10%/30), waiting for old jobs to finish (3 left)
2025-04-02 19:54:44: Failed jobs: 57 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 3 (10%/30), waiting for jobs (3 left), finished 0 jobs
2025-04-02 19:54:44: Failed jobs: 57 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 3 (10%/30), waiting for old jobs to finish (3 left)
2025-04-02 19:54:56: Failed jobs: 57 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 3 (10%/30), waiting for jobs (3 left), finished 0 jobs
2025-04-02 19:54:56: Failed jobs: 57 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 3 (10%/30), waiting for old jobs to finish (3 left)
2025-04-02 19:55:05: Failed jobs: 57 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 3 (10%/30), waiting for jobs (3 left), finished 0 jobs
2025-04-02 19:55:05: Failed jobs: 57 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 3 (10%/30), waiting for old jobs to finish (3 left)
2025-04-02 19:55:14: Failed jobs: 57 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, failed 3 (10%/30), waiting for jobs (3 left), finished 0 jobs
2025-04-02 19:55:15: Failed jobs: 57 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, failed 3 (10%/30), waiting for old jobs to finish (3 left)
2025-04-02 19:55:36: Failed jobs: 57 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, failed 3 (10%/30), job_failed
2025-04-02 19:55:54: Failed jobs: 58 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, failed 2 (7%/30), job_failed
2025-04-02 19:56:13: Failed jobs: 59 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, failed 1 (3%/30), job_failed
2025-04-02 19:56:17: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, waiting for jobs (3 left), finished 3 jobs
2025-04-02 19:56:18: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, finished 0 jobs
2025-04-02 19:56:18: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, trying to get 30 next steps (current done: 0, max: 500)
2025-04-02 19:56:19: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, finishing jobs (_get_next_trials), finished 0 jobs
2025-04-02 19:56:19: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #1/30
2025-04-02 19:56:19: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #2/30 | ETA: 12s
2025-04-02 19:56:20: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #3/30 | ETA: 12s
2025-04-02 19:56:20: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #4/30 | ETA: 11s
2025-04-02 19:56:21: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #5/30 | ETA: 11s
2025-04-02 19:56:22: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #6/30 | ETA: 12s
2025-04-02 19:56:23: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #7/30 | ETA: 14s
2025-04-02 19:56:23: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #8/30 | ETA: 14s
2025-04-02 19:56:24: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #9/30 | ETA: 14s
2025-04-02 19:56:25: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #10/30 | ETA: 13s
2025-04-02 19:56:26: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #11/30 | ETA: 13s
2025-04-02 19:56:27: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #12/30 | ETA: 13s
2025-04-02 19:56:28: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #13/30 | ETA: 12s
2025-04-02 19:56:29: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #14/30 | ETA: 11s
2025-04-02 19:56:30: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #15/30 | ETA: 11s
2025-04-02 19:56:30: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #16/30 | ETA: 10s
2025-04-02 19:56:31: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #17/30 | ETA: 10s
2025-04-02 19:56:32: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #18/30 | ETA: 9s
2025-04-02 19:56:33: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #19/30 | ETA: 8s
2025-04-02 19:56:34: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #20/30 | ETA: 8s
2025-04-02 19:56:35: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #21/30 | ETA: 7s
2025-04-02 19:56:36: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #22/30 | ETA: 6s
2025-04-02 19:56:37: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #23/30 | ETA: 6s
2025-04-02 19:56:38: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #24/30 | ETA: 5s
2025-04-02 19:56:39: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #25/30 | ETA: 4s
2025-04-02 19:56:40: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #26/30 | ETA: 3s
2025-04-02 19:56:41: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #27/30 | ETA: 3s
2025-04-02 19:56:41: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #28/30 | ETA: 2s
2025-04-02 19:56:42: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #29/30 | ETA: 1s
2025-04-02 19:56:43: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #30/30 | ETA: 0s
2025-04-02 19:56:44: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, starting parameter set
2025-04-02 19:56:44: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, starting new job
2025-04-02 19:56:46: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, unknown 1 (3%/30), started new job
2025-04-02 19:56:46: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, unknown 1 (3%/30), starting parameter set
2025-04-02 19:56:47: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, unknown 1 (3%/30), starting new job
2025-04-02 19:56:49: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 1/1 (7%/30), started new job
2025-04-02 19:56:49: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 1/1 (7%/30), starting parameter set
2025-04-02 19:56:49: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 1/1 (7%/30), starting new job
2025-04-02 19:56:51: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 1/2 (10%/30), started new job
2025-04-02 19:56:51: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 1/2 (10%/30), starting parameter set
2025-04-02 19:56:52: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 1/2 (10%/30), starting new job
2025-04-02 19:56:54: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 3/1 (13%/30), started new job
2025-04-02 19:56:54: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 3/1 (13%/30), starting parameter set
2025-04-02 19:56:54: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 3/1 (13%/30), starting new job
2025-04-02 19:56:56: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 3/2 (17%/30), started new job
2025-04-02 19:56:56: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 3/2 (17%/30), starting parameter set
2025-04-02 19:56:56: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 3/2 (17%/30), starting new job
2025-04-02 19:56:59: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 5/1 (20%/30), started new job
2025-04-02 19:56:59: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 5/1 (20%/30), starting parameter set
2025-04-02 19:56:59: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 5/1 (20%/30), starting new job
2025-04-02 19:57:01: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 5/2 (23%/30), started new job
2025-04-02 19:57:01: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 5/2 (23%/30), starting parameter set
2025-04-02 19:57:02: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 7 (23%/30), starting new job
2025-04-02 19:57:05: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 7/1 (27%/30), started new job
2025-04-02 19:57:05: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 7/1 (27%/30), starting parameter set
2025-04-02 19:57:06: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 7/1 (27%/30), starting new job
2025-04-02 19:57:08: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 8/1 (30%/30), started new job
2025-04-02 19:57:08: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 8/1 (30%/30), starting parameter set
2025-04-02 19:57:10: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 8/1 (30%/30), starting new job
2025-04-02 19:57:12: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 8/2 (33%/30), started new job
2025-04-02 19:57:12: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 8/2 (33%/30), starting parameter set
2025-04-02 19:57:13: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 10 (33%/30), starting new job
2025-04-02 19:57:16: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 10/1 (37%/30), started new job
2025-04-02 19:57:16: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 10/1 (37%/30), starting parameter set
2025-04-02 19:57:17: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 11 (37%/30), starting new job
2025-04-02 19:57:19: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 11/1 (40%/30), started new job
2025-04-02 19:57:19: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 11/1 (40%/30), starting parameter set
2025-04-02 19:57:20: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 11/1 (40%/30), starting new job
2025-04-02 19:57:22: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 11/2 (43%/30), started new job
2025-04-02 19:57:22: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 11/2 (43%/30), starting parameter set
2025-04-02 19:57:22: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 11/2 (43%/30), starting new job
2025-04-02 19:57:24: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 13/1 (47%/30), started new job
2025-04-02 19:57:24: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 13/1 (47%/30), starting parameter set
2025-04-02 19:57:25: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 13/1 (47%/30), starting new job
2025-04-02 19:57:28: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 13/2 (50%/30), started new job
2025-04-02 19:57:28: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 13/2 (50%/30), starting parameter set
2025-04-02 19:57:28: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 13/2 (50%/30), starting new job
2025-04-02 19:57:30: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 14/2 (53%/30), started new job
2025-04-02 19:57:30: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 14/2 (53%/30), starting parameter set
2025-04-02 19:57:31: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 14/2 (53%/30), starting new job
2025-04-02 19:57:34: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 16/1 (57%/30), started new job
2025-04-02 19:57:34: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 16/1 (57%/30), starting parameter set
2025-04-02 19:57:34: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 16/1 (57%/30), starting new job
2025-04-02 19:57:36: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 16/2 (60%/30), started new job
2025-04-02 19:57:36: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 16/2 (60%/30), starting parameter set
2025-04-02 19:57:37: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 16/2 (60%/30), starting new job
2025-04-02 19:57:39: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 18/1 (63%/30), started new job
2025-04-02 19:57:39: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 18/1 (63%/30), starting parameter set
2025-04-02 19:57:40: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 18/1 (63%/30), starting new job
2025-04-02 19:57:42: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 18/2 (67%/30), started new job
2025-04-02 19:57:42: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 18/2 (67%/30), starting parameter set
2025-04-02 19:57:43: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 20 (67%/30), starting new job
2025-04-02 19:57:46: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 20/1 (70%/30), started new job
2025-04-02 19:57:46: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 20/1 (70%/30), starting parameter set
2025-04-02 19:57:47: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 20/1 (70%/30), starting new job
2025-04-02 19:57:49: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 21/1 (73%/30), started new job
2025-04-02 19:57:49: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 21/1 (73%/30), starting parameter set
2025-04-02 19:57:50: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 21/1 (73%/30), starting new job
2025-04-02 19:57:53: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 21/2 (77%/30), started new job
2025-04-02 19:57:53: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 21/2 (77%/30), starting parameter set
2025-04-02 19:57:54: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 23 (77%/30), starting new job
2025-04-02 19:57:56: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 23/1 (80%/30), started new job
2025-04-02 19:57:56: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 23/1 (80%/30), starting parameter set
2025-04-02 19:57:57: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 23/1 (80%/30), starting new job
2025-04-02 19:57:59: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 23/2 (83%/30), started new job
2025-04-02 19:57:59: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 23/2 (83%/30), starting parameter set
2025-04-02 19:57:59: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 23/2 (83%/30), starting new job
2025-04-02 19:58:01: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 24/2 (87%/30), started new job
2025-04-02 19:58:01: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 24/2 (87%/30), starting parameter set
2025-04-02 19:58:01: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 24/2 (87%/30), starting new job
2025-04-02 19:58:03: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 26/1 (90%/30), started new job
2025-04-02 19:58:04: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 26/1 (90%/30), starting parameter set
2025-04-02 19:58:04: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 26/1 (90%/30), starting new job
2025-04-02 19:58:06: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 26/2 (93%/30), started new job
2025-04-02 19:58:06: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 26/2 (93%/30), starting parameter set
2025-04-02 19:58:06: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 26/2 (93%/30), starting new job
2025-04-02 19:58:08: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 26/3 (97%/30), started new job
2025-04-02 19:58:09: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 26/3 (97%/30), starting parameter set
2025-04-02 19:58:09: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 26/3 (97%/30), starting new job
2025-04-02 19:58:11: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 28/2 (100%/30), started new job
2025-04-02 19:59:23: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), finishing jobs after starting them, finished 0 jobs
2025-04-02 19:59:23: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), got 30, requested 30
2025-04-02 20:00:34: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), finishing previous jobs (30), finished 0 jobs
2025-04-02 20:00:35: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for old jobs to finish (30 left)
2025-04-02 20:01:41: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for jobs (30 left), finished 0 jobs
2025-04-02 20:01:42: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for old jobs to finish (30 left)
2025-04-02 20:02:55: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for jobs (30 left), finished 0 jobs
2025-04-02 20:02:55: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for old jobs to finish (30 left)
2025-04-02 20:04:05: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for jobs (30 left), finished 0 jobs
2025-04-02 20:04:06: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for old jobs to finish (30 left)
2025-04-02 20:05:20: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for jobs (30 left), finished 0 jobs
2025-04-02 20:05:20: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for old jobs to finish (30 left)
2025-04-02 20:06:35: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for jobs (30 left), finished 0 jobs
2025-04-02 20:06:35: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for old jobs to finish (30 left)
2025-04-02 20:07:40: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for jobs (30 left), finished 0 jobs
2025-04-02 20:07:41: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for old jobs to finish (30 left)
2025-04-02 20:08:54: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for jobs (30 left), finished 0 jobs
2025-04-02 20:08:55: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for old jobs to finish (30 left)
2025-04-02 20:10:08: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for jobs (30 left), finished 0 jobs
2025-04-02 20:10:08: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for old jobs to finish (30 left)
2025-04-02 20:11:14: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for jobs (30 left), finished 0 jobs
2025-04-02 20:11:14: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for old jobs to finish (30 left)
2025-04-02 20:12:30: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for jobs (30 left), finished 0 jobs
2025-04-02 20:12:30: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for old jobs to finish (30 left)
2025-04-02 20:13:36: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for jobs (30 left), finished 0 jobs
2025-04-02 20:13:36: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for old jobs to finish (30 left)
2025-04-02 20:14:52: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for jobs (30 left), finished 0 jobs
2025-04-02 20:14:52: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for old jobs to finish (30 left)
2025-04-02 20:16:03: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for jobs (30 left), finished 0 jobs
2025-04-02 20:16:04: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for old jobs to finish (30 left)
2025-04-02 20:17:10: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for jobs (30 left), finished 0 jobs
2025-04-02 20:17:10: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for old jobs to finish (30 left)
2025-04-02 20:18:25: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for jobs (30 left), finished 0 jobs
2025-04-02 20:18:26: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for old jobs to finish (30 left)
2025-04-02 20:19:41: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for jobs (30 left), finished 0 jobs
2025-04-02 20:19:41: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for old jobs to finish (30 left)
2025-04-02 20:20:58: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for jobs (30 left), finished 0 jobs
2025-04-02 20:20:58: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for old jobs to finish (30 left)
2025-04-02 20:22:12: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for jobs (30 left), finished 0 jobs
2025-04-02 20:22:12: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for old jobs to finish (30 left)
2025-04-02 20:23:28: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for jobs (30 left), finished 0 jobs
2025-04-02 20:23:28: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for old jobs to finish (30 left)
2025-04-02 20:24:43: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for jobs (30 left), finished 0 jobs
2025-04-02 20:24:43: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for old jobs to finish (30 left)
2025-04-02 20:25:48: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for jobs (30 left), finished 0 jobs
2025-04-02 20:25:49: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for old jobs to finish (30 left)
2025-04-02 20:27:04: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for jobs (30 left), finished 0 jobs
2025-04-02 20:27:05: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for old jobs to finish (30 left)
2025-04-02 20:28:18: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for jobs (30 left), finished 0 jobs
2025-04-02 20:28:19: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for old jobs to finish (30 left)
2025-04-02 20:29:24: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for jobs (30 left), finished 0 jobs
2025-04-02 20:29:24: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for old jobs to finish (30 left)
2025-04-02 20:30:39: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for jobs (30 left), finished 0 jobs
2025-04-02 20:30:39: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for old jobs to finish (30 left)
2025-04-02 20:31:55: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for jobs (30 left), finished 0 jobs
2025-04-02 20:31:55: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for old jobs to finish (30 left)
2025-04-02 20:33:10: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for jobs (30 left), finished 0 jobs
2025-04-02 20:33:10: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for old jobs to finish (30 left)
2025-04-02 20:34:26: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for jobs (30 left), finished 0 jobs
2025-04-02 20:34:26: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for old jobs to finish (30 left)
2025-04-02 20:35:42: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for jobs (30 left), finished 0 jobs
2025-04-02 20:35:42: Failed jobs: 60 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for old jobs to finish (30 left)
Main-Log
Debug-Logs
Single Logs