2025-04-02 18:44:15: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for old jobs to finish (30 left)
⚠ Job 16301516 (task: 0) with path /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301516/16301516_0_result.pkl
has not produced any output (state: FAILED)
No error stream produced. Look at stdout: /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301516/16301516_0_log.out
----------------------------------------
Traceback (most recent call last):
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/runpy.py", line 86, in _run_code
exec(code, run_globals)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/_submit.py", line 11, in <module>
submitit_main()
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/submission.py", line 73, in submitit_main
parser = argparse.ArgumentParser(description="Run a job")
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/argparse.py", line 1728, in __init__
self._positionals = add_group(_('positional arguments'))
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/gettext.py", line 742, in gettext
return dgettext(_current_domain, message)
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/gettext.py", line 666, in dgettext
t = translation(domain, _localedirs.get(domain, None))
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/gettext.py", line 587, in translation
mofiles = find(domain, localedir, languages, all=True)
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/gettext.py", line 558, in find
for nelang in _expand_lang(lang):
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/gettext.py", line 212, in _expand_lang
import locale
File "<frozen importlib._bootstrap>", line 1027, in _find_and_load
File "<frozen importlib._bootstrap>", line 1002, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 945, in _find_spec
File "<frozen importlib._bootstrap_external>", line 1439, in find_spec
File "<frozen importlib._bootstrap_external>", line 1411, in _get_spec
File "<frozen importlib._bootstrap_external>", line 1577, in find_spec
File "<frozen importlib._bootstrap_external>", line 161, in _path_isfile
File "<frozen importlib._bootstrap_external>", line 153, in _path_is_mode_type
File "<frozen importlib._bootstrap_external>", line 147, in _path_stat
KeyboardInterrupt
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301516/16301516_0_log.err not found
⚠ Job 16301519 (task: 0) with path /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301519/16301519_0_result.pkl
has not produced any output (state: FAILED)
No error stream produced. Look at stdout: /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301519/16301519_0_log.out
----------------------------------------
submitit INFO (2025-04-02 18:32:02,833) - Starting with JobEnvironment(job_id=16301519, hostname=n1708, local_rank=0(1), node=0(1), global_rank=0(1))
submitit INFO (2025-04-02 18:32:02,838) - Loading pickle: /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301519/16301519_submitted.pkl
Traceback (most recent call last):
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/runpy.py", line 86, in _run_code
exec(code, run_globals)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/_submit.py", line 11, in <module>
submitit_main()
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/submission.py", line 76, in submitit_main
process_job(args.folder)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/submission.py", line 52, in process_job
delayed = utils.DelayedSubmission.load(paths.submitted_pickle)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/utils.py", line 153, in load
obj = pickle_load(filepath)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/utils.py", line 232, in pickle_load
return pickle.load(ifile)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/cloudpickle/cloudpickle.py", line 469, in subimport
__import__(name)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/torch/__init__.py", line 405, in <module>
from torch._C import * # noqa: F403
File "<frozen importlib._bootstrap>", line 216, in _lock_unlock_module
KeyboardInterrupt
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301519/16301519_0_log.err not found
⚠ Job 16301522 (task: 0) with path /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301522/16301522_0_result.pkl
has not produced any output (state: FAILED)
No error stream produced. Look at stdout: /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301522/16301522_0_log.out
----------------------------------------
submitit INFO (2025-04-02 18:32:02,826) - Starting with JobEnvironment(job_id=16301522, hostname=n1708, local_rank=0(1), node=0(1), global_rank=0(1))
submitit INFO (2025-04-02 18:32:02,860) - Loading pickle: /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301522/16301522_submitted.pkl
Traceback (most recent call last):
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/runpy.py", line 86, in _run_code
exec(code, run_globals)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/_submit.py", line 11, in <module>
submitit_main()
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/submission.py", line 76, in submitit_main
process_job(args.folder)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/submission.py", line 52, in process_job
delayed = utils.DelayedSubmission.load(paths.submitted_pickle)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/utils.py", line 153, in load
obj = pickle_load(filepath)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/utils.py", line 232, in pickle_load
return pickle.load(ifile)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/cloudpickle/cloudpickle.py", line 469, in subimport
__import__(name)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/torch/__init__.py", line 405, in <module>
from torch._C import * # noqa: F403
File "<frozen importlib._bootstrap>", line 216, in _lock_unlock_module
KeyboardInterrupt
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301522/16301522_0_log.err not found
⚠ Job 16301525 (task: 0) with path /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301525/16301525_0_result.pkl
has not produced any output (state: FAILED)
No error stream produced. Look at stdout: /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301525/16301525_0_log.out
----------------------------------------
submitit INFO (2025-04-02 18:32:02,834) - Starting with JobEnvironment(job_id=16301525, hostname=n1708, local_rank=0(1), node=0(1), global_rank=0(1))
submitit INFO (2025-04-02 18:32:02,839) - Loading pickle: /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301525/16301525_submitted.pkl
Traceback (most recent call last):
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/runpy.py", line 86, in _run_code
exec(code, run_globals)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/_submit.py", line 11, in <module>
submitit_main()
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/submission.py", line 76, in submitit_main
process_job(args.folder)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/submission.py", line 52, in process_job
delayed = utils.DelayedSubmission.load(paths.submitted_pickle)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/utils.py", line 153, in load
obj = pickle_load(filepath)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/utils.py", line 232, in pickle_load
return pickle.load(ifile)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/cloudpickle/cloudpickle.py", line 469, in subimport
__import__(name)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/torch/__init__.py", line 405, in <module>
from torch._C import * # noqa: F403
File "<frozen importlib._bootstrap>", line 216, in _lock_unlock_module
KeyboardInterrupt
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301525/16301525_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301529/16301529_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301531/16301531_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301534/16301534_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301536/16301536_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301538/16301538_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301539/16301539_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301543/16301543_0_log.err not found
⚠ Job 16301547 (task: 0) with path /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301547/16301547_0_result.pkl
has not produced any output (state: FAILED)
No error stream produced. Look at stdout: /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301547/16301547_0_log.out
----------------------------------------
submitit INFO (2025-04-02 18:33:33,325) - Starting with JobEnvironment(job_id=16301547, hostname=n1708, local_rank=0(1), node=0(1), global_rank=0(1))
submitit INFO (2025-04-02 18:33:33,344) - Loading pickle: /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301547/16301547_submitted.pkl
Traceback (most recent call last):
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/runpy.py", line 86, in _run_code
exec(code, run_globals)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/_submit.py", line 11, in <module>
submitit_main()
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/submission.py", line 76, in submitit_main
process_job(args.folder)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/submission.py", line 52, in process_job
delayed = utils.DelayedSubmission.load(paths.submitted_pickle)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/utils.py", line 153, in load
obj = pickle_load(filepath)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/utils.py", line 232, in pickle_load
return pickle.load(ifile)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/cloudpickle/cloudpickle.py", line 469, in subimport
__import__(name)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/matplotlib/__init__.py", line 161, in <module>
from . import _api, _version, cbook, _docstring, rcsetup
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/matplotlib/rcsetup.py", line 28, in <module>
from matplotlib.colors import Colormap, is_color_like
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/matplotlib/colors.py", line 52, in <module>
from PIL import Image
File "<frozen importlib._bootstrap>", line 1027, in _find_and_load
File "<frozen importlib._bootstrap>", line 1006, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 688, in _load_unlocked
File "<frozen importlib._bootstrap_external>", line 879, in exec_module
File "<frozen importlib._bootstrap_external>", line 1012, in get_code
File "<frozen importlib._bootstrap_external>", line 672, in _compile_bytecode
KeyboardInterrupt
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301547/16301547_0_log.err not found
⚠ Job 16301552 (task: 0) with path /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301552/16301552_0_result.pkl
has not produced any output (state: FAILED)
No error stream produced. Look at stdout: /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301552/16301552_0_log.out
----------------------------------------
submitit INFO (2025-04-02 18:33:33,326) - Starting with JobEnvironment(job_id=16301552, hostname=n1708, local_rank=0(1), node=0(1), global_rank=0(1))
submitit INFO (2025-04-02 18:33:33,343) - Loading pickle: /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301552/16301552_submitted.pkl
Traceback (most recent call last):
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/runpy.py", line 86, in _run_code
exec(code, run_globals)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/_submit.py", line 11, in <module>
submitit_main()
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/submission.py", line 76, in submitit_main
process_job(args.folder)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/submission.py", line 52, in process_job
delayed = utils.DelayedSubmission.load(paths.submitted_pickle)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/utils.py", line 153, in load
obj = pickle_load(filepath)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/utils.py", line 232, in pickle_load
return pickle.load(ifile)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/cloudpickle/cloudpickle.py", line 469, in subimport
__import__(name)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/matplotlib/__init__.py", line 161, in <module>
from . import _api, _version, cbook, _docstring, rcsetup
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/matplotlib/rcsetup.py", line 28, in <module>
from matplotlib.colors import Colormap, is_color_like
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/matplotlib/colors.py", line 52, in <module>
from PIL import Image
File "<frozen importlib._bootstrap>", line 1027, in _find_and_load
File "<frozen importlib._bootstrap>", line 1006, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 688, in _load_unlocked
File "<frozen importlib._bootstrap_external>", line 879, in exec_module
File "<frozen importlib._bootstrap_external>", line 1012, in get_code
File "<frozen importlib._bootstrap_external>", line 672, in _compile_bytecode
KeyboardInterrupt
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301552/16301552_0_log.err not found
⚠ Job 16301556 (task: 0) with path /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301556/16301556_0_result.pkl
has not produced any output (state: FAILED)
No error stream produced. Look at stdout: /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301556/16301556_0_log.out
----------------------------------------
submitit INFO (2025-04-02 18:33:33,325) - Starting with JobEnvironment(job_id=16301556, hostname=n1708, local_rank=0(1), node=0(1), global_rank=0(1))
submitit INFO (2025-04-02 18:33:33,357) - Loading pickle: /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301556/16301556_submitted.pkl
Traceback (most recent call last):
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/runpy.py", line 86, in _run_code
exec(code, run_globals)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/_submit.py", line 11, in <module>
submitit_main()
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/submission.py", line 76, in submitit_main
process_job(args.folder)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/submission.py", line 52, in process_job
delayed = utils.DelayedSubmission.load(paths.submitted_pickle)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/utils.py", line 153, in load
obj = pickle_load(filepath)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/utils.py", line 232, in pickle_load
return pickle.load(ifile)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/cloudpickle/cloudpickle.py", line 469, in subimport
__import__(name)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/matplotlib/__init__.py", line 161, in <module>
from . import _api, _version, cbook, _docstring, rcsetup
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/matplotlib/rcsetup.py", line 28, in <module>
from matplotlib.colors import Colormap, is_color_like
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/matplotlib/colors.py", line 52, in <module>
from PIL import Image
File "<frozen importlib._bootstrap>", line 1027, in _find_and_load
File "<frozen importlib._bootstrap>", line 1006, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 688, in _load_unlocked
File "<frozen importlib._bootstrap_external>", line 879, in exec_module
File "<frozen importlib._bootstrap_external>", line 1012, in get_code
File "<frozen importlib._bootstrap_external>", line 672, in _compile_bytecode
KeyboardInterrupt
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301556/16301556_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301559/16301559_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301563/16301563_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301565/16301565_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301568/16301568_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301571/16301571_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301573/16301573_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301575/16301575_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301578/16301578_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301581/16301581_0_log.err not found
⚠ Job 16301585 (task: 0) with path /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301585/16301585_0_result.pkl
has not produced any output (state: FAILED)
No error stream produced. Look at stdout: /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301585/16301585_0_log.out
----------------------------------------
Traceback (most recent call last):
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/runpy.py", line 86, in _run_code
exec(code, run_globals)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/_submit.py", line 11, in <module>
submitit_main()
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/submission.py", line 76, in submitit_main
process_job(args.folder)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/submission.py", line 37, in process_job
env = job_environment.JobEnvironment()
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/job_environment.py", line 44, in __new__
return plugins.get_job_environment()
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/plugins.py", line 71, in get_job_environment
envs = get_job_environments()
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/plugins.py", line 88, in get_job_environments
return {env.name(): env for env in _get_plugins()1]}
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/plugins.py", line 24, in _get_plugins
import pkg_resources
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/pkg_resources/__init__.py", line 77, in <module>
__import__('pkg_resources.extern.packaging.specifiers')
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/pkg_resources/_vendor/packaging/specifiers.py", line 333, in <module>
class Specifier(_IndividualSpecifier):
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/pkg_resources/_vendor/packaging/specifiers.py", line 428, in Specifier
_regex = re.compile(r"^\s*" + _regex_str + r"\s*$", re.VERBOSE | re.IGNORECASE)
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/re.py", line 251, in compile
return _compile(pattern, flags)
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/re.py", line 303, in _compile
p = sre_compile.compile(pattern, flags)
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/sre_compile.py", line 764, in compile
p = sre_parse.parse(p, flags)
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/sre_parse.py", line 950, in parse
p = _parse_sub(source, state, flags & SRE_FLAG_VERBOSE, 0)
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/sre_parse.py", line 443, in _parse_sub
itemsappend(_parse(source, state, verbose, nested + 1,
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/sre_parse.py", line 831, in _parse
group = state.opengroup(name)
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/sre_parse.py", line 86, in opengroup
self.groupwidths.append(None)
KeyboardInterrupt
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301585/16301585_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301587/16301587_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301598/16301598_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301601/16301601_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301604/16301604_0_log.err not found
⚠ Job 16301591 (task: 0) with path /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301591/16301591_0_result.pkl
has not produced any output (state: FAILED)
No error stream produced. Look at stdout: /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301591/16301591_0_log.out
----------------------------------------
exec(code, run_globals)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/_submit.py", line 11, in <module>
submitit_main()
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/submission.py", line 76, in submitit_main
process_job(args.folder)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/submission.py", line 52, in process_job
delayed = utils.DelayedSubmission.load(paths.submitted_pickle)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/utils.py", line 153, in load
obj = pickle_load(filepath)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/utils.py", line 232, in pickle_load
return pickle.load(ifile)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/cloudpickle/cloudpickle.py", line 469, in subimport
__import__(name)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/pandas/__init__.py", line 49, in <module>
from pandas.core.api import (
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/pandas/core/api.py", line 47, in <module>
from pandas.core.groupby import (
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/pandas/core/groupby/__init__.py", line 1, in <module>
from pandas.core.groupby.generic import (
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/pandas/core/groupby/generic.py", line 68, in <module>
from pandas.core.frame import DataFrame
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/pandas/core/frame.py", line 509, in <module>
class DataFrame(NDFrame, OpsMixin):
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/pandas/core/frame.py", line 2183, in DataFrame
def to_gbq(
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/pandas/util/_decorators.py", line 295, in decorate
old_sig = inspect.signature(func)
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/inspect.py", line 3247, in signature
return Signature.from_callable(obj, follow_wrapped=follow_wrapped,
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/inspect.py", line 2995, in from_callable
return _signature_from_callable(obj, sigcls=cls,
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/inspect.py", line 2456, in _signature_from_callable
return _signature_from_function(sigcls, obj,
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/inspect.py", line 2366, in _signature_from_function
return cls(parameters,
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/inspect.py", line 2962, in __init__
params = OrderedDict((param.name, param) for param in parameters)
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/inspect.py", line 2962, in <genexpr>
params = OrderedDict((param.name, param) for param in parameters)
KeyboardInterrupt
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301591/16301591_0_log.err not found
⚠ Job 16301596 (task: 0) with path /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301596/16301596_0_result.pkl
has not produced any output (state: FAILED)
No error stream produced. Look at stdout: /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301596/16301596_0_log.out
----------------------------------------
submitit INFO (2025-04-02 18:35:34,142) - Starting with JobEnvironment(job_id=16301596, hostname=n1708, local_rank=0(1), node=0(1), global_rank=0(1))
submitit INFO (2025-04-02 18:35:34,146) - Loading pickle: /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301596/16301596_submitted.pkl
Traceback (most recent call last):
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/runpy.py", line 86, in _run_code
exec(code, run_globals)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/_submit.py", line 11, in <module>
submitit_main()
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/submission.py", line 76, in submitit_main
process_job(args.folder)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/submission.py", line 52, in process_job
delayed = utils.DelayedSubmission.load(paths.submitted_pickle)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/utils.py", line 153, in load
obj = pickle_load(filepath)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/utils.py", line 232, in pickle_load
return pickle.load(ifile)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/cloudpickle/cloudpickle.py", line 469, in subimport
__import__(name)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/pandas/__init__.py", line 121, in <module>
from pandas.core.reshape.api import (
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/pandas/core/reshape/api.py", line 21, in <module>
from pandas.core.reshape.tile import (
File "<frozen importlib._bootstrap>", line 1024, in _find_and_load
File "<frozen importlib._bootstrap>", line 174, in __exit__
File "<frozen importlib._bootstrap>", line 125, in release
KeyboardInterrupt
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301596/16301596_0_log.err not found
Current git-hash: 748be6af2e38a3c47ed5b1c8cc0139d9175bbc80 (version: 5373)
Runtime (end): 5 seconds, PID: 2842316
To cancel, press CTRLc, then run 'scancel 16301502'
Run-UUID: 1d0f65ab-5c7f-4baa-917a-bf0e41b13aaf
____ _ ____ _ ___
/ __ \ (_)/ __ \ | | |__ \
| | | |_ __ ___ _ __ _| | | |_ __ | |_ ) |
| | | | '_ ` _ \| '_ \| | | | | '_ \| __| / /
| |__| | | | | | | | | | | |__| | |_) | |_ / /_
\____/|_| |_| |_|_| |_|_|\____/| .__/ \__|____|
| |
|_|
omniopt --partition=romeo --experiment_name=CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME --result_names ACCURACY=max RUNTIME=min --mem_gb=64 --time=1440 --worker_timeout=60 --max_eval=500 --num_parallel_jobs=30 --revert_to_random_when_seemingly_exhausted --generate_all_jobs_at_once --decimalrounding=12 --gpus=0 --num_random_steps=20 --send_anonymized_usage_stats --run_program=bW9kdWxlIGxvYWQgR0NDY29yZS8xMC4zLjAgUHl0aG9uICYmIHNvdXJjZSAvZGF0YS9ob3JzZS93cy9zNDEyMjQ4NS1jb21wUGVyZkREL2JlbmNobWFyay92ZW52L2Jpbi9hY3RpdmF0ZSAmJiBweXRob24gL2RhdGEvaG9yc2Uvd3MvczQxMjI0ODUtY29tcFBlcmZERC9iZW5jaG1hcmsvZGZraS9iZW5jaG1hcmtkZC9tYWluLnB5IDEgMSAwIFRNREJhbGFuY2VkNXMgMjAwMCBIb2VmZmRpbmdUcmVlQ2xhc3NpZmllciBDU0RETSByZWNlbnRfc2FtcGxlc19zaXplICUocmVjZW50X3NhbXBsZXNfc2l6ZSkgbl9zYW1wbGVzICUobl9zYW1wbGVzKSBjb25maWRlbmNlICUoY29uZmlkZW5jZSkgZmVhdHVyZV9wcm9wb3J0aW9uICUoZmVhdHVyZV9wcm9wb3J0aW9uKSBuX2NsdXN0ZXJzICUobl9jbHVzdGVycyk= --cpus_per_task=1 --model=BOTORCH_MODULAR --run_mode=local --live_share --parameter recent_samples_size range 1 5000 int --parameter n_samples range 1 5000 int --parameter confidence choice 0.85,0.8,0.75,0.7,0.65,0.6,0.55,0.5,0.45,0.4,0.35,0.3,0.25,0.2,0.15,0.1,0.05,0.025,0.01,0.005,0.001,0.0001 --parameter feature_proportion range 0.001 0.999 float --parameter n_clusters range 1 50 int
Run-folder: runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0
Warning: --num_random_steps is smaller than --num_parallel_jobs. It's recommended that --num_parallel_jobs is the same as or a multiple of --num_random_stepsYou have 2 CPUs available for the main process.No CUDA devices found.Generation strategy: Sobol for 30 trials, BoTorch for subsequent trials.
Run-Program: module load GCCcore/10.3.0 Python && source /data/horse/ws/s4122485-compPerfDD/benchmark/venv/bin/activate && python /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/main.py 1 1 0 TMDBalanced5s 2000 HoeffdingTreeClassifier CSDDM recent_samples_size %(recent_samples_size) n_samples %(n_samples) confidence %(confidence) feature_proportion %(feature_proportion) n_clusters %(n_clusters)
Experiment parameters:
┏━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━┳━━━━━━━━━━━━━┳━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━┳━━━━━━━━━━━━┓
┃Name ┃Type ┃Lower bound┃Upper bound┃Values ┃Type ┃Log Scale?┃
┡━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━╇━━━━━━━━━━━━━╇━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━╇━━━━━━━━━━━━┩
│recent_samples_size│range │1 │5000 ││int │No │
│n_samples │range │1 │5000 ││int │No │
│confidence │choice│││0.0001, 0.001, 0.005, 0.01, 0.025, 0.05, 0.1, 0.15, 0.2, 0.25, 0.3, 0.35, 0.4, 0.45, 0.5, 0.55, 0.6, 0.65, 0.7, │││
│││││0.75, 0.8, 0.85 │││
│feature_proportion │range │0.001 │0.999 ││float│No │
│n_clusters │range │1 │50 ││int │No │
└─────────────────────┴────────┴─────────────┴─────────────┴──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┴───────┴────────────┘
Result-Names:
┏━━━━━━━━━━━━━┳━━━━━━━━━━━━━┓
┃Result-Name┃Min or max?┃
┡━━━━━━━━━━━━━╇━━━━━━━━━━━━━┩
│ACCURACY │ max│
│RUNTIME │ min│
└─────────────┴─────────────┘
See https://imageseg.scads.de/omniax/share?user_id=s4122485&experiment_name=CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME&run_nr=9 for live-results.
█▀▀▀▀▀█ █▀ ▀▀▀ ▄▀ ▄▀▄▀ ▄▄█▄▀ ▀█▄ ▄▀ █▀▀▀▀▀█
█ ███ █ ▄▄▄▀ █▄ ▀▄██ ▄▄█▄ █▄▀▄▄██ █▄ █ ███ █
█ ▀▀▀ █ ▀ ██▄ ▀ ▄█ ▀█▀▀▀█▀ ▀▀▀▀ ▀▀▀ █ ▀▀▀ █
▀▀▀▀▀▀▀ ▀▄█ █▄▀▄█ ▀▄█ ▀ █ ▀▄█ ▀ █ ▀▄█ ▀▀▀▀▀▀▀
▀█ ▄▄▀▀█ ▀▀▄ ▄▄ ▄██▄█▀█████▄ ███▄▄█▄▄▄▄▄██▄▄
▀ ▄▀██▀ ▄ ▀▄█▀ ██▀ ▀▀ ▀ ▀ ▄▀▀█▀▀▄▄▀▀▄▄█▀
▄▀▀ ▀▀▀ ▄ ██ ▀▀ ▄▄█▀▄ ▄█▄█▄▀█ █▄▀▀▄▀▀█ ▀
▄████▄▀█▀█▄█▀▀▀▄▀█ ▄███▄▀█▄▄▀▀▄▀ ▀█████ ▄██▄
▄▄▀ ▀▀▀█▄▀▄▄▀▀█▄▀▀▄▀ ▄██ █ ███▄▄ █▄█▀▄ ▀▄██
▄▀██ █▀▀▄▀▄ ▀▄▀█▄▄█▄ ▀ ▄█▄ ▄▀ ▄ ▄█ █ █ ▄█▄ ▀
█▄▀▄█▀▀▀██ ▄▄ ▄▄█▀▄█▀▀▀██▄ █▄█▄█▄▄█▀▀▀█ ▄▀▄
▄▄█ █ ▀ █▄ █▄ █ ▀ ▀█ ▀ █▀ ▀▄▀ ▀▄█▀▀█ ▀ █▀▄▀
█▀ ▀█▀▀▀ ▄█▀█▀ ▀▄▀█▀███▀█ █▀█▄██▀▄▀█▀█▀ ▄▄█
▄▄▀▄█▀▀█▄▀▄▄ ██ ▄ ▀ ▀ ▄█▄▀▄█ ▄▀▀ ▀███ ███▀▄
█ ▄▀██▀▄ ▄█▄█▀ ▄▀▀▀▄ █▀▄▀▄ █▄▀▄▄ ▄ █ █▀ ▄▀
▄▀ ▀ ▀▄▄▀ ██ ▄█▄▀▀▀▄▀█▀▄██▄██ ▀█▀ █▀▄█ █▀▄▄█
█▄▀█▀▄▀▀██▄▀█▀██ ▄▀▄██ ▀▀██▄▄█▄▄▄ █ █▄ ██▄ ▀▀
▄▄▄█ ▀█▄▀ ▀█▄▄██▄▄ █▀▀▄ ▀▀▄▀ █▄███▀█ ██▄██
▀ ▀▀ ▀▀▄▀ ██▄▀█ ▀ █▀▀▀█▄▀▄▀▄█ ▀█ ██▀▀▀██ ▄
█▀▀▀▀▀█ ██▀▄█▄▄▄▄█▄▄█ ▀ █ ▀▀ ▄▀ █▀▄█ ▀ █▀▄█▄
█ ███ █ ▄ ▄▀▄ ▀ ▄▀▄▀█▀▀██ █▄▀ █▀ █▀▀▀█ ▄▀▀
█ ▀▀▀ █ ▄▄▄█ ██ █▄▄▄▄█▀▄█▀ ▀▄█▄▄▀█ ▄▀▄ ▄█▄█▀
▀▀▀▀▀▀▀ ▀ ▀ ▀▀ ▀▀▀▀ ▀ ▀▀▀▀ ▀ ▀▀ ▀ ▀ ▀
Failed jobs: 1 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, failed/completed/running/pending 3/4/3/19 (97%/30), job_failed: 0%|░░░░░░░░░░| 0/500 02:09<?, ?it/s]
⚠ Job 16301516 (task: 0) with path /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301516/16301516_0_result.pkl
has not produced any output (state: FAILED)
No error stream produced. Look at stdout: /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301516/16301516_0_log.out
----------------------------------------
Traceback (most recent call last):
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/runpy.py", line 86, in _run_code
exec(code, run_globals)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/_submit.py", line 11, in <module>
submitit_main()
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/submission.py", line 73, in submitit_main
parser = argparse.ArgumentParser(description="Run a job")
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/argparse.py", line 1728, in __init__
self._positionals = add_group(_('positional arguments'))
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/gettext.py", line 742, in gettext
return dgettext(_current_domain, message)
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/gettext.py", line 666, in dgettext
t = translation(domain, _localedirs.get(domain, None))
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/gettext.py", line 587, in translation
mofiles = find(domain, localedir, languages, all=True)
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/gettext.py", line 558, in find
for nelang in _expand_lang(lang):
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/gettext.py", line 212, in _expand_lang
import locale
File "<frozen importlib._bootstrap>", line 1027, in _find_and_load
File "<frozen importlib._bootstrap>", line 1002, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 945, in _find_spec
File "<frozen importlib._bootstrap_external>", line 1439, in find_spec
File "<frozen importlib._bootstrap_external>", line 1411, in _get_spec
File "<frozen importlib._bootstrap_external>", line 1577, in find_spec
File "<frozen importlib._bootstrap_external>", line 161, in _path_isfile
File "<frozen importlib._bootstrap_external>", line 153, in _path_is_mode_type
File "<frozen importlib._bootstrap_external>", line 147, in _path_stat
KeyboardInterrupt
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301516/16301516_0_log.err not found
⚠ Job 16301519 (task: 0) with path /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301519/16301519_0_result.pkl
has not produced any output (state: FAILED)
No error stream produced. Look at stdout: /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301519/16301519_0_log.out
----------------------------------------
submitit INFO (2025-04-02 18:32:02,833) - Starting with JobEnvironment(job_id=16301519, hostname=n1708, local_rank=0(1), node=0(1), global_rank=0(1))
submitit INFO (2025-04-02 18:32:02,838) - Loading pickle: /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301519/16301519_submitted.pkl
Traceback (most recent call last):
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/runpy.py", line 86, in _run_code
exec(code, run_globals)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/_submit.py", line 11, in <module>
submitit_main()
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/submission.py", line 76, in submitit_main
process_job(args.folder)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/submission.py", line 52, in process_job
delayed = utils.DelayedSubmission.load(paths.submitted_pickle)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/utils.py", line 153, in load
obj = pickle_load(filepath)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/utils.py", line 232, in pickle_load
return pickle.load(ifile)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/cloudpickle/cloudpickle.py", line 469, in subimport
__import__(name)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/torch/__init__.py", line 405, in <module>
from torch._C import * # noqa: F403
File "<frozen importlib._bootstrap>", line 216, in _lock_unlock_module
KeyboardInterrupt
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301519/16301519_0_log.err not foundFailed jobs: 10 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, completed/failed/pending 1/3/16 (67%/30), job_failed: 0%|░░░░░░░░░░| 0/500 03:04<?, ?it/s]
⚠ Job 16301522 (task: 0) with path /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301522/16301522_0_result.pkl
has not produced any output (state: FAILED)
No error stream produced. Look at stdout: /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301522/16301522_0_log.out
----------------------------------------
submitit INFO (2025-04-02 18:32:02,826) - Starting with JobEnvironment(job_id=16301522, hostname=n1708, local_rank=0(1), node=0(1), global_rank=0(1))
submitit INFO (2025-04-02 18:32:02,860) - Loading pickle: /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301522/16301522_submitted.pkl
Traceback (most recent call last):
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/runpy.py", line 86, in _run_code
exec(code, run_globals)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/_submit.py", line 11, in <module>
submitit_main()
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/submission.py", line 76, in submitit_main
process_job(args.folder)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/submission.py", line 52, in process_job
delayed = utils.DelayedSubmission.load(paths.submitted_pickle)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/utils.py", line 153, in load
obj = pickle_load(filepath)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/utils.py", line 232, in pickle_load
return pickle.load(ifile)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/cloudpickle/cloudpickle.py", line 469, in subimport
__import__(name)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/torch/__init__.py", line 405, in <module>
from torch._C import * # noqa: F403
File "<frozen importlib._bootstrap>", line 216, in _lock_unlock_module
KeyboardInterrupt
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301522/16301522_0_log.err not found
⚠ Job 16301525 (task: 0) with path /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301525/16301525_0_result.pkl
has not produced any output (state: FAILED)
No error stream produced. Look at stdout: /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301525/16301525_0_log.out
----------------------------------------
submitit INFO (2025-04-02 18:32:02,834) - Starting with JobEnvironment(job_id=16301525, hostname=n1708, local_rank=0(1), node=0(1), global_rank=0(1))
submitit INFO (2025-04-02 18:32:02,839) - Loading pickle: /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301525/16301525_submitted.pkl
Traceback (most recent call last):
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/runpy.py", line 86, in _run_code
exec(code, run_globals)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/_submit.py", line 11, in <module>
submitit_main()
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/submission.py", line 76, in submitit_main
process_job(args.folder)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/submission.py", line 52, in process_job
delayed = utils.DelayedSubmission.load(paths.submitted_pickle)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/utils.py", line 153, in load
obj = pickle_load(filepath)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/utils.py", line 232, in pickle_load
return pickle.load(ifile)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/cloudpickle/cloudpickle.py", line 469, in subimport
__import__(name)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/torch/__init__.py", line 405, in <module>
from torch._C import * # noqa: F403
File "<frozen importlib._bootstrap>", line 216, in _lock_unlock_module
KeyboardInterrupt
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301525/16301525_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301529/16301529_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301531/16301531_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301534/16301534_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301536/16301536_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301538/16301538_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301539/16301539_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301543/16301543_0_log.err not foundFailed jobs: 12 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, failed/pending 2/16 (60%/30), job_failed: 0%|░░░░░░░░░░| 0/500 03:41<?, ?it/s]
⚠ Job 16301547 (task: 0) with path /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301547/16301547_0_result.pkl
has not produced any output (state: FAILED)
No error stream produced. Look at stdout: /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301547/16301547_0_log.out
----------------------------------------
submitit INFO (2025-04-02 18:33:33,325) - Starting with JobEnvironment(job_id=16301547, hostname=n1708, local_rank=0(1), node=0(1), global_rank=0(1))
submitit INFO (2025-04-02 18:33:33,344) - Loading pickle: /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301547/16301547_submitted.pkl
Traceback (most recent call last):
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/runpy.py", line 86, in _run_code
exec(code, run_globals)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/_submit.py", line 11, in <module>
submitit_main()
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/submission.py", line 76, in submitit_main
process_job(args.folder)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/submission.py", line 52, in process_job
delayed = utils.DelayedSubmission.load(paths.submitted_pickle)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/utils.py", line 153, in load
obj = pickle_load(filepath)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/utils.py", line 232, in pickle_load
return pickle.load(ifile)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/cloudpickle/cloudpickle.py", line 469, in subimport
__import__(name)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/matplotlib/__init__.py", line 161, in <module>
from . import _api, _version, cbook, _docstring, rcsetup
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/matplotlib/rcsetup.py", line 28, in <module>
from matplotlib.colors import Colormap, is_color_like
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/matplotlib/colors.py", line 52, in <module>
from PIL import Image
File "<frozen importlib._bootstrap>", line 1027, in _find_and_load
File "<frozen importlib._bootstrap>", line 1006, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 688, in _load_unlocked
File "<frozen importlib._bootstrap_external>", line 879, in exec_module
File "<frozen importlib._bootstrap_external>", line 1012, in get_code
File "<frozen importlib._bootstrap_external>", line 672, in _compile_bytecode
KeyboardInterrupt
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301547/16301547_0_log.err not found
⚠ Job 16301552 (task: 0) with path /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301552/16301552_0_result.pkl
has not produced any output (state: FAILED)
No error stream produced. Look at stdout: /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301552/16301552_0_log.out
----------------------------------------
submitit INFO (2025-04-02 18:33:33,326) - Starting with JobEnvironment(job_id=16301552, hostname=n1708, local_rank=0(1), node=0(1), global_rank=0(1))
submitit INFO (2025-04-02 18:33:33,343) - Loading pickle: /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301552/16301552_submitted.pkl
Traceback (most recent call last):
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/runpy.py", line 86, in _run_code
exec(code, run_globals)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/_submit.py", line 11, in <module>
submitit_main()
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/submission.py", line 76, in submitit_main
process_job(args.folder)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/submission.py", line 52, in process_job
delayed = utils.DelayedSubmission.load(paths.submitted_pickle)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/utils.py", line 153, in load
obj = pickle_load(filepath)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/utils.py", line 232, in pickle_load
return pickle.load(ifile)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/cloudpickle/cloudpickle.py", line 469, in subimport
__import__(name)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/matplotlib/__init__.py", line 161, in <module>
from . import _api, _version, cbook, _docstring, rcsetup
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/matplotlib/rcsetup.py", line 28, in <module>
from matplotlib.colors import Colormap, is_color_like
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/matplotlib/colors.py", line 52, in <module>
from PIL import Image
File "<frozen importlib._bootstrap>", line 1027, in _find_and_load
File "<frozen importlib._bootstrap>", line 1006, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 688, in _load_unlocked
File "<frozen importlib._bootstrap_external>", line 879, in exec_module
File "<frozen importlib._bootstrap_external>", line 1012, in get_code
File "<frozen importlib._bootstrap_external>", line 672, in _compile_bytecode
KeyboardInterrupt
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301552/16301552_0_log.err not foundFailed jobs: 22 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, running/failed/pending 2/1/5 (27%/30), job_failed: 0%|░░░░░░░░░░| 0/500 04:24<?, ?it/s]
⚠ Job 16301556 (task: 0) with path /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301556/16301556_0_result.pkl
has not produced any output (state: FAILED)
No error stream produced. Look at stdout: /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301556/16301556_0_log.out
----------------------------------------
submitit INFO (2025-04-02 18:33:33,325) - Starting with JobEnvironment(job_id=16301556, hostname=n1708, local_rank=0(1), node=0(1), global_rank=0(1))
submitit INFO (2025-04-02 18:33:33,357) - Loading pickle: /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301556/16301556_submitted.pkl
Traceback (most recent call last):
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/runpy.py", line 86, in _run_code
exec(code, run_globals)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/_submit.py", line 11, in <module>
submitit_main()
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/submission.py", line 76, in submitit_main
process_job(args.folder)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/submission.py", line 52, in process_job
delayed = utils.DelayedSubmission.load(paths.submitted_pickle)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/utils.py", line 153, in load
obj = pickle_load(filepath)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/utils.py", line 232, in pickle_load
return pickle.load(ifile)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/cloudpickle/cloudpickle.py", line 469, in subimport
__import__(name)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/matplotlib/__init__.py", line 161, in <module>
from . import _api, _version, cbook, _docstring, rcsetup
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/matplotlib/rcsetup.py", line 28, in <module>
from matplotlib.colors import Colormap, is_color_like
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/matplotlib/colors.py", line 52, in <module>
from PIL import Image
File "<frozen importlib._bootstrap>", line 1027, in _find_and_load
File "<frozen importlib._bootstrap>", line 1006, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 688, in _load_unlocked
File "<frozen importlib._bootstrap_external>", line 879, in exec_module
File "<frozen importlib._bootstrap_external>", line 1012, in get_code
File "<frozen importlib._bootstrap_external>", line 672, in _compile_bytecode
KeyboardInterrupt
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301556/16301556_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301559/16301559_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301563/16301563_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301565/16301565_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301568/16301568_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301571/16301571_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301573/16301573_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301575/16301575_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301578/16301578_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301581/16301581_0_log.err not foundFailed jobs: 28 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, failed 2 (7%/30), waiting for old jobs to finish (2 left): 0%|░░░░░░░░░░| 0/500 06:27<?, ?it/s]
⚠ Job 16301585 (task: 0) with path /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301585/16301585_0_result.pkl
has not produced any output (state: FAILED)
No error stream produced. Look at stdout: /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301585/16301585_0_log.out
----------------------------------------
Traceback (most recent call last):
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/runpy.py", line 86, in _run_code
exec(code, run_globals)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/_submit.py", line 11, in <module>
submitit_main()
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/submission.py", line 76, in submitit_main
process_job(args.folder)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/submission.py", line 37, in process_job
env = job_environment.JobEnvironment()
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/job_environment.py", line 44, in __new__
return plugins.get_job_environment()
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/plugins.py", line 71, in get_job_environment
envs = get_job_environments()
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/plugins.py", line 88, in get_job_environments
return {env.name(): env for env in _get_plugins()1]}
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/plugins.py", line 24, in _get_plugins
import pkg_resources
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/pkg_resources/__init__.py", line 77, in <module>
__import__('pkg_resources.extern.packaging.specifiers')
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/pkg_resources/_vendor/packaging/specifiers.py", line 333, in <module>
class Specifier(_IndividualSpecifier):
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/pkg_resources/_vendor/packaging/specifiers.py", line 428, in Specifier
_regex = re.compile(r"^\s*" + _regex_str + r"\s*$", re.VERBOSE | re.IGNORECASE)
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/re.py", line 251, in compile
return _compile(pattern, flags)
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/re.py", line 303, in _compile
p = sre_compile.compile(pattern, flags)
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/sre_compile.py", line 764, in compile
p = sre_parse.parse(p, flags)
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/sre_parse.py", line 950, in parse
p = _parse_sub(source, state, flags & SRE_FLAG_VERBOSE, 0)
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/sre_parse.py", line 443, in _parse_sub
itemsappend(_parse(source, state, verbose, nested + 1,
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/sre_parse.py", line 831, in _parse
group = state.opengroup(name)
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/sre_parse.py", line 86, in opengroup
self.groupwidths.append(None)
KeyboardInterrupt
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301585/16301585_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301587/16301587_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301598/16301598_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301601/16301601_0_log.err not found
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301604/16301604_0_log.err not foundFailed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, finished 0 jobs: 0%|░░░░░░░░░░| 0/500 07:10<?, ?it/s]
⚠ Job 16301591 (task: 0) with path /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301591/16301591_0_result.pkl
has not produced any output (state: FAILED)
No error stream produced. Look at stdout: /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301591/16301591_0_log.out
----------------------------------------
exec(code, run_globals)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/_submit.py", line 11, in <module>
submitit_main()
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/submission.py", line 76, in submitit_main
process_job(args.folder)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/submission.py", line 52, in process_job
delayed = utils.DelayedSubmission.load(paths.submitted_pickle)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/utils.py", line 153, in load
obj = pickle_load(filepath)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/utils.py", line 232, in pickle_load
return pickle.load(ifile)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/cloudpickle/cloudpickle.py", line 469, in subimport
__import__(name)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/pandas/__init__.py", line 49, in <module>
from pandas.core.api import (
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/pandas/core/api.py", line 47, in <module>
from pandas.core.groupby import (
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/pandas/core/groupby/__init__.py", line 1, in <module>
from pandas.core.groupby.generic import (
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/pandas/core/groupby/generic.py", line 68, in <module>
from pandas.core.frame import DataFrame
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/pandas/core/frame.py", line 509, in <module>
class DataFrame(NDFrame, OpsMixin):
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/pandas/core/frame.py", line 2183, in DataFrame
def to_gbq(
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/pandas/util/_decorators.py", line 295, in decorate
old_sig = inspect.signature(func)
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/inspect.py", line 3247, in signature
return Signature.from_callable(obj, follow_wrapped=follow_wrapped,
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/inspect.py", line 2995, in from_callable
return _signature_from_callable(obj, sigcls=cls,
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/inspect.py", line 2456, in _signature_from_callable
return _signature_from_function(sigcls, obj,
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/inspect.py", line 2366, in _signature_from_function
return cls(parameters,
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/inspect.py", line 2962, in __init__
params = OrderedDict((param.name, param) for param in parameters)
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/inspect.py", line 2962, in <genexpr>
params = OrderedDict((param.name, param) for param in parameters)
KeyboardInterrupt
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301591/16301591_0_log.err not found
⚠ Job 16301596 (task: 0) with path /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301596/16301596_0_result.pkl
has not produced any output (state: FAILED)
No error stream produced. Look at stdout: /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301596/16301596_0_log.out
----------------------------------------
submitit INFO (2025-04-02 18:35:34,142) - Starting with JobEnvironment(job_id=16301596, hostname=n1708, local_rank=0(1), node=0(1), global_rank=0(1))
submitit INFO (2025-04-02 18:35:34,146) - Loading pickle: /data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301596/16301596_submitted.pkl
Traceback (most recent call last):
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/runpy.py", line 86, in _run_code
exec(code, run_globals)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/_submit.py", line 11, in <module>
submitit_main()
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/submission.py", line 76, in submitit_main
process_job(args.folder)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/submission.py", line 52, in process_job
delayed = utils.DelayedSubmission.load(paths.submitted_pickle)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/utils.py", line 153, in load
obj = pickle_load(filepath)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/utils.py", line 232, in pickle_load
return pickle.load(ifile)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/cloudpickle/cloudpickle.py", line 469, in subimport
__import__(name)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/pandas/__init__.py", line 121, in <module>
from pandas.core.reshape.api import (
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/pandas/core/reshape/api.py", line 21, in <module>
from pandas.core.reshape.tile import (
File "<frozen importlib._bootstrap>", line 1024, in _find_and_load
File "<frozen importlib._bootstrap>", line 174, in __exit__
File "<frozen importlib._bootstrap>", line 125, in release
KeyboardInterrupt
/data/horse/ws/s4122485-compPerfDD/benchmark/dfki/benchmarkdd/OmniOpt/runs/CSDDM_TMDBalanced5s_HoeffdingTreeClassifier_ACCURACY-RUNTIME/0/single_runs/16301596/16301596_0_log.err not foundFailed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for old jobs to finish (30 left): 0%|░░░░░░░░░░| 0/500 13:03<?, ?it/s]
2025-04-02 18:31:11: Initializing model, Started OmniOpt2 run...
2025-04-02 18:31:12: Initializing model, finished 0 jobs
2025-04-02 18:31:12: Initializing model, trying to get 30 next steps (current done: 0, max: 500)
2025-04-02 18:31:12: Initializing model, finishing jobs (_get_next_trials), finished 0 jobs
2025-04-02 18:31:12: Initializing model, getting new hyperparameter set #1/30
2025-04-02 18:31:12: SobolGenerator, getting new hyperparameter set #2/30 | ETA: 17s
2025-04-02 18:31:13: SobolGenerator, getting new hyperparameter set #3/30 | ETA: 16s
2025-04-02 18:31:14: SobolGenerator, getting new hyperparameter set #4/30 | ETA: 16s
2025-04-02 18:31:14: SobolGenerator, getting new hyperparameter set #5/30 | ETA: 15s
2025-04-02 18:31:15: SobolGenerator, getting new hyperparameter set #6/30 | ETA: 15s
2025-04-02 18:31:15: SobolGenerator, getting new hyperparameter set #7/30 | ETA: 14s
2025-04-02 18:31:16: SobolGenerator, getting new hyperparameter set #8/30 | ETA: 14s
2025-04-02 18:31:17: SobolGenerator, getting new hyperparameter set #9/30 | ETA: 13s
2025-04-02 18:31:17: SobolGenerator, getting new hyperparameter set #10/30 | ETA: 13s
2025-04-02 18:31:18: SobolGenerator, getting new hyperparameter set #11/30 | ETA: 12s
2025-04-02 18:31:18: SobolGenerator, getting new hyperparameter set #12/30 | ETA: 11s
2025-04-02 18:31:19: SobolGenerator, getting new hyperparameter set #13/30 | ETA: 10s
2025-04-02 18:31:20: SobolGenerator, getting new hyperparameter set #14/30 | ETA: 10s
2025-04-02 18:31:20: SobolGenerator, getting new hyperparameter set #15/30 | ETA: 9s
2025-04-02 18:31:21: SobolGenerator, getting new hyperparameter set #16/30 | ETA: 8s
2025-04-02 18:31:21: SobolGenerator, getting new hyperparameter set #17/30 | ETA: 8s
2025-04-02 18:31:22: SobolGenerator, getting new hyperparameter set #18/30 | ETA: 7s
2025-04-02 18:31:22: SobolGenerator, getting new hyperparameter set #19/30 | ETA: 6s
2025-04-02 18:31:23: SobolGenerator, getting new hyperparameter set #20/30 | ETA: 6s
2025-04-02 18:31:23: SobolGenerator, getting new hyperparameter set #21/30 | ETA: 5s
2025-04-02 18:31:23: SobolGenerator, getting new hyperparameter set #22/30 | ETA: 4s
2025-04-02 18:31:24: SobolGenerator, getting new hyperparameter set #23/30 | ETA: 4s
2025-04-02 18:31:24: SobolGenerator, getting new hyperparameter set #24/30 | ETA: 3s
2025-04-02 18:31:25: SobolGenerator, getting new hyperparameter set #25/30 | ETA: 3s
2025-04-02 18:31:25: SobolGenerator, getting new hyperparameter set #26/30 | ETA: 2s
2025-04-02 18:31:26: SobolGenerator, getting new hyperparameter set #27/30 | ETA: 2s
2025-04-02 18:31:26: SobolGenerator, getting new hyperparameter set #28/30 | ETA: 1s
2025-04-02 18:31:27: SobolGenerator, getting new hyperparameter set #29/30 | ETA: 1s
2025-04-02 18:31:27: SobolGenerator, getting new hyperparameter set #30/30 | ETA: 0s
2025-04-02 18:31:28: SobolGenerator, starting parameter set
2025-04-02 18:31:28: SobolGenerator, starting new job
2025-04-02 18:31:30: SobolGenerator, unknown 1 (3%/30), started new job
2025-04-02 18:31:30: SobolGenerator, unknown 1 (3%/30), starting parameter set
2025-04-02 18:31:30: SobolGenerator, unknown 1 (3%/30), starting new job
2025-04-02 18:31:32: SobolGenerator, unknown 2 (7%/30), started new job
2025-04-02 18:31:32: SobolGenerator, unknown 2 (7%/30), starting parameter set
2025-04-02 18:31:33: SobolGenerator, unknown 2 (7%/30), starting new job
2025-04-02 18:31:35: SobolGenerator, failed/pending/unknown 1/1/1 (10%/30), started new job
2025-04-02 18:31:35: SobolGenerator, failed/pending/unknown 1/1/1 (10%/30), starting parameter set
2025-04-02 18:31:36: SobolGenerator, failed/pending/unknown 1/1/1 (10%/30), starting new job
2025-04-02 18:31:38: SobolGenerator, failed/pending/unknown 1/1/2 (13%/30), started new job
2025-04-02 18:31:38: SobolGenerator, failed/pending/unknown 1/1/2 (13%/30), starting parameter set
2025-04-02 18:31:39: SobolGenerator, failed/pending/unknown 1/1/2 (13%/30), starting new job
2025-04-02 18:31:41: SobolGenerator, failed/pending/unknown 1/3/1 (17%/30), started new job
2025-04-02 18:31:41: SobolGenerator, failed/pending/unknown 1/3/1 (17%/30), starting parameter set
2025-04-02 18:31:42: SobolGenerator, failed/pending/unknown 1/3/1 (17%/30), starting new job
2025-04-02 18:31:44: SobolGenerator, failed/pending/unknown 1/3/2 (20%/30), started new job
2025-04-02 18:31:44: SobolGenerator, failed/pending/unknown 1/3/2 (20%/30), starting parameter set
2025-04-02 18:31:44: SobolGenerator, failed/pending/unknown 1/3/2 (20%/30), starting new job
2025-04-02 18:31:46: SobolGenerator, failed/pending/unknown 1/4/2 (23%/30), started new job
2025-04-02 18:31:46: SobolGenerator, failed/pending/unknown 1/4/2 (23%/30), starting parameter set
2025-04-02 18:31:46: SobolGenerator, failed/pending/unknown 1/4/2 (23%/30), starting new job
2025-04-02 18:31:48: SobolGenerator, failed/pending 1/7 (27%/30), started new job
2025-04-02 18:31:48: SobolGenerator, failed/pending 1/7 (27%/30), starting parameter set
2025-04-02 18:31:49: SobolGenerator, failed/pending 1/7 (27%/30), starting new job
2025-04-02 18:31:50: SobolGenerator, failed/pending/unknown 1/7/1 (30%/30), started new job
2025-04-02 18:31:51: SobolGenerator, failed/pending/unknown 1/7/1 (30%/30), starting parameter set
2025-04-02 18:31:51: SobolGenerator, failed/pending/unknown 1/7/1 (30%/30), starting new job
2025-04-02 18:31:53: SobolGenerator, failed/pending/unknown 1/7/2 (33%/30), started new job
2025-04-02 18:31:53: SobolGenerator, failed/pending/unknown 1/7/2 (33%/30), starting parameter set
2025-04-02 18:31:54: SobolGenerator, failed/pending 1/9 (33%/30), starting new job
2025-04-02 18:31:56: SobolGenerator, failed/pending/unknown 1/9/1 (37%/30), started new job
2025-04-02 18:31:56: SobolGenerator, failed/pending/unknown 1/9/1 (37%/30), starting parameter set
2025-04-02 18:31:57: SobolGenerator, failed/pending/unknown 1/9/1 (37%/30), starting new job
2025-04-02 18:32:00: SobolGenerator, failed/pending/unknown 1/10/1 (40%/30), started new job
2025-04-02 18:32:00: SobolGenerator, failed/pending/unknown 1/10/1 (40%/30), starting parameter set
2025-04-02 18:32:00: SobolGenerator, failed/pending/unknown 1/10/1 (40%/30), starting new job
2025-04-02 18:32:02: SobolGenerator, failed/running/pending/unknown 1/3/7/2 (43%/30), started new job
2025-04-02 18:32:02: SobolGenerator, failed/running/pending/unknown 1/3/7/2 (43%/30), starting parameter set
2025-04-02 18:32:02: SobolGenerator, failed/running/pending/unknown 1/3/7/2 (43%/30), starting new job
2025-04-02 18:32:04: SobolGenerator, failed/running/pending/unknown 1/3/8/2 (47%/30), started new job
2025-04-02 18:32:04: SobolGenerator, failed/running/pending/unknown 1/3/8/2 (47%/30), starting parameter set
2025-04-02 18:32:05: SobolGenerator, failed/running/pending/unknown 1/3/8/2 (47%/30), starting new job
2025-04-02 18:32:07: SobolGenerator, failed/running/pending/unknown 1/3/9/2 (50%/30), started new job
2025-04-02 18:32:07: SobolGenerator, failed/running/pending/unknown 1/3/9/2 (50%/30), starting parameter set
2025-04-02 18:32:07: SobolGenerator, failed/running/pending/unknown 1/3/9/2 (50%/30), starting new job
2025-04-02 18:32:09: SobolGenerator, failed/pending/unknown 4/9/3 (53%/30), started new job
2025-04-02 18:32:09: SobolGenerator, failed/pending/unknown 4/9/3 (53%/30), starting parameter set
2025-04-02 18:32:10: SobolGenerator, failed/pending/unknown 4/9/3 (53%/30), starting new job
2025-04-02 18:32:12: SobolGenerator, failed/pending/unknown 4/12/1 (57%/30), started new job
2025-04-02 18:32:12: SobolGenerator, failed/pending/unknown 4/12/1 (57%/30), starting parameter set
2025-04-02 18:32:13: SobolGenerator, failed/pending/unknown 4/12/1 (57%/30), starting new job
2025-04-02 18:32:15: SobolGenerator, failed/pending/unknown 4/12/2 (60%/30), started new job
2025-04-02 18:32:16: SobolGenerator, failed/pending/unknown 4/12/2 (60%/30), starting parameter set
2025-04-02 18:32:16: SobolGenerator, failed/pending 4/14 (60%/30), starting new job
2025-04-02 18:32:19: SobolGenerator, failed/pending/unknown 4/14/1 (63%/30), started new job
2025-04-02 18:32:19: SobolGenerator, failed/pending/unknown 4/14/1 (63%/30), starting parameter set
2025-04-02 18:32:20: SobolGenerator, failed/pending 4/15 (63%/30), starting new job
2025-04-02 18:32:22: SobolGenerator, failed/pending/unknown 4/15/1 (67%/30), started new job
2025-04-02 18:32:22: SobolGenerator, failed/pending/unknown 4/15/1 (67%/30), starting parameter set
2025-04-02 18:32:22: SobolGenerator, failed/pending/unknown 4/15/1 (67%/30), starting new job
2025-04-02 18:32:24: SobolGenerator, failed/pending/unknown 4/15/2 (70%/30), started new job
2025-04-02 18:32:24: SobolGenerator, failed/pending/unknown 4/15/2 (70%/30), starting parameter set
2025-04-02 18:32:25: SobolGenerator, failed/pending/unknown 4/15/2 (70%/30), starting new job
2025-04-02 18:32:26: SobolGenerator, failed/pending/unknown 4/17/1 (73%/30), started new job
2025-04-02 18:32:26: SobolGenerator, failed/pending/unknown 4/17/1 (73%/30), starting parameter set
2025-04-02 18:32:27: SobolGenerator, failed/pending/unknown 4/17/1 (73%/30), starting new job
2025-04-02 18:32:29: SobolGenerator, failed/pending/unknown 4/17/2 (77%/30), started new job
2025-04-02 18:32:29: SobolGenerator, failed/pending/unknown 4/17/2 (77%/30), starting parameter set
2025-04-02 18:32:29: SobolGenerator, failed/pending/unknown 4/17/2 (77%/30), starting new job
2025-04-02 18:32:31: SobolGenerator, failed/pending/unknown 4/17/3 (80%/30), started new job
2025-04-02 18:32:31: SobolGenerator, failed/pending/unknown 4/17/3 (80%/30), starting parameter set
2025-04-02 18:32:32: SobolGenerator, failed/pending/unknown 4/17/3 (80%/30), starting new job
2025-04-02 18:32:34: SobolGenerator, failed/running/pending/unknown 4/4/15/2 (83%/30), started new job
2025-04-02 18:32:34: SobolGenerator, failed/running/pending/unknown 4/4/15/2 (83%/30), starting parameter set
2025-04-02 18:32:35: SobolGenerator, failed/running/pending 4/4/17 (83%/30), starting new job
2025-04-02 18:32:37: SobolGenerator, failed/running/pending/unknown 4/4/17/1 (87%/30), started new job
2025-04-02 18:32:37: SobolGenerator, failed/running/pending/unknown 4/4/17/1 (87%/30), starting parameter set
2025-04-02 18:32:39: SobolGenerator, failed/running/pending/unknown 4/4/17/1 (87%/30), starting new job
2025-04-02 18:32:41: SobolGenerator, failed/running/pending/unknown 4/4/17/2 (90%/30), started new job
2025-04-02 18:32:41: SobolGenerator, failed/running/pending/unknown 4/4/17/2 (90%/30), starting parameter set
2025-04-02 18:32:41: SobolGenerator, failed/running/pending/unknown 4/4/17/2 (90%/30), starting new job
2025-04-02 18:32:43: SobolGenerator, failed/running/pending/unknown 4/4/19/1 (93%/30), started new job
2025-04-02 18:32:43: SobolGenerator, failed/running/pending/unknown 4/4/19/1 (93%/30), starting parameter set
2025-04-02 18:32:44: SobolGenerator, failed/running/pending/unknown 4/4/19/1 (93%/30), starting new job
2025-04-02 18:32:46: SobolGenerator, failed/running/pending/unknown 4/4/19/2 (97%/30), started new job
2025-04-02 18:32:46: SobolGenerator, failed/running/pending/unknown 4/4/19/2 (97%/30), starting parameter set
2025-04-02 18:32:46: SobolGenerator, failed/running/pending/unknown 4/4/19/2 (97%/30), starting new job
2025-04-02 18:32:48: SobolGenerator, failed/running/pending/unknown 4/4/21/1 (100%/30), started new job
2025-04-02 18:33:04: SobolGenerator, failed/completed/running/pending 4/4/3/19 (100%/30), job_failed
2025-04-02 18:33:21: Failed jobs: 1 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, failed/completed/running/pending 3/4/3/19 (97%/30), job_failed
2025-04-02 18:33:38: Failed jobs: 2 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, failed/completed/running/pending 2/4/3/19 (93%/30), job_failed
2025-04-02 18:33:56: Failed jobs: 3 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, failed/completed/running/pending 1/4/3/19 (90%/30), job_failed
2025-04-02 18:34:01: Failed jobs: 4 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, completed/failed/pending 7/3/16 (87%/30), job_failed
2025-04-02 18:34:03: Failed jobs: 5 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, completed/failed/pending 6/3/16 (83%/30), job_failed
2025-04-02 18:34:05: Failed jobs: 6 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, completed/failed/pending 5/3/16 (80%/30), job_failed
2025-04-02 18:34:08: Failed jobs: 7 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, completed/failed/pending 4/3/16 (77%/30), job_failed
2025-04-02 18:34:10: Failed jobs: 8 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, completed/failed/pending 3/3/16 (73%/30), job_failed
2025-04-02 18:34:13: Failed jobs: 9 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, completed/failed/pending 2/3/16 (70%/30), job_failed
2025-04-02 18:34:16: Failed jobs: 10 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, completed/failed/pending 1/3/16 (67%/30), job_failed
2025-04-02 18:34:35: Failed jobs: 11 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, failed/pending 3/16 (63%/30), job_failed
2025-04-02 18:34:53: Failed jobs: 12 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, failed/pending 2/16 (60%/30), job_failed
2025-04-02 18:35:10: Failed jobs: 13 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, failed/pending 1/16 (57%/30), job_failed
2025-04-02 18:35:12: Failed jobs: 14 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, completed/running/failed/pending 7/3/1/5 (53%/30), job_failed
2025-04-02 18:35:15: Failed jobs: 15 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, completed/running/failed/pending 6/3/1/5 (50%/30), job_failed
2025-04-02 18:35:17: Failed jobs: 16 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, completed/running/failed/pending 5/3/1/5 (47%/30), job_failed
2025-04-02 18:35:20: Failed jobs: 17 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, completed/running/failed/pending 4/3/1/5 (43%/30), job_failed
2025-04-02 18:35:24: Failed jobs: 18 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, completed/running/failed/pending 3/3/1/5 (40%/30), job_failed
2025-04-02 18:35:28: Failed jobs: 19 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, completed/running/failed/pending 2/3/1/5 (37%/30), job_failed
2025-04-02 18:35:31: Failed jobs: 20 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, completed/running/failed/pending 1/3/1/5 (33%/30), job_failed
2025-04-02 18:35:34: Failed jobs: 21 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, running/failed/pending 3/1/5 (30%/30), job_failed
2025-04-02 18:35:36: Failed jobs: 22 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, running/failed/pending 2/1/5 (27%/30), job_failed
2025-04-02 18:35:53: Failed jobs: 23 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, failed/running/pending 1/1/5 (23%/30), job_failed
2025-04-02 18:35:55: Failed jobs: 24 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, running/pending 1/5 (20%/30), job_failed
2025-04-02 18:35:59: Failed jobs: 25 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 5 (17%/30), finishing jobs after starting them, finished 25 jobs
2025-04-02 18:35:59: Failed jobs: 25 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 5 (17%/30), got 30, requested 30
2025-04-02 18:36:02: Failed jobs: 25 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 5 (17%/30), finishing previous jobs (5), finished 0 jobs
2025-04-02 18:36:03: Failed jobs: 25 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 5 (17%/30), waiting for old jobs to finish (5 left)
2025-04-02 18:36:12: Failed jobs: 25 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 5 (17%/30), waiting for jobs (5 left), finished 0 jobs
2025-04-02 18:36:12: Failed jobs: 25 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 5 (17%/30), waiting for old jobs to finish (5 left)
2025-04-02 18:36:20: Failed jobs: 25 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 5 (17%/30), waiting for jobs (5 left), finished 0 jobs
2025-04-02 18:36:20: Failed jobs: 25 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 5 (17%/30), waiting for old jobs to finish (5 left)
2025-04-02 18:36:27: Failed jobs: 25 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 5 (17%/30), waiting for jobs (5 left), finished 0 jobs
2025-04-02 18:36:27: Failed jobs: 25 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 5 (17%/30), waiting for old jobs to finish (5 left)
2025-04-02 18:36:34: Failed jobs: 25 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 5 (17%/30), job_failed
2025-04-02 18:36:39: Failed jobs: 26 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 4 (13%/30), job_failed
2025-04-02 18:36:42: Failed jobs: 27 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 3 (10%/30), job_failed
2025-04-02 18:36:44: Failed jobs: 28 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 2 (7%/30), waiting for jobs (5 left), finished 3 jobs
2025-04-02 18:36:44: Failed jobs: 28 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 2 (7%/30), waiting for old jobs to finish (2 left)
2025-04-02 18:36:50: Failed jobs: 28 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 2 (7%/30), waiting for jobs (2 left), finished 0 jobs
2025-04-02 18:36:51: Failed jobs: 28 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 2 (7%/30), waiting for old jobs to finish (2 left)
2025-04-02 18:36:58: Failed jobs: 28 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 2 (7%/30), waiting for jobs (2 left), finished 0 jobs
2025-04-02 18:36:58: Failed jobs: 28 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 2 (7%/30), waiting for old jobs to finish (2 left)
2025-04-02 18:37:04: Failed jobs: 28 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 2 (7%/30), waiting for jobs (2 left), finished 0 jobs
2025-04-02 18:37:05: Failed jobs: 28 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 2 (7%/30), waiting for old jobs to finish (2 left)
2025-04-02 18:37:11: Failed jobs: 28 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 2 (7%/30), waiting for jobs (2 left), finished 0 jobs
2025-04-02 18:37:11: Failed jobs: 28 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 2 (7%/30), waiting for old jobs to finish (2 left)
2025-04-02 18:37:18: Failed jobs: 28 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 2 (7%/30), waiting for jobs (2 left), finished 0 jobs
2025-04-02 18:37:18: Failed jobs: 28 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 2 (7%/30), waiting for old jobs to finish (2 left)
2025-04-02 18:37:25: Failed jobs: 28 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 2 (7%/30), waiting for jobs (2 left), finished 0 jobs
2025-04-02 18:37:25: Failed jobs: 28 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 2 (7%/30), waiting for old jobs to finish (2 left)
2025-04-02 18:37:31: Failed jobs: 28 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 2 (7%/30), waiting for jobs (2 left), finished 0 jobs
2025-04-02 18:37:31: Failed jobs: 28 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 2 (7%/30), waiting for old jobs to finish (2 left)
2025-04-02 18:37:38: Failed jobs: 28 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 2 (7%/30), waiting for jobs (2 left), finished 0 jobs
2025-04-02 18:37:39: Failed jobs: 28 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, failed 2 (7%/30), waiting for old jobs to finish (2 left)
2025-04-02 18:37:59: Failed jobs: 28 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, failed 2 (7%/30), job_failed
2025-04-02 18:38:18: Failed jobs: 29 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, failed 1 (3%/30), job_failed
2025-04-02 18:38:21: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, waiting for jobs (2 left), finished 2 jobs
2025-04-02 18:38:22: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, finished 0 jobs
2025-04-02 18:38:22: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, trying to get 30 next steps (current done: 0, max: 500)
2025-04-02 18:38:23: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, finishing jobs (_get_next_trials), finished 0 jobs
2025-04-02 18:38:23: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #1/30
2025-04-02 18:38:23: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #2/30 | ETA: 20s
2025-04-02 18:38:24: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #3/30 | ETA: 18s
2025-04-02 18:38:25: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #4/30 | ETA: 18s
2025-04-02 18:38:26: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #5/30 | ETA: 17s
2025-04-02 18:38:26: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #6/30 | ETA: 16s
2025-04-02 18:38:27: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #7/30 | ETA: 16s
2025-04-02 18:38:28: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #8/30 | ETA: 15s
2025-04-02 18:38:29: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #9/30 | ETA: 15s
2025-04-02 18:38:29: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #10/30 | ETA: 14s
2025-04-02 18:38:30: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #11/30 | ETA: 14s
2025-04-02 18:38:31: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #12/30 | ETA: 13s
2025-04-02 18:38:32: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #13/30 | ETA: 12s
2025-04-02 18:38:32: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #14/30 | ETA: 11s
2025-04-02 18:38:33: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #15/30 | ETA: 10s
2025-04-02 18:38:33: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #16/30 | ETA: 9s
2025-04-02 18:38:33: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #17/30 | ETA: 8s
2025-04-02 18:38:34: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #18/30 | ETA: 8s
2025-04-02 18:38:34: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #19/30 | ETA: 7s
2025-04-02 18:38:35: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #20/30 | ETA: 6s
2025-04-02 18:38:35: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #21/30 | ETA: 6s
2025-04-02 18:38:36: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #22/30 | ETA: 5s
2025-04-02 18:38:37: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #23/30 | ETA: 4s
2025-04-02 18:38:37: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #24/30 | ETA: 4s
2025-04-02 18:38:38: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #25/30 | ETA: 3s
2025-04-02 18:38:38: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #26/30 | ETA: 2s
2025-04-02 18:38:39: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #27/30 | ETA: 2s
2025-04-02 18:38:39: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #28/30 | ETA: 1s
2025-04-02 18:38:40: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #29/30 | ETA: 1s
2025-04-02 18:38:40: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, getting new hyperparameter set #30/30 | ETA: 0s
2025-04-02 18:38:41: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, starting parameter set
2025-04-02 18:38:41: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, starting new job
2025-04-02 18:38:43: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, unknown 1 (3%/30), started new job
2025-04-02 18:38:43: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, unknown 1 (3%/30), starting parameter set
2025-04-02 18:38:44: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 1 (3%/30), starting new job
2025-04-02 18:38:47: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 1/1 (7%/30), started new job
2025-04-02 18:38:47: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 1/1 (7%/30), starting parameter set
2025-04-02 18:38:48: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 1/1 (7%/30), starting new job
2025-04-02 18:38:50: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 1/2 (10%/30), started new job
2025-04-02 18:38:50: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 1/2 (10%/30), starting parameter set
2025-04-02 18:38:51: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 3 (10%/30), starting new job
2025-04-02 18:38:54: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 3/1 (13%/30), started new job
2025-04-02 18:38:54: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 3/1 (13%/30), starting parameter set
2025-04-02 18:38:55: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 4 (13%/30), starting new job
2025-04-02 18:38:57: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 4/1 (17%/30), started new job
2025-04-02 18:38:57: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 4/1 (17%/30), starting parameter set
2025-04-02 18:38:57: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 4/1 (17%/30), starting new job
2025-04-02 18:38:59: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 4/2 (20%/30), started new job
2025-04-02 18:38:59: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 4/2 (20%/30), starting parameter set
2025-04-02 18:38:59: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 4/2 (20%/30), starting new job
2025-04-02 18:39:01: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 5/2 (23%/30), started new job
2025-04-02 18:39:01: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 5/2 (23%/30), starting parameter set
2025-04-02 18:39:02: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 5/2 (23%/30), starting new job
2025-04-02 18:39:04: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 6/2 (27%/30), started new job
2025-04-02 18:39:04: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 6/2 (27%/30), starting parameter set
2025-04-02 18:39:04: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 6/2 (27%/30), starting new job
2025-04-02 18:39:06: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 6/3 (30%/30), started new job
2025-04-02 18:39:06: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 6/3 (30%/30), starting parameter set
2025-04-02 18:39:07: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 9 (30%/30), starting new job
2025-04-02 18:39:10: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 9/1 (33%/30), started new job
2025-04-02 18:39:10: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 9/1 (33%/30), starting parameter set
2025-04-02 18:39:11: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 10 (33%/30), starting new job
2025-04-02 18:39:13: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 10/1 (37%/30), started new job
2025-04-02 18:39:13: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 10/1 (37%/30), starting parameter set
2025-04-02 18:39:14: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 10/1 (37%/30), starting new job
2025-04-02 18:39:17: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 10/2 (40%/30), started new job
2025-04-02 18:39:17: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 10/2 (40%/30), starting parameter set
2025-04-02 18:39:18: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 12 (40%/30), starting new job
2025-04-02 18:39:20: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 12/1 (43%/30), started new job
2025-04-02 18:39:20: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 12/1 (43%/30), starting parameter set
2025-04-02 18:39:21: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 12/1 (43%/30), starting new job
2025-04-02 18:39:23: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 13/1 (47%/30), started new job
2025-04-02 18:39:23: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 13/1 (47%/30), starting parameter set
2025-04-02 18:39:23: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 13/1 (47%/30), starting new job
2025-04-02 18:39:25: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 13/2 (50%/30), started new job
2025-04-02 18:39:25: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 13/2 (50%/30), starting parameter set
2025-04-02 18:39:25: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 13/2 (50%/30), starting new job
2025-04-02 18:39:27: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 13/3 (53%/30), started new job
2025-04-02 18:39:27: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 13/3 (53%/30), starting parameter set
2025-04-02 18:39:28: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 13/3 (53%/30), starting new job
2025-04-02 18:39:30: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 15/2 (57%/30), started new job
2025-04-02 18:39:30: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 15/2 (57%/30), starting parameter set
2025-04-02 18:39:30: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 15/2 (57%/30), starting new job
2025-04-02 18:39:34: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 17/1 (60%/30), started new job
2025-04-02 18:39:34: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 17/1 (60%/30), starting parameter set
2025-04-02 18:39:35: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 17/1 (60%/30), starting new job
2025-04-02 18:39:37: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 17/2 (63%/30), started new job
2025-04-02 18:39:37: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 17/2 (63%/30), starting parameter set
2025-04-02 18:39:38: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 18/1 (63%/30), starting new job
2025-04-02 18:39:41: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 19/1 (67%/30), started new job
2025-04-02 18:39:41: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 19/1 (67%/30), starting parameter set
2025-04-02 18:39:42: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 19/1 (67%/30), starting new job
2025-04-02 18:39:44: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 19/2 (70%/30), started new job
2025-04-02 18:39:44: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 19/2 (70%/30), starting parameter set
2025-04-02 18:39:44: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 19/2 (70%/30), starting new job
2025-04-02 18:39:46: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 21/1 (73%/30), started new job
2025-04-02 18:39:46: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 21/1 (73%/30), starting parameter set
2025-04-02 18:39:47: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 21/1 (73%/30), starting new job
2025-04-02 18:39:49: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 21/2 (77%/30), started new job
2025-04-02 18:39:49: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 21/2 (77%/30), starting parameter set
2025-04-02 18:39:49: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 21/2 (77%/30), starting new job
2025-04-02 18:39:51: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 23/1 (80%/30), started new job
2025-04-02 18:39:51: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 23/1 (80%/30), starting parameter set
2025-04-02 18:39:52: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 23/1 (80%/30), starting new job
2025-04-02 18:39:54: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 23/2 (83%/30), started new job
2025-04-02 18:39:54: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 23/2 (83%/30), starting parameter set
2025-04-02 18:39:55: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 23/2 (83%/30), starting new job
2025-04-02 18:39:57: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 25/1 (87%/30), started new job
2025-04-02 18:39:57: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 25/1 (87%/30), starting parameter set
2025-04-02 18:39:58: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 25/1 (87%/30), starting new job
2025-04-02 18:40:01: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 25/2 (90%/30), started new job
2025-04-02 18:40:01: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 25/2 (90%/30), starting parameter set
2025-04-02 18:40:02: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 27 (90%/30), starting new job
2025-04-02 18:40:04: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 27/1 (93%/30), started new job
2025-04-02 18:40:05: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 27/1 (93%/30), starting parameter set
2025-04-02 18:40:05: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 27/1 (93%/30), starting new job
2025-04-02 18:40:07: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 27/2 (97%/30), started new job
2025-04-02 18:40:07: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 27/2 (97%/30), starting parameter set
2025-04-02 18:40:08: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 27/2 (97%/30), starting new job
2025-04-02 18:40:10: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending/unknown 28/2 (100%/30), started new job
2025-04-02 18:40:45: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), finishing jobs after starting them, finished 0 jobs
2025-04-02 18:40:46: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), got 30, requested 30
2025-04-02 18:41:26: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), finishing previous jobs (30), finished 0 jobs
2025-04-02 18:41:27: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for old jobs to finish (30 left)
2025-04-02 18:42:07: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for jobs (30 left), finished 0 jobs
2025-04-02 18:42:07: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for old jobs to finish (30 left)
2025-04-02 18:42:51: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for jobs (30 left), finished 0 jobs
2025-04-02 18:42:51: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for old jobs to finish (30 left)
2025-04-02 18:43:33: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for jobs (30 left), finished 0 jobs
2025-04-02 18:43:33: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for old jobs to finish (30 left)
2025-04-02 18:44:15: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for jobs (30 left), finished 0 jobs
2025-04-02 18:44:15: Failed jobs: 30 ('ACCURACY: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output, 'RUNTIME: <number>' not found in output), SobolGenerator, pending 30 (100%/30), waiting for old jobs to finish (30 left)
Traceback (most recent call last):
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/runpy.py", line 86, in _run_code
exec(code, run_globals)
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/_submit.py", line 11, in <module>
submitit_main()
File "/home/s4122485/.omniax_x86_64_Python_3.10.4_barnard/lib/python3.10/site-packages/submitit/core/submission.py", line 73, in submitit_main
parser = argparse.ArgumentParser(description="Run a job")
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/argparse.py", line 1728, in __init__
self._positionals = add_group(_('positional arguments'))
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/gettext.py", line 742, in gettext
return dgettext(_current_domain, message)
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/gettext.py", line 666, in dgettext
t = translation(domain, _localedirs.get(domain, None))
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/gettext.py", line 587, in translation
mofiles = find(domain, localedir, languages, all=True)
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/gettext.py", line 558, in find
for nelang in _expand_lang(lang):
File "/software/rapids/r23.04/Python/3.10.4-GCCcore-11.3.0/lib/python3.10/gettext.py", line 212, in _expand_lang
import locale
File "<frozen importlib._bootstrap>", line 1027, in _find_and_load
File "<frozen importlib._bootstrap>", line 1002, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 945, in _find_spec
File "<frozen importlib._bootstrap_external>", line 1439, in find_spec
File "<frozen importlib._bootstrap_external>", line 1411, in _get_spec
File "<frozen importlib._bootstrap_external>", line 1577, in find_spec
File "<frozen importlib._bootstrap_external>", line 161, in _path_isfile
File "<frozen importlib._bootstrap_external>", line 153, in _path_is_mode_type
File "<frozen importlib._bootstrap_external>", line 147, in _path_stat
KeyboardInterrupt