Experiment overview
| Setting | Value |
|---|
| Model for non-random steps | BOTORCH_MODULAR |
| Max. nr. evaluations | 500 |
| Number random steps | 20 |
| Nr. of workers (parameter) | 20 |
| Main process memory (GB) | 8 |
| Worker memory (GB) | 10 |
Job Summary per Generation Node
| Generation Node | Total | FAILED | RUNNING |
|---|
| SOBOL | 35 | 34 | 1 |
Experiment parameters
| Name | Type | Lower bound | Upper bound | Values | Type | Log Scale? |
|---|
| epochs | range | 10 | 200 | | int | No |
| lr | range | 1e-05 | 0.1 | | float | No |
| batch_size | range | 8 | 2048 | | int | No |
| hidden_size | range | 8 | 2048 | | int | No |
| dropout | range | 0 | 0.5 | | float | No |
| activation | fixed | | | leaky_relu | | |
| num_dense_layers | range | 1 | 4 | | int | No |
| init | fixed | | | normal | | |
| weight_decay | range | 0 | 1 | | float | No |
Number of evaluations
| Failed |
Succeeded |
Running |
Total |
| 34 |
0 |
1 |
35 |
Result names and types
Last progressbar status
2025-07-31 14:07:36: Sobol, failed: 34 ('VAL_ACC: <FLOAT>' not found), running 1∑1 (5%/20), finishing jobs (_get_next_trials), finished 1 job
Git-Version
Commit: 561f8bab39c1f7b1122bd994d62bbc93a318a44a (7752)
trial_index,submit_time,queue_time,start_time,end_time,run_time,program_string,VAL_ACC,exit_code,signal,hostname,OO_Info_SLURM_JOB_ID,arm_name,trial_status,generation_node,epochs,lr,batch_size,hidden_size,dropout,num_dense_layers,weight_decay,activation,init
0,1753961644,45,1753961689,1753961799,110,python3 .tests/mnist/train --epochs 80 --learning_rate 0.08916501283109189158 --batch_size 1389 --hidden_size 79 --dropout 0.22175358235836029053 --activation leaky_relu --num_dense_layers 4 --init normal --weight_decay 0.01646918617188930511,,1,,c142,530624,0_0,FAILED,SOBOL,80,0.089165012831091891576384966811,1389,79,0.22175358235836029052734375,4,0.01646918617188930511474609375,leaky_relu,normal
1,1753961674,44,1753961718,1753961798,80,python3 .tests/mnist/train --epochs 111 --learning_rate 0.0251600005546771012 --batch_size 589 --hidden_size 1218 --dropout 0.44397135823965072632 --activation leaky_relu --num_dense_layers 1 --init normal --weight_decay 0.66685931850224733353,,1,,c152,530625,1_0,FAILED,SOBOL,111,0.025160000554677101197720290315,589,1218,0.443971358239650726318359375,1,0.666859318502247333526611328125,leaky_relu,normal
2,1753961708,44,1753961752,1753961795,43,python3 .tests/mnist/train --epochs 155 --learning_rate 0.07151115785544738535 --batch_size 1863 --hidden_size 729 --dropout 0.32479815417900681496 --activation leaky_relu --num_dense_layers 2 --init normal --weight_decay 0.32097789552062749863,,1,,c150,530626,2_0,FAILED,SOBOL,155,0.071511157855447385345293298542,1863,729,0.324798154179006814956665039062,2,0.320977895520627498626708984375,leaky_relu,normal
3,1753961744,23,1753961767,1753961798,31,python3 .tests/mnist/train --epochs 29 --learning_rate 0.00750153329272754479 --batch_size 115 --hidden_size 1584 --dropout 0.10267951618880033493 --activation leaky_relu --num_dense_layers 3 --init normal --weight_decay 0.98699204251170158386,,1,,c142,530628,3_0,FAILED,SOBOL,29,0.00750153329272754479384310855,115,1584,0.102679516188800334930419921875,3,0.9869920425117015838623046875,leaky_relu,normal
4,1753961776,35,1753961811,1753961830,19,python3 .tests/mnist/train --epochs 50 --learning_rate 0.05602100089317188503 --batch_size 948 --hidden_size 1814 --dropout 0.05342986015602946281 --activation leaky_relu --num_dense_layers 4 --init normal --weight_decay 0.48823537398129701614,,1,,c141,530630,4_0,FAILED,SOBOL,50,0.056021000893171885026688983089,948,1814,0.053429860156029462814331054688,4,0.488235373981297016143798828125,leaky_relu,normal
5,1753961812,17,1753961829,1753961841,12,python3 .tests/mnist/train --epochs 187 --learning_rate 0.01691276749213226419 --batch_size 1185 --hidden_size 1010 --dropout 0.26857524551451206207 --activation leaky_relu --num_dense_layers 1 --init normal --weight_decay 0.82221839390695095062,,1,,c152,530631,5_0,FAILED,SOBOL,187,0.016912767492132264185444867621,1185,1010,0.26857524551451206207275390625,1,0.82221839390695095062255859375,leaky_relu,normal
6,1753961870,18,1753961888,1753961900,12,python3 .tests/mnist/train --epochs 138 --learning_rate 0.08600430938054808017 --batch_size 418 --hidden_size 1419 --dropout 0.3996083294041454792 --activation leaky_relu --num_dense_layers 2 --init normal --weight_decay 0.16748369857668876648,,1,,c152,530632,6_0,FAILED,SOBOL,138,0.086004309380548080166128954716,418,1419,0.399608329404145479202270507812,2,0.1674836985766887664794921875,leaky_relu,normal
7,1753961925,23,1753961948,1753961960,12,python3 .tests/mnist/train --epochs 95 --learning_rate 0.04689761343931780208 --batch_size 1715 --hidden_size 389 --dropout 0.18408917728811502457 --activation leaky_relu --num_dense_layers 3 --init normal --weight_decay 0.51709270384162664413,,1,,c152,530633,7_0,FAILED,SOBOL,95,0.046897613439317802075390062555,1715,389,0.184089177288115024566650390625,3,0.517092703841626644134521484375,leaky_relu,normal
8,1753961990,18,1753962008,1753962021,13,python3 .tests/mnist/train --epochs 91 --learning_rate 0.06362989498381503572 --batch_size 294 --hidden_size 884 --dropout 0.49358150968328118324 --activation leaky_relu --num_dense_layers 3 --init normal --weight_decay 0.41667255200445652008,,1,,c152,530634,8_0,FAILED,SOBOL,91,0.063629894983815035724994402244,294,884,0.493581509683281183242797851562,3,0.41667255200445652008056640625,leaky_relu,normal
9,1753962047,23,1753962070,1753962082,12,python3 .tests/mnist/train --epochs 145 --learning_rate 0.00265190034916624453 --batch_size 1588 --hidden_size 1943 --dropout 0.21569199766963720322 --activation leaky_relu --num_dense_layers 2 --init normal --weight_decay 0.76628235820680856705,,1,,c152,530636,9_0,FAILED,SOBOL,145,0.002651900349166244532511660381,1588,1943,0.215691997669637203216552734375,2,0.766282358206808567047119140625,leaky_relu,normal
10,1753962106,25,1753962131,1753962143,12,python3 .tests/mnist/train --epochs 189 --learning_rate 0.09440943574747071021 --batch_size 825 --hidden_size 514 --dropout 0.08487633382901549339 --activation leaky_relu --num_dense_layers 1 --init normal --weight_decay 0.2371791033074259758,,1,,c152,530639,10_0,FAILED,SOBOL,189,0.094409435747470710209583444339,825,514,0.084876333829015493392944335938,1,0.237179103307425975799560546875,leaky_relu,normal
11,1753962170,17,1753962187,1753962200,13,python3 .tests/mnist/train --epochs 40 --learning_rate 0.03342687603984959704 --batch_size 1058 --hidden_size 1289 --dropout 0.36265135928988456726 --activation leaky_relu --num_dense_layers 4 --init normal --weight_decay 0.57116489112377166748,,1,,c152,530640,11_0,FAILED,SOBOL,40,0.033426876039849597044284479352,1058,1289,0.3626513592898845672607421875,4,0.57116489112377166748046875,leaky_relu,normal
12,1753962228,20,1753962248,1753962266,18,python3 .tests/mnist/train --epochs 13 --learning_rate 0.07882201373239978992 --batch_size 1990 --hidden_size 1089 --dropout 0.29373312415555119514 --activation leaky_relu --num_dense_layers 3 --init normal --weight_decay 0.07178688887506723404,,1,,c143,530642,12_0,FAILED,SOBOL,13,0.0788220137323997899203575912,1990,1089,0.293733124155551195144653320312,3,0.071786888875067234039306640625,leaky_relu,normal
13,1753962291,23,1753962314,1753962326,12,python3 .tests/mnist/train --epochs 174 --learning_rate 0.04293613815520890692 --batch_size 239 --hidden_size 205 --dropout 0.00925950426608324051 --activation leaky_relu --num_dense_layers 2 --init normal --weight_decay 0.73780404962599277496,,1,,c143,530643,13_0,FAILED,SOBOL,174,0.042936138155208906919124700607,239,205,0.009259504266083240509033203125,2,0.73780404962599277496337890625,leaky_relu,normal
14,1753962357,14,1753962371,1753962384,13,python3 .tests/mnist/train --epochs 124 --learning_rate 0.06037192694609054555 --batch_size 1516 --hidden_size 1713 --dropout 0.1282228897325694561 --activation leaky_relu --num_dense_layers 1 --init normal --weight_decay 0.26752330362796783447,,1,,c143,530644,14_0,FAILED,SOBOL,124,0.060371926946090545551548700587,1516,1713,0.128222889732569456100463867188,1,0.26752330362796783447265625,leaky_relu,normal
15,1753962429,29,1753962458,1753962470,12,python3 .tests/mnist/train --epochs 58 --learning_rate 0.02448754114976153112 --batch_size 713 --hidden_size 604 --dropout 0.41308568231761455536 --activation leaky_relu --num_dense_layers 4 --init normal --weight_decay 0.91791448276489973068,,1,,c143,530645,15_0,FAILED,SOBOL,58,0.024487541149761531122930335869,713,604,0.41308568231761455535888671875,4,0.917914482764899730682373046875,leaky_relu,normal
16,1753962488,56,1753962544,1753962562,18,python3 .tests/mnist/train --epochs 69 --learning_rate 0.058332195499809468 --batch_size 1626 --hidden_size 1522 --dropout 0.10946923913434147835 --activation leaky_relu --num_dense_layers 2 --init normal --weight_decay 0.62915977928787469864,,1,,c138,530646,16_0,FAILED,SOBOL,69,0.058332195499809467997831546882,1626,1522,0.109469239134341478347778320312,2,0.629159779287874698638916015625,leaky_relu,normal
17,1753962546,33,1753962579,1753962592,13,python3 .tests/mnist/train --epochs 123 --learning_rate 0.0193200707508437361 --batch_size 385 --hidden_size 285 --dropout 0.33366213459521532059 --activation leaky_relu --num_dense_layers 3 --init normal --weight_decay 0.06079890020191669464,,1,,c143,530649,17_0,FAILED,SOBOL,123,0.019320070750843736095969660482,385,285,0.333662134595215320587158203125,3,0.06079890020191669464111328125,leaky_relu,normal
18,1753962589,19,1753962608,1753962620,12,python3 .tests/mnist/train --epochs 167 --learning_rate 0.07738881213648245161 --batch_size 1152 --hidden_size 1918 --dropout 0.4683686564676463604 --activation leaky_relu --num_dense_layers 4 --init normal --weight_decay 0.96503197401762008667,,1,,c143,530650,18_0,FAILED,SOBOL,167,0.077388812136482451609076349541,1152,1918,0.468368656467646360397338867188,4,0.965031974017620086669921875,leaky_relu,normal
19,1753962660,9,1753962669,1753962687,18,python3 .tests/mnist/train --epochs 17 --learning_rate 0.03838130051192828462 --batch_size 859 --hidden_size 906 --dropout 0.24432079307734966278 --activation leaky_relu --num_dense_layers 1 --init normal --weight_decay 0.34979702066630125046,,1,,c152,530657,19_0,FAILED,SOBOL,17,0.038381300511928284624474372322,859,906,0.24432079307734966278076171875,1,0.349797020666301250457763671875,leaky_relu,normal
20,1753962737,24,1753962761,1753962773,12,python3 .tests/mnist/train --epochs 38 --learning_rate 0.0993968242518417644 --batch_size 149 --hidden_size 705 --dropout 0.16185656795278191566 --activation leaky_relu --num_dense_layers 2 --init normal --weight_decay 0.85100083239376544952,,1,,c152,530658,20_0,FAILED,SOBOL,38,0.099396824251841764397141787413,149,705,0.161856567952781915664672851562,2,0.85100083239376544952392578125,leaky_relu,normal
21,1753962776,11,1753962787,1753962800,13,python3 .tests/mnist/train --epochs 199 --learning_rate 0.03529262849685736725 --batch_size 1953 --hidden_size 1607 --dropout 0.37505544628947973251 --activation leaky_relu --num_dense_layers 3 --init normal --weight_decay 0.46623474452644586563,,1,,c152,530659,21_0,FAILED,SOBOL,199,0.035292628496857367248473735799,1953,1607,0.375055446289479732513427734375,3,0.466234744526445865631103515625,leaky_relu,normal
22,1753962846,36,1753962882,1753962894,12,python3 .tests/mnist/train --epochs 150 --learning_rate 0.06766908630040474604 --batch_size 679 --hidden_size 55 --dropout 0.25998315727338194847 --activation leaky_relu --num_dense_layers 4 --init normal --weight_decay 0.56164507102221250534,,1,,c152,530660,22_0,FAILED,SOBOL,150,0.067669086300404746037173708828,679,55,0.259983157273381948471069335938,4,0.561645071022212505340576171875,leaky_relu,normal
23,1753962911,28,1753962939,1753962951,12,python3 .tests/mnist/train --epochs 84 --learning_rate 0.00356335271311923911 --batch_size 1423 --hidden_size 1242 --dropout 0.04642565175890922546 --activation leaky_relu --num_dense_layers 1 --init normal --weight_decay 0.13000305742025375366,,1,,c152,530661,23_0,FAILED,SOBOL,84,0.003563352713119239106170921261,1423,1242,0.0464256517589092254638671875,1,0.130003057420253753662109375,leaky_relu,normal
24,1753962979,22,1753963001,1753963013,12,python3 .tests/mnist/train --epochs 103 --learning_rate 0.08279243571025320103 --batch_size 552 --hidden_size 1737 --dropout 0.35390670923516154289 --activation leaky_relu --num_dense_layers 1 --init normal --weight_decay 0.81074166018515825272,,1,,c152,530662,24_0,FAILED,SOBOL,103,0.0827924357102532010310724786,552,1737,0.353906709235161542892456054688,1,0.810741660185158252716064453125,leaky_relu,normal
25,1753963044,14,1753963058,1753963071,13,python3 .tests/mnist/train --epochs 133 --learning_rate 0.04680737581638619998 --batch_size 1299 --hidden_size 580 --dropout 0.07796370424330234528 --activation leaky_relu --num_dense_layers 4 --init normal --weight_decay 0.37910236231982707977,,1,,c152,530663,25_0,FAILED,SOBOL,133,0.046807375816386199984808769159,1299,580,0.07796370424330234527587890625,4,0.37910236231982707977294921875,leaky_relu,normal
26,1753963111,33,1753963144,1753963162,18,python3 .tests/mnist/train --epochs 177 --learning_rate 0.05029249529955909237 --batch_size 22 --hidden_size 1113 --dropout 0.19324578391388058662 --activation leaky_relu --num_dense_layers 3 --init normal --weight_decay 0.59985420480370521545,,1,,c138,530666,26_0,FAILED,SOBOL,177,0.050292495299559092369889867769,22,1113,0.193245783913880586624145507812,3,0.5998542048037052154541015625,leaky_relu,normal
27,1753963170,8,1753963178,1753963191,13,python3 .tests/mnist/train --epochs 52 --learning_rate 0.01431200085115619074 --batch_size 1829 --hidden_size 181 --dropout 0.46905916277319192886 --activation leaky_relu --num_dense_layers 2 --init normal --weight_decay 0.21508898492902517319,,1,,c143,530668,27_0,FAILED,SOBOL,52,0.014312000851156190736612749959,1829,181,0.469059162773191928863525390625,2,0.215088984929025173187255859375,leaky_relu,normal
28,1753963247,22,1753963269,1753963282,13,python3 .tests/mnist/train --epochs 25 --learning_rate 0.0722024794989638008 --batch_size 1275 --hidden_size 410 --dropout 0.43726937612518668175 --activation leaky_relu --num_dense_layers 1 --init normal --weight_decay 0.71593372337520122528,,1,,c152,530670,28_0,FAILED,SOBOL,25,0.072202479498963800796929035641,1275,410,0.437269376125186681747436523438,1,0.71593372337520122528076171875,leaky_relu,normal
29,1753963307,22,1753963329,1753963341,12,python3 .tests/mnist/train --epochs 162 --learning_rate 0.01132059388888068639 --batch_size 986 --hidden_size 1392 --dropout 0.15082063525915145874 --activation leaky_relu --num_dense_layers 4 --init normal --weight_decay 0.10069986898452043533,,1,,c143,530673,29_0,FAILED,SOBOL,162,0.011320593888880686392339747215,986,1392,0.150820635259151458740234375,4,0.100699868984520435333251953125,leaky_relu,normal
30,1753963375,16,1753963391,1753963404,13,python3 .tests/mnist/train --epochs 112 --learning_rate 0.09203129859489389553 --batch_size 1750 --hidden_size 780 --dropout 0.01589666539803147316 --activation leaky_relu --num_dense_layers 3 --init normal --weight_decay 0.8803047453984618187,,1,,c143,530676,30_0,FAILED,SOBOL,112,0.092031298594893895526070082269,1750,780,0.015896665398031473159790039062,3,0.880304745398461818695068359375,leaky_relu,normal
31,1753963433,22,1753963455,1753963467,12,python3 .tests/mnist/train --epochs 70 --learning_rate 0.03114792283145710952 --batch_size 511 --hidden_size 2047 --dropout 0.30268868338316679001 --activation leaky_relu --num_dense_layers 2 --init normal --weight_decay 0.31194681301712989807,,1,,c143,530677,31_0,FAILED,SOBOL,70,0.031147922831457109521524628803,511,2047,0.302688683383166790008544921875,2,0.3119468130171298980712890625,leaky_relu,normal
32,1753963495,14,1753963509,1753963521,12,python3 .tests/mnist/train --epochs 74 --learning_rate 0.06908669874296523294 --batch_size 795 --hidden_size 1258 --dropout 0.17544006090611219406 --activation leaky_relu --num_dense_layers 2 --init normal --weight_decay 0.94010718166828155518,,1,,c143,530678,32_0,FAILED,SOBOL,74,0.069086698742965232944435172158,795,1258,0.175440060906112194061279296875,2,0.94010718166828155517578125,leaky_relu,normal
33,1753963562,10,1753963572,1753963584,12,python3 .tests/mnist/train --epochs 115 --learning_rate 0.0082049321440048513 --batch_size 1087 --hidden_size 38 --dropout 0.39656730974093079567 --activation leaky_relu --num_dense_layers 3 --init normal --weight_decay 0.3678400842472910881,,1,,c143,530679,33_0,FAILED,SOBOL,115,0.008204932144004851296559266416,1087,38,0.396567309740930795669555664062,3,0.367840084247291088104248046875,leaky_relu,normal
34,1753963630,30,1753963660,1753963672,12,python3 .tests/mnist/train --epochs 159 --learning_rate 0.08890409854473546591 --batch_size 321 --hidden_size 1654 --dropout 0.27747420966625213623 --activation leaky_relu --num_dense_layers 4 --init normal --weight_decay 0.65121585968881845474,,1,,c142,530688,34_0,RUNNING,SOBOL,159,0.088904098544735465914357064321,321,1654,0.27747420966625213623046875,4,0.651215859688818454742431640625,leaky_relu,normal
To cancel, press CTRL c, then run 'scancel 530622'
⠋ Importing logging...
⠋ Importing warnings...
⠋ Importing argparse...
⠋ Importing datetime...
⠋ Importing dataclass...
⠋ Importing hashlib...
⠋ Importing socket...
⠋ Importing stat...
⠋ Importing pwd...
⠋ Importing signal...
⠋ Importing base64...
⠋ Importing json...
⠋ Importing yaml...
⠋ Importing toml...
⠋ Importing csv...
⠋ Importing ast...
⠋ Importing rich.table...
⠋ Importing rich print...
⠋ Importing rich.pretty...
⠋ Importing rich.prompt...
⠋ Importing types.FunctionType...
⠋ Importing typing...
⠋ Importing ThreadPoolExecutor...
⠙ Importing submitit.LocalExecutor...
⠋ Importing submitit.Job...
⠋ Importing importlib.util...
⠋ Importing inspect...
⠋ Importing platform...
⠋ Importing inspect frame info...
⠋ Importing pathlib.Path...
⠋ Importing uuid...
⠋ Importing traceback...
⠋ Importing cowsay...
⠋ Importing psutil...
⠋ Importing shutil...
⠋ Importing itertools.combinations...
⠋ Importing os.listdir...
⠋ Importing os.path...
⠋ Importing PIL.Image...
⠋ Importing sixel...
⠋ Importing subprocess...
⠋ Importing tqdm...
⠹ Importing beartype...
⠋ Importing statistics...
⠋ Trying to import pyfiglet...
⠦ Importing helpers...
⠋ Parsing arguments...
⠴ Importing torch...
⠋ Importing numpy...
⠋ Importing collections...
⠦ Importing ax...
⠋ Importing ax.core.generator_run...
⠋ Importing Cont_X_trans and Y_trans from ax.modelbridge.registry...
⠋ Importing ax.core.arm...
⠋ Importing ax.core.objective...
⠋ Importing ax.core.Metric...
⠋ Importing ax.exceptions.core...
⠋ Importing ax.exceptions.generation_strategy...
⠋ Importing CORE_DECODER_REGISTRY...
⠋ Trying ax.generation_strategy.generation_node...
⠋ Importing GenerationStep, GenerationStrategy from generation_strategy...
⠋ Importing GenerationNode from generation_node...
⠋ Importing ExternalGenerationNode...
⠋ Importing MaxTrials...
⠋ Importing GeneratorSpec...
⠋ Importing Models from ax.modelbridge.registry...
⠋ Importing get_pending_observation_features...
⠋ Importing load_experiment...
⠋ Importing save_experiment...
⠋ Importing save_experiment_to_db...
⠋ Importing TrialStatus...
⠋ Importing Data...
⠋ Importing Experiment...
⠋ Importing parameter types...
⠋ Importing TParameterization...
⠋ Importing pandas...
⠋ Importing AxClient and ObjectiveProperties...
⠋ Importing RandomForestRegressor...
⠋ Importing botorch...
⠋ Importing submitit...
⠋ Importing ax logger...
⠋ Importing SQL-Storage-Stuff...
Run-UUID: 7bc6c3a3-2f2a-4b61-b151-236ed8aa1afc
_________________________________________________
/ \
| OmniOpt2 - Makes grid search look like it's still |
| on dial-up. |
\ /
=================================================
\
\
\
\
/ \\ //\\
|\\___/| / \\// \\\\
/0 0 \\__ / // | \\ \\
/ / \\/_/ // | \\ \\
\@_^_\@'/ \\/_ // | \\ \\
//_^_/ \\/_ // | \\ \\
( //) | \\/// | \\ \\
( / /) _|_ / ) // | \\ _\\
( // /) '/,_ _ _/ ( ; -. | _ _\\.-~ .-~~~^-.
(( / / )) ,-{ _ `-.|.-~-. .~ `.
(( // / )) '/\\ / ~-. _ .-~ .-~^-. \\
(( /// )) `. { } / \\ \\
(( / )) .----~-.\\ \\-' .~ \\ `. \\^-.
///.----..> \\ _ -~ `. ^-` ^-_
///-._ _ _ _ _ _ _}^ - - - - ~ ~-- ,.-~
/.-~
⠋ Writing worker creation log...
omniopt --partition=alpha --experiment_name=mnist_gpu_noall --mem_gb=10 --time=2880 --worker_timeout=120 --max_eval=500 --num_parallel_jobs=20 --gpus=1 --num_random_steps=20 --follow --live_share --send_anonymized_usage_stats --result_names VAL_ACC=max --run_program=cHl0aG9uMyAudGVzdHMvbW5pc3QvdHJhaW4gLS1lcG9jaHMgJWVwb2NocyAtLWxlYXJuaW5nX3JhdGUgJWxyIC0tYmF0Y2hfc2l6ZSAlYmF0Y2hfc2l6ZSAtLWhpZGRlbl9zaXplICVoaWRkZW5fc2l6ZSAtLWRyb3BvdXQgJWRyb3BvdXQgLS1hY3RpdmF0aW9uICVhY3RpdmF0aW9uIC0tbnVtX2RlbnNlX2xheWVycyAlbnVtX2RlbnNlX2xheWVycyAtLWluaXQgJWluaXQgLS13ZWlnaHRfZGVjYXkgJXdlaWdodF9kZWNheQ== --cpus_per_task=1 --nodes_per_job=1 --revert_to_random_when_seemingly_exhausted --model=BOTORCH_MODULAR --n_estimators_randomforest=100 --run_mode=local --occ_type=euclid --main_process_gb=8 --max_nr_of_zero_results=50 --slurm_signal_delay_s=0 --max_failed_jobs=0 --max_attempts_for_generation=20 --num_restarts=20 --raw_samples=1024 --max_abandoned_retrial=20 --max_num_of_parallel_sruns=16 --parameter epochs range 10 200 int false --parameter lr range 0.00001 0.1 float false --parameter batch_size range 8 2048 int false --parameter hidden_size range 8 2048 int false --parameter dropout range 0 0.5 float false --parameter activation fixed leaky_relu --parameter num_dense_layers range 1 4 int false --parameter init fixed normal --parameter weight_decay range 0 1 float false --ui_url aHR0cHM6Ly9pbWFnZXNlZy5zY2Fkcy5kZS9vbW5pYXgvZ3VpP3BhcnRpdGlvbj1hbHBoYSZleHBlcmltZW50X25hbWU9bW5pc3RfZ3B1X25vYWxsJnJlc2VydmF0aW9uPSZhY2NvdW50PSZtZW1fZ2I9MTAmdGltZT0xNDQwJndvcmtlcl90aW1lb3V0PTEyMCZtYXhfZXZhbD01MDAmbnVtX3BhcmFsbGVsX2pvYnM9MjAmZ3B1cz0xJm51bV9yYW5kb21fc3RlcHM9MjAmZm9sbG93PTEmbGl2ZV9zaGFyZT0xJnNlbmRfYW5vbnltaXplZF91c2FnZV9zdGF0cz0xJmNvbnN0cmFpbnRzPSZyZXN1bHRfbmFtZXM9VkFMX0FDQyUzRG1heCZydW5fcHJvZ3JhbT1weXRob24zJTIwLnRlc3RzJTJGbW5pc3QlMkZ0cmFpbiUyMC0tZXBvY2hzJTIwJTI1ZXBvY2hzJTIwLS1sZWFybmluZ19yYXRlJTIwJTI1bHIlMjAtLWJhdGNoX3NpemUlMjAlMjViYXRjaF9zaXplJTIwLS1oaWRkZW5fc2l6ZSUyMCUyNWhpZGRlbl9zaXplJTIwLS1kcm9wb3V0JTIwJTI1ZHJvcG91dCUyMC0tYWN0aXZhdGlvbiUyMCUyNWFjdGl2YXRpb24lMjAtLW51bV9kZW5zZV9sYXllcnMlMjAlMjVudW1fZGVuc2VfbGF5ZXJzJTIwLS1pbml0JTIwJTI1aW5pdCUyMC0td2VpZ2h0X2RlY2F5JTIwJTI1d2VpZ2h0X2RlY2F5JmNwdXNfcGVyX3Rhc2s9MSZub2Rlc19wZXJfam9iPTEmc2VlZD0mZHJ5cnVuPTAmZGVidWc9MCZyZXZlcnRfdG9fcmFuZG9tX3doZW5fc2VlbWluZ2x5X2V4aGF1c3RlZD0xJmdyaWRzZWFyY2g9MCZtb2RlbD1CT1RPUkNIX01PRFVMQVImZXh0ZXJuYWxfZ2VuZXJhdG9yPSZuX2VzdGltYXRvcnNfcmFuZG9tZm9yZXN0PTEwMCZpbnN0YWxsYXRpb25fbWV0aG9kPWNsb25lJnJ1bl9tb2RlPWxvY2FsJmRpc2FibGVfdHFkbT0wJnZlcmJvc2VfdHFkbT0wJmZvcmNlX2xvY2FsX2V4ZWN1dGlvbj0wJmF1dG9fZXhjbHVkZV9kZWZlY3RpdmVfaG9zdHM9MCZzaG93X3NpeGVsX2dlbmVyYWw9MCZzaG93X3NpeGVsX3RyaWFsX2luZGV4X3Jlc3VsdD0wJnNob3dfc2l4ZWxfc2NhdHRlcj0wJnNob3dfd29ya2VyX3BlcmNlbnRhZ2VfdGFibGVfYXRfZW5kPTAmb2NjPTAmb2NjX3R5cGU9ZXVjbGlkJm5vX3NsZWVwPTAmc2x1cm1fdXNlX3NydW49MCZ2ZXJib3NlX2JyZWFrX3J1bl9zZWFyY2hfdGFibGU9MCZhYmJyZXZpYXRlX2pvYl9uYW1lcz0wJm1haW5fcHJvY2Vzc19nYj04Jm1heF9ucl9vZl96ZXJvX3Jlc3VsdHM9NTAmc2x1cm1fc2lnbmFsX2RlbGF5X3M9MCZtYXhfZmFpbGVkX2pvYnM9MCZleGNsdWRlPSZ1c2VybmFtZT0mZ2VuZXJhdGlvbl9zdHJhdGVneT0mcm9vdF92ZW52X2Rpcj0md29ya2Rpcj0mZG9udF9qaXRfY29tcGlsZT0wJmZpdF9vdXRfb2ZfZGVzaWduPTAmcmVmaXRfb25fY3Y9MCZzaG93X2dlbmVyYXRlX3RpbWVfdGFibGU9MCZkb250X3dhcm1fc3RhcnRfcmVmaXR0aW5nPTAmbWF4X2F0dGVtcHRzX2Zvcl9nZW5lcmF0aW9uPTIwJm51bV9yZXN0YXJ0cz0yMCZyYXdfc2FtcGxlcz0xMDI0Jm1heF9hYmFuZG9uZWRfcmV0cmlhbD0yMCZtYXhfbnVtX29mX3BhcmFsbGVsX3NydW5zPTE2JmZvcmNlX2Nob2ljZV9mb3JfcmFuZ2VzPTAmbm9fdHJhbnNmb3JtX2lucHV0cz0wJmZpdF9hYmFuZG9uZWQ9MCZub19ub3JtYWxpemVfeT0wJnZlcmJvc2U9MCZnZW5lcmF0ZV9hbGxfam9ic19hdF9vbmNlPTAmZmxhbWVfZ3JhcGg9MCZjaGVja291dF90b19sYXRlc3RfdGVzdGVkX3ZlcnNpb249MCZwYXJhbWV0ZXJfMF9uYW1lPWVwb2NocyZwYXJhbWV0ZXJfMF90eXBlPXJhbmdlJnBhcmFtZXRlcl8wX21pbj0xMCZwYXJhbWV0ZXJfMF9tYXg9MjAwJnBhcmFtZXRlcl8wX251bWJlcl90eXBlPWludCZwYXJhbWV0ZXJfMF9sb2dfc2NhbGU9ZmFsc2UmcGFyYW1ldGVyXzFfbmFtZT1sciZwYXJhbWV0ZXJfMV90eXBlPXJhbmdlJnBhcmFtZXRlcl8xX21pbj0wLjAwMDAxJnBhcmFtZXRlcl8xX21heD0wLjEmcGFyYW1ldGVyXzFfbnVtYmVyX3R5cGU9ZmxvYXQmcGFyYW1ldGVyXzFfbG9nX3NjYWxlPWZhbHNlJnBhcmFtZXRlcl8yX25hbWU9YmF0Y2hfc2l6ZSZwYXJhbWV0ZXJfMl90eXBlPXJhbmdlJnBhcmFtZXRlcl8yX21pbj04JnBhcmFtZXRlcl8yX21heD0yMDQ4JnBhcmFtZXRlcl8yX251bWJlcl90eXBlPWludCZwYXJhbWV0ZXJfMl9sb2dfc2NhbGU9ZmFsc2UmcGFyYW1ldGVyXzNfbmFtZT1oaWRkZW5fc2l6ZSZwYXJhbWV0ZXJfM190eXBlPXJhbmdlJnBhcmFtZXRlcl8zX21pbj04JnBhcmFtZXRlcl8zX21heD0yMDQ4JnBhcmFtZXRlcl8zX251bWJlcl90eXBlPWludCZwYXJhbWV0ZXJfM19sb2dfc2NhbGU9ZmFsc2UmcGFyYW1ldGVyXzRfbmFtZT1kcm9wb3V0JnBhcmFtZXRlcl80X3R5cGU9cmFuZ2UmcGFyYW1ldGVyXzRfbWluPTAmcGFyYW1ldGVyXzRfbWF4PTAuNSZwYXJhbWV0ZXJfNF9udW1iZXJfdHlwZT1mbG9hdCZwYXJhbWV0ZXJfNF9sb2dfc2NhbGU9ZmFsc2UmcGFyYW1ldGVyXzVfbmFtZT1hY3RpdmF0aW9uJnBhcmFtZXRlcl81X3R5cGU9Zml4ZWQmcGFyYW1ldGVyXzVfdmFsdWU9bGVha3lfcmVsdSZwYXJhbWV0ZXJfNl9uYW1lPW51bV9kZW5zZV9sYXllcnMmcGFyYW1ldGVyXzZfdHlwZT1yYW5nZSZwYXJhbWV0ZXJfNl9taW49MSZwYXJhbWV0ZXJfNl9tYXg9NCZwYXJhbWV0ZXJfNl9udW1iZXJfdHlwZT1pbnQmcGFyYW1ldGVyXzZfbG9nX3NjYWxlPWZhbHNlJnBhcmFtZXRlcl83X25hbWU9aW5pdCZwYXJhbWV0ZXJfN190eXBlPWZpeGVkJnBhcmFtZXRlcl83X3ZhbHVlPW5vcm1hbCZwYXJhbWV0ZXJfOF9uYW1lPXdlaWdodF9kZWNheSZwYXJhbWV0ZXJfOF90eXBlPXJhbmdlJnBhcmFtZXRlcl84X21pbj0wJnBhcmFtZXRlcl84X21heD0xJnBhcmFtZXRlcl84X251bWJlcl90eXBlPWZsb2F0JnBhcmFtZXRlcl84X2xvZ19zY2FsZT1mYWxzZSZwYXJ0aXRpb249YWxwaGEmbnVtX3BhcmFtZXRlcnM9OQ==
⠋ Disabling logging...
⠋ Setting run folder...
⠋ Creating folder /data/horse/ws/pwinkler-mnist_tst/omniopt/runs/mnist_gpu_noall/0...
⠋ Writing revert_to_random_when_seemingly_exhausted file ...
⠋ Writing username state file...
⠋ Writing result names file...
⠋ Writing result min/max file...
⠋ Saving state files...
Run-folder: /data/horse/ws/pwinkler-mnist_tst/omniopt/runs/mnist_gpu_noall/0
⠋ Printing run info...
⠋ Initializing NVIDIA-Logs...
⠋ Writing ui_url file if it is present...
⠋ Writing live_share file if it is present...
⠋ Writing job_start_time file...
⠸ Writing git info file...
⠋ Checking max_eval...
⠋ Calculating number of steps...
⠋ Adding excluded nodes...
⠋ Handling random steps...
⠋ Initializing ax_client...
[WARNING 07-31 13:32:38] ax.service.ax_client: Selecting a GenerationStrategy when using BatchTrials is in beta. Double check the recommended strategy matches your expectations.
⠋ Setting orchestrator...
You have 1 CPUs available for the main process. Using CUDA device NVIDIA H100. Generation strategy: SOBOL for 20 steps and then BOTORCH_MODULAR for 480 steps.
Run-Program: python3 .tests/mnist/train --epochs %epochs --learning_rate %lr --batch_size %batch_size --hidden_size %hidden_size --dropout %dropout --activation %activation --num_dense_layers %num_dense_layers --init %init --weight_decay %weight_decay
Experiment parameters
┏━━━━━━━━━━━━━━━━━━┳━━━━━━━┳━━━━━━━━━━━━━┳━━━━━━━━━━━━━┳━━━━━━━━━━━━┳━━━━━━━┳━━━━━━━━━━━━┓
┃ Name ┃ Type ┃ Lower bound ┃ Upper bound ┃ Values ┃ Type ┃ Log Scale? ┃
┡━━━━━━━━━━━━━━━━━━╇━━━━━━━╇━━━━━━━━━━━━━╇━━━━━━━━━━━━━╇━━━━━━━━━━━━╇━━━━━━━╇━━━━━━━━━━━━┩
│ epochs │ range │ 10 │ 200 │ │ int │ No │
│ lr │ range │ 1e-05 │ 0.1 │ │ float │ No │
│ batch_size │ range │ 8 │ 2048 │ │ int │ No │
│ hidden_size │ range │ 8 │ 2048 │ │ int │ No │
│ dropout │ range │ 0 │ 0.5 │ │ float │ No │
│ activation │ fixed │ │ │ leaky_relu │ │ │
│ num_dense_layers │ range │ 1 │ 4 │ │ int │ No │
│ init │ fixed │ │ │ normal │ │ │
│ weight_decay │ range │ 0 │ 1 │ │ float │ No │
└──────────────────┴───────┴─────────────┴─────────────┴────────────┴───────┴────────────┘
Result-Names
┏━━━━━━━━━━━━━┳━━━━━━━━━━━━━┓
┃ Result-Name ┃ Min or max? ┃
┡━━━━━━━━━━━━━╇━━━━━━━━━━━━━┩
│ VAL_ACC │ max │
└─────────────┴─────────────┘
See https://imageseg.scads.de/omniax/share?user_id=pwinkler&experiment_name=mnist_gpu_noall&run_nr=4 for live-results.
█▀▀▀▀▀█ ▄ █ ▀▀▄▄▀ █▀▀ ▄▀ █▄▄ █▀▀▀▀▀█
█ ███ █ ▄▄▄ █▄ ▀▀▄ █▀▀▄▄█▄█▀▄ █ ███ █
█ ▀▀▀ █ ▄█ ▄▄▄▄▄█▀▀▀█ ▀ ▄▀▄█ █ ▀▀▀ █
▀▀▀▀▀▀▀ ▀▄█▄▀ ▀▄▀ ▀▄█▄█▄▀ █▄▀ ▀▀▀▀▀▀▀
██▀▀█▄▀███▄▀▄▀█▀▄▀▄▀█ ▀▄ █▀▀▄▀ █ █▄█
▀▀ ██▀▀▄▄▀ ▄▀ ▀█ ▄█▀ █ █▀▄▀▀▀█▀▄▀
▄▀▄ █ ▀▀▄▀▄ ▀▀█ ▄█▀▄█▄▀▄ ▀▀ ▄▀▀█▀▀█▄▀
▀▄ ▀▄▀▀ ▀█ █▀ █▀▄ ▄▄██ ▄▀▄▄█▄█▄▀▀█
█▀ █ ▀▀▄▀▄ ▀▄█▀ ▄█▄█▄▄██▄▀█ ▄▀▀ ▀▀█▄▀
▄█▄▄▄ ▀▀▀█▄ ▄▀▀▀█ █▄ ▀▀ ██▀██▀ ▀▀█
▄▄ ██ ▀▄█ █ ▀▄█▄██▄▄▄▄ ▄▀▀▀ ▄█▀▄▀███▀
█▄▀▄▀ ▀█ ▄██▀▀███▀▄ █▄▀ ▄ █▀█▄▀█ ▀█
█▀▄█▄▀▀███▄▀▄█▀▀██▄█▄▄▀█▀█▄ ▄ ▀▄▀▀██▀
█ █▄▀▀▀█ ▄█ ▄▀▀█ ▀ ▀██▄ ▀█▀█▀ ▀▀ ▀█
▀ ▀▀ ▄▀█ ▀▀█▀█▀ █▄ █▀ ▀█▄█▀▀▀██▀
█▀▀▀▀▀█ ▀▄▄█▀▀ ▀█▀▀▄ █ ▄█ █▄█ ▀ █ ▀█
█ ███ █ █▀█▀██▄▀▄▀ ▄█▄█▄ ▀█▀▀████▀▀ ▀
█ ▀▀▀ █ █▄█ ▀ █▀█ ▄ ██ ▀▄▄▄▄▄█ ▀▀█
▀▀▀▀▀▀▀ ▀▀▀ ▀ ▀ ▀ ▀▀▀ ▀▀ ▀▀▀▀
Sobol, failed: 34 ('VAL_ACC: ' not found), running 1∑1 (5%/20), finishing jobs (_get_next_trials), finished 1 job : 0%|░░░░░░░░░░| 0/500 [34:31
2025-07-31 13:33:05: SOBOL, Started OmniOpt2 run...
2025-07-31 13:33:34: Sobol, getting new HP set
2025-07-31 13:33:47: Sobol, requested 1 jobs, got 1, 13.26 s/job
2025-07-31 13:33:52: Sobol, eval #1/1 start
2025-07-31 13:34:00: Sobol, starting new job
2025-07-31 13:34:06: Sobol, unknown 1∑1 (5%/20), started new job
2025-07-31 13:34:11: Sobol, pending 1∑1 (5%/20), getting new HP set
2025-07-31 13:34:20: Sobol, pending 1∑1 (5%/20), requested 1 jobs, got 1, 8.89 s/job
2025-07-31 13:34:25: Sobol, pending 1∑1 (5%/20), eval #1/1 start
2025-07-31 13:34:29: Sobol, pending 1∑1 (5%/20), starting new job
2025-07-31 13:34:35: Sobol, running/unknown 1/1∑2 (10%/20), started new job
2025-07-31 13:34:41: Sobol, running/pending 1/1∑2 (10%/20), getting new HP set
2025-07-31 13:34:52: Sobol, running/pending 1/1∑2 (10%/20), requested 1 jobs, got 1, 10.90 s/job
2025-07-31 13:34:59: Sobol, running/pending 1/1∑2 (10%/20), eval #1/1 start
2025-07-31 13:35:03: Sobol, running/pending 1/1∑2 (10%/20), starting new job
2025-07-31 13:35:09: Sobol, running/unknown 2/1∑3 (15%/20), started new job
2025-07-31 13:35:17: Sobol, running/pending 2/1∑3 (15%/20), getting new HP set
2025-07-31 13:35:27: Sobol, running/pending 2/1∑3 (15%/20), requested 1 jobs, got 1, 9.41 s/job
2025-07-31 13:35:32: Sobol, running/pending 2/1∑3 (15%/20), eval #1/1 start
2025-07-31 13:35:38: Sobol, running/pending 2/1∑3 (15%/20), starting new job
2025-07-31 13:35:45: Sobol, running/unknown 3/1∑4 (20%/20), started new job
2025-07-31 13:35:52: Sobol, running/pending 3/1∑4 (20%/20), getting new HP set
2025-07-31 13:36:01: Sobol, running/pending 3/1∑4 (20%/20), requested 1 jobs, got 1, 10.92 s/job
2025-07-31 13:36:06: Sobol, running/pending 3/1∑4 (20%/20), eval #1/1 start
2025-07-31 13:36:11: Sobol, running/pending 3/1∑4 (20%/20), starting new job
2025-07-31 13:36:17: Sobol, running/unknown 4/1∑5 (25%/20), started new job
2025-07-31 13:36:22: Sobol, running/pending 4/1∑5 (25%/20), getting new HP set
2025-07-31 13:36:31: Sobol, running/pending 4/1∑5 (25%/20), requested 1 jobs, got 1, 9.33 s/job
2025-07-31 13:36:36: Sobol, running/pending 4/1∑5 (20%/20), eval #1/1 start
2025-07-31 13:36:47: Sobol, completed/running 4/1∑5 (5%/20), starting new job
2025-07-31 13:36:53: Sobol, completed/running/unknown 4/1/1∑6 (10%/20), started new job
2025-07-31 13:36:59: Sobol, completed/running/pending 4/1/1∑6 (10%/20), job_failed
2025-07-31 13:36:59: Sobol, completed/running/pending 4/1/1∑6 (10%/20), job_failed
2025-07-31 13:36:59: Sobol, completed/running/pending 4/1/1∑6 (10%/20), job_failed
2025-07-31 13:37:00: Sobol, completed/running/pending 4/1/1∑6 (10%/20), job_failed
2025-07-31 13:37:16: Sobol, failed: 4 ('VAL_ACC: <FLOAT>' not found), running 2∑2 (5%/20), finishing jobs (_get_next_trials), finished 4 jobs
2025-07-31 13:37:21: Sobol, failed: 4 ('VAL_ACC: <FLOAT>' not found), running 2∑2 (5%/20), getting new HP set
2025-07-31 13:37:30: Sobol, failed: 4 ('VAL_ACC: <FLOAT>' not found), completed 2∑2 (0%/20), requested 1 jobs, got 1, 9.78 s/job
2025-07-31 13:37:40: Sobol, failed: 4 ('VAL_ACC: <FLOAT>' not found), completed 2∑2 (0%/20), eval #1/1 start
2025-07-31 13:37:45: Sobol, failed: 4 ('VAL_ACC: <FLOAT>' not found), completed 2∑2 (0%/20), starting new job
2025-07-31 13:37:52: Sobol, failed: 4 ('VAL_ACC: <FLOAT>' not found), completed/unknown 2/1∑3 (5%/20), started new job
2025-07-31 13:37:57: Sobol, failed: 4 ('VAL_ACC: <FLOAT>' not found), completed/pending 2/1∑3 (5%/20), job_failed
2025-07-31 13:37:57: Sobol, failed: 4 ('VAL_ACC: <FLOAT>' not found), completed/pending 2/1∑3 (5%/20), job_failed
2025-07-31 13:38:11: Sobol, failed: 6 ('VAL_ACC: <FLOAT>' not found), running 1∑1 (5%/20), finishing jobs (_get_next_trials), finished 2 jobs
2025-07-31 13:38:16: Sobol, failed: 6 ('VAL_ACC: <FLOAT>' not found), running 1∑1 (5%/20), getting new HP set
2025-07-31 13:38:25: Sobol, failed: 6 ('VAL_ACC: <FLOAT>' not found), completed 1∑1 (0%/20), requested 1 jobs, got 1, 9.94 s/job
2025-07-31 13:38:30: Sobol, failed: 6 ('VAL_ACC: <FLOAT>' not found), completed 1∑1 (0%/20), eval #1/1 start
2025-07-31 13:38:41: Sobol, failed: 6 ('VAL_ACC: <FLOAT>' not found), completed 1∑1 (0%/20), starting new job
2025-07-31 13:38:47: Sobol, failed: 6 ('VAL_ACC: <FLOAT>' not found), completed/unknown 1/1∑2 (5%/20), started new job
2025-07-31 13:38:51: Sobol, failed: 6 ('VAL_ACC: <FLOAT>' not found), completed/pending 1/1∑2 (5%/20), job_failed
2025-07-31 13:39:01: Sobol, failed: 7 ('VAL_ACC: <FLOAT>' not found), pending 1∑1 (5%/20), finishing jobs (_get_next_trials), finished 1 job
2025-07-31 13:39:17: Sobol, failed: 7 ('VAL_ACC: <FLOAT>' not found), pending 1∑1 (5%/20), getting new HP set
2025-07-31 13:39:33: Sobol, failed: 7 ('VAL_ACC: <FLOAT>' not found), completed 1∑1 (0%/20), requested 1 jobs, got 1, 15.71 s/job
2025-07-31 13:39:39: Sobol, failed: 7 ('VAL_ACC: <FLOAT>' not found), completed 1∑1 (0%/20), eval #1/1 start
2025-07-31 13:39:45: Sobol, failed: 7 ('VAL_ACC: <FLOAT>' not found), completed 1∑1 (0%/20), starting new job
2025-07-31 13:39:52: Sobol, failed: 7 ('VAL_ACC: <FLOAT>' not found), completed/unknown 1/1∑2 (5%/20), started new job
2025-07-31 13:39:57: Sobol, failed: 7 ('VAL_ACC: <FLOAT>' not found), completed/pending 1/1∑2 (5%/20), job_failed
2025-07-31 13:40:10: Sobol, failed: 8 ('VAL_ACC: <FLOAT>' not found), running 1∑1 (5%/20), finishing jobs (_get_next_trials), finished 1 job
2025-07-31 13:40:15: Sobol, failed: 8 ('VAL_ACC: <FLOAT>' not found), running 1∑1 (5%/20), getting new HP set
2025-07-31 13:40:26: Sobol, failed: 8 ('VAL_ACC: <FLOAT>' not found), completed 1∑1 (0%/20), requested 1 jobs, got 1, 11.01 s/job
2025-07-31 13:40:31: Sobol, failed: 8 ('VAL_ACC: <FLOAT>' not found), completed 1∑1 (0%/20), eval #1/1 start
2025-07-31 13:40:41: Sobol, failed: 8 ('VAL_ACC: <FLOAT>' not found), completed 1∑1 (0%/20), starting new job
2025-07-31 13:40:48: Sobol, failed: 8 ('VAL_ACC: <FLOAT>' not found), completed/unknown 1/1∑2 (5%/20), started new job
2025-07-31 13:40:53: Sobol, failed: 8 ('VAL_ACC: <FLOAT>' not found), completed/pending 1/1∑2 (5%/20), job_failed
2025-07-31 13:41:04: Sobol, failed: 9 ('VAL_ACC: <FLOAT>' not found), running 1∑1 (5%/20), finishing jobs (_get_next_trials), finished 1 job
2025-07-31 13:41:10: Sobol, failed: 9 ('VAL_ACC: <FLOAT>' not found), running 1∑1 (5%/20), getting new HP set
2025-07-31 13:41:23: Sobol, failed: 9 ('VAL_ACC: <FLOAT>' not found), completed 1∑1 (0%/20), requested 1 jobs, got 1, 12.44 s/job
2025-07-31 13:41:30: Sobol, failed: 9 ('VAL_ACC: <FLOAT>' not found), completed 1∑1 (0%/20), eval #1/1 start
2025-07-31 13:41:41: Sobol, failed: 9 ('VAL_ACC: <FLOAT>' not found), completed 1∑1 (0%/20), starting new job
2025-07-31 13:41:48: Sobol, failed: 9 ('VAL_ACC: <FLOAT>' not found), completed/unknown 1/1∑2 (5%/20), started new job
2025-07-31 13:41:53: Sobol, failed: 9 ('VAL_ACC: <FLOAT>' not found), completed/pending 1/1∑2 (5%/20), job_failed
2025-07-31 13:42:05: Sobol, failed: 10 ('VAL_ACC: <FLOAT>' not found), pending 1∑1 (5%/20), finishing jobs (_get_next_trials), finished 1 job
2025-07-31 13:42:11: Sobol, failed: 10 ('VAL_ACC: <FLOAT>' not found), pending 1∑1 (5%/20), getting new HP set
2025-07-31 13:42:21: Sobol, failed: 10 ('VAL_ACC: <FLOAT>' not found), running 1∑1 (5%/20), requested 1 jobs, got 1, 10.92 s/job
2025-07-31 13:42:28: Sobol, failed: 10 ('VAL_ACC: <FLOAT>' not found), running 1∑1 (0%/20), eval #1/1 start
2025-07-31 13:42:43: Sobol, failed: 10 ('VAL_ACC: <FLOAT>' not found), running 1∑1 (0%/20), starting new job
2025-07-31 13:42:51: Sobol, failed: 10 ('VAL_ACC: <FLOAT>' not found), completed/unknown 1/1∑2 (5%/20), started new job
2025-07-31 13:42:57: Sobol, failed: 10 ('VAL_ACC: <FLOAT>' not found), completed/pending 1/1∑2 (5%/20), job_failed
2025-07-31 13:43:10: Sobol, failed: 11 ('VAL_ACC: <FLOAT>' not found), running 1∑1 (5%/20), finishing jobs (_get_next_trials), finished 1 job
2025-07-31 13:43:17: Sobol, failed: 11 ('VAL_ACC: <FLOAT>' not found), running 1∑1 (5%/20), getting new HP set
2025-07-31 13:43:29: Sobol, failed: 11 ('VAL_ACC: <FLOAT>' not found), completed 1∑1 (0%/20), requested 1 jobs, got 1, 11.99 s/job
2025-07-31 13:43:36: Sobol, failed: 11 ('VAL_ACC: <FLOAT>' not found), completed 1∑1 (0%/20), eval #1/1 start
2025-07-31 13:43:42: Sobol, failed: 11 ('VAL_ACC: <FLOAT>' not found), completed 1∑1 (0%/20), starting new job
2025-07-31 13:43:49: Sobol, failed: 11 ('VAL_ACC: <FLOAT>' not found), completed/unknown 1/1∑2 (5%/20), started new job
2025-07-31 13:43:55: Sobol, failed: 11 ('VAL_ACC: <FLOAT>' not found), completed/pending 1/1∑2 (5%/20), job_failed
2025-07-31 13:44:08: Sobol, failed: 12 ('VAL_ACC: <FLOAT>' not found), running 1∑1 (5%/20), finishing jobs (_get_next_trials), finished 1 job
2025-07-31 13:44:14: Sobol, failed: 12 ('VAL_ACC: <FLOAT>' not found), running 1∑1 (5%/20), getting new HP set
2025-07-31 13:44:26: Sobol, failed: 12 ('VAL_ACC: <FLOAT>' not found), running 1∑1 (5%/20), requested 1 jobs, got 1, 11.74 s/job
2025-07-31 13:44:32: Sobol, failed: 12 ('VAL_ACC: <FLOAT>' not found), completed 1∑1 (0%/20), eval #1/1 start
2025-07-31 13:44:45: Sobol, failed: 12 ('VAL_ACC: <FLOAT>' not found), completed 1∑1 (0%/20), starting new job
2025-07-31 13:44:52: Sobol, failed: 12 ('VAL_ACC: <FLOAT>' not found), completed/unknown 1/1∑2 (5%/20), started new job
2025-07-31 13:44:59: Sobol, failed: 12 ('VAL_ACC: <FLOAT>' not found), completed/pending 1/1∑2 (5%/20), job_failed
2025-07-31 13:45:11: Sobol, failed: 13 ('VAL_ACC: <FLOAT>' not found), running 1∑1 (5%/20), finishing jobs (_get_next_trials), finished 1 job
2025-07-31 13:45:18: Sobol, failed: 13 ('VAL_ACC: <FLOAT>' not found), running 1∑1 (5%/20), getting new HP set
2025-07-31 13:45:30: Sobol, failed: 13 ('VAL_ACC: <FLOAT>' not found), running 1∑1 (0%/20), requested 1 jobs, got 1, 12.32 s/job
2025-07-31 13:45:36: Sobol, failed: 13 ('VAL_ACC: <FLOAT>' not found), completed 1∑1 (0%/20), eval #1/1 start
2025-07-31 13:45:48: Sobol, failed: 13 ('VAL_ACC: <FLOAT>' not found), completed 1∑1 (0%/20), starting new job
2025-07-31 13:45:58: Sobol, failed: 13 ('VAL_ACC: <FLOAT>' not found), completed/unknown 1/1∑2 (5%/20), started new job
2025-07-31 13:46:13: Sobol, failed: 13 ('VAL_ACC: <FLOAT>' not found), completed/running 1/1∑2 (5%/20), job_failed
2025-07-31 13:46:28: Sobol, failed: 14 ('VAL_ACC: <FLOAT>' not found), completed 1∑1 (0%/20), finishing jobs (_get_next_trials), finished 1 job
2025-07-31 13:46:40: Sobol, failed: 14 ('VAL_ACC: <FLOAT>' not found), completed 1∑1 (0%/20), getting new HP set
2025-07-31 13:46:53: Sobol, failed: 14 ('VAL_ACC: <FLOAT>' not found), completed 1∑1 (0%/20), requested 1 jobs, got 1, 17.69 s/job
2025-07-31 13:46:59: Sobol, failed: 14 ('VAL_ACC: <FLOAT>' not found), completed 1∑1 (0%/20), eval #1/1 start
2025-07-31 13:47:04: Sobol, failed: 14 ('VAL_ACC: <FLOAT>' not found), completed 1∑1 (0%/20), starting new job
2025-07-31 13:47:10: Sobol, failed: 14 ('VAL_ACC: <FLOAT>' not found), completed/unknown 1/1∑2 (5%/20), started new job
2025-07-31 13:47:16: Sobol, failed: 14 ('VAL_ACC: <FLOAT>' not found), completed/pending 1/1∑2 (5%/20), job_failed
2025-07-31 13:47:27: Sobol, failed: 15 ('VAL_ACC: <FLOAT>' not found), pending 1∑1 (5%/20), finishing jobs (_get_next_trials), finished 1 job
2025-07-31 13:47:32: Sobol, failed: 15 ('VAL_ACC: <FLOAT>' not found), pending 1∑1 (5%/20), getting new HP set
2025-07-31 13:47:46: Sobol, failed: 15 ('VAL_ACC: <FLOAT>' not found), running 1∑1 (5%/20), requested 1 jobs, got 1, 14.59 s/job
2025-07-31 13:47:52: Sobol, failed: 15 ('VAL_ACC: <FLOAT>' not found), running 1∑1 (0%/20), eval #1/1 start
2025-07-31 13:48:03: Sobol, failed: 15 ('VAL_ACC: <FLOAT>' not found), running 1∑1 (0%/20), starting new job
2025-07-31 13:48:10: Sobol, failed: 15 ('VAL_ACC: <FLOAT>' not found), completed/unknown 1/1∑2 (5%/20), started new job
2025-07-31 13:48:21: Sobol, failed: 15 ('VAL_ACC: <FLOAT>' not found), completed/pending 1/1∑2 (5%/20), job_failed
2025-07-31 13:48:32: Sobol, failed: 16 ('VAL_ACC: <FLOAT>' not found), pending 1∑1 (5%/20), finishing jobs (_get_next_trials), finished 1 job
2025-07-31 13:48:37: Sobol, failed: 16 ('VAL_ACC: <FLOAT>' not found), pending 1∑1 (5%/20), getting new HP set
2025-07-31 13:48:49: Sobol, failed: 16 ('VAL_ACC: <FLOAT>' not found), running 1∑1 (5%/20), requested 1 jobs, got 1, 11.32 s/job
2025-07-31 13:48:55: Sobol, failed: 16 ('VAL_ACC: <FLOAT>' not found), running 1∑1 (5%/20), eval #1/1 start
2025-07-31 13:49:01: Sobol, failed: 16 ('VAL_ACC: <FLOAT>' not found), running 1∑1 (5%/20), starting new job
2025-07-31 13:49:07: Sobol, failed: 16 ('VAL_ACC: <FLOAT>' not found), running/unknown 1/1∑2 (10%/20), started new job
2025-07-31 13:49:14: Sobol, failed: 16 ('VAL_ACC: <FLOAT>' not found), running/pending 1/1∑2 (10%/20), getting new HP set
2025-07-31 13:49:26: Sobol, failed: 16 ('VAL_ACC: <FLOAT>' not found), completed/pending 1/1∑2 (5%/20), requested 1 jobs, got 1, 11.39 s/job
2025-07-31 13:49:31: Sobol, failed: 16 ('VAL_ACC: <FLOAT>' not found), completed/pending 1/1∑2 (5%/20), eval #1/1 start
2025-07-31 13:49:44: Sobol, failed: 16 ('VAL_ACC: <FLOAT>' not found), completed/pending 1/1∑2 (5%/20), starting new job
2025-07-31 13:49:52: Sobol, failed: 16 ('VAL_ACC: <FLOAT>' not found), completed/running/unknown 1/1/1∑3 (10%/20), started new job
2025-07-31 13:50:04: Sobol, failed: 16 ('VAL_ACC: <FLOAT>' not found), completed/running 2/1∑3 (5%/20), job_failed
2025-07-31 13:50:04: Sobol, failed: 16 ('VAL_ACC: <FLOAT>' not found), completed/running 2/1∑3 (5%/20), job_failed
2025-07-31 13:50:19: Sobol, failed: 18 ('VAL_ACC: <FLOAT>' not found), running 1∑1 (5%/20), finishing jobs (_get_next_trials), finished 2 jobs
2025-07-31 13:50:31: Sobol, failed: 18 ('VAL_ACC: <FLOAT>' not found), running 1∑1 (0%/20), getting new HP set
2025-07-31 13:50:43: Sobol, failed: 18 ('VAL_ACC: <FLOAT>' not found), running 1∑1 (0%/20), requested 1 jobs, got 1, 17.26 s/job
2025-07-31 13:50:48: Sobol, failed: 18 ('VAL_ACC: <FLOAT>' not found), running 1∑1 (0%/20), eval #1/1 start
2025-07-31 13:50:54: Sobol, failed: 18 ('VAL_ACC: <FLOAT>' not found), completed 1∑1 (0%/20), starting new job
2025-07-31 13:51:01: Sobol, failed: 18 ('VAL_ACC: <FLOAT>' not found), completed/unknown 1/1∑2 (5%/20), started new job
2025-07-31 13:51:07: Sobol, failed: 18 ('VAL_ACC: <FLOAT>' not found), completed/running 1/1∑2 (5%/20), job_failed
2025-07-31 13:51:24: Sobol, failed: 19 ('VAL_ACC: <FLOAT>' not found), running 1∑1 (5%/20), finishing jobs, finished 1 job
2025-07-31 13:51:29: Sobol, failed: 19 ('VAL_ACC: <FLOAT>' not found), running 1∑1 (0%/20), job_failed
2025-07-31 13:51:41: Sobol, failed: 20 ('VAL_ACC: <FLOAT>' not found), finishing previous jobs (1), finished 1 job
2025-07-31 13:51:48: Sobol, failed: 20 ('VAL_ACC: <FLOAT>' not found), getting new HP set
2025-07-31 13:52:00: Sobol, failed: 20 ('VAL_ACC: <FLOAT>' not found), requested 1 jobs, got 1, 11.92 s/job
2025-07-31 13:52:06: Sobol, failed: 20 ('VAL_ACC: <FLOAT>' not found), eval #1/1 start
2025-07-31 13:52:12: Sobol, failed: 20 ('VAL_ACC: <FLOAT>' not found), starting new job
2025-07-31 13:52:19: Sobol, failed: 20 ('VAL_ACC: <FLOAT>' not found), unknown 1∑1 (5%/20), started new job
2025-07-31 13:52:25: Sobol, failed: 20 ('VAL_ACC: <FLOAT>' not found), pending 1∑1 (5%/20), getting new HP set
2025-07-31 13:52:37: Sobol, failed: 20 ('VAL_ACC: <FLOAT>' not found), running 1∑1 (5%/20), requested 1 jobs, got 1, 11.76 s/job
2025-07-31 13:52:45: Sobol, failed: 20 ('VAL_ACC: <FLOAT>' not found), running 1∑1 (5%/20), eval #1/1 start
2025-07-31 13:52:50: Sobol, failed: 20 ('VAL_ACC: <FLOAT>' not found), running 1∑1 (5%/20), starting new job
2025-07-31 13:52:59: Sobol, failed: 20 ('VAL_ACC: <FLOAT>' not found), completed/unknown 1/1∑2 (5%/20), started new job
2025-07-31 13:53:10: Sobol, failed: 20 ('VAL_ACC: <FLOAT>' not found), completed/running 1/1∑2 (5%/20), job_failed
2025-07-31 13:53:22: Sobol, failed: 21 ('VAL_ACC: <FLOAT>' not found), running 1∑1 (0%/20), finishing jobs (_get_next_trials), finished 1 job
2025-07-31 13:53:34: Sobol, failed: 21 ('VAL_ACC: <FLOAT>' not found), completed 1∑1 (0%/20), getting new HP set
2025-07-31 13:53:47: Sobol, failed: 21 ('VAL_ACC: <FLOAT>' not found), completed 1∑1 (0%/20), requested 1 jobs, got 1, 17.98 s/job
2025-07-31 13:53:54: Sobol, failed: 21 ('VAL_ACC: <FLOAT>' not found), completed 1∑1 (0%/20), eval #1/1 start
2025-07-31 13:53:59: Sobol, failed: 21 ('VAL_ACC: <FLOAT>' not found), completed 1∑1 (0%/20), starting new job
2025-07-31 13:54:07: Sobol, failed: 21 ('VAL_ACC: <FLOAT>' not found), completed/unknown 1/1∑2 (5%/20), started new job
2025-07-31 13:54:14: Sobol, failed: 21 ('VAL_ACC: <FLOAT>' not found), completed/pending 1/1∑2 (5%/20), job_failed
2025-07-31 13:54:25: Sobol, failed: 22 ('VAL_ACC: <FLOAT>' not found), pending 1∑1 (5%/20), finishing jobs (_get_next_trials), finished 1 job
2025-07-31 13:54:31: Sobol, failed: 22 ('VAL_ACC: <FLOAT>' not found), pending 1∑1 (5%/20), getting new HP set
2025-07-31 13:54:44: Sobol, failed: 22 ('VAL_ACC: <FLOAT>' not found), pending 1∑1 (5%/20), requested 1 jobs, got 1, 13.57 s/job
2025-07-31 13:54:50: Sobol, failed: 22 ('VAL_ACC: <FLOAT>' not found), running 1∑1 (5%/20), eval #1/1 start
2025-07-31 13:55:03: Sobol, failed: 22 ('VAL_ACC: <FLOAT>' not found), running 1∑1 (0%/20), starting new job
2025-07-31 13:55:12: Sobol, failed: 22 ('VAL_ACC: <FLOAT>' not found), completed/unknown 1/1∑2 (5%/20), started new job
2025-07-31 13:55:23: Sobol, failed: 22 ('VAL_ACC: <FLOAT>' not found), completed/pending 1/1∑2 (5%/20), job_failed
2025-07-31 13:55:36: Sobol, failed: 23 ('VAL_ACC: <FLOAT>' not found), running 1∑1 (5%/20), finishing jobs (_get_next_trials), finished 1 job
2025-07-31 13:55:44: Sobol, failed: 23 ('VAL_ACC: <FLOAT>' not found), running 1∑1 (5%/20), getting new HP set
2025-07-31 13:55:55: Sobol, failed: 23 ('VAL_ACC: <FLOAT>' not found), running 1∑1 (0%/20), requested 1 jobs, got 1, 12.09 s/job
2025-07-31 13:56:02: Sobol, failed: 23 ('VAL_ACC: <FLOAT>' not found), completed 1∑1 (0%/20), eval #1/1 start
2025-07-31 13:56:14: Sobol, failed: 23 ('VAL_ACC: <FLOAT>' not found), completed 1∑1 (0%/20), starting new job
2025-07-31 13:56:20: Sobol, failed: 23 ('VAL_ACC: <FLOAT>' not found), completed/unknown 1/1∑2 (5%/20), started new job
2025-07-31 13:56:26: Sobol, failed: 23 ('VAL_ACC: <FLOAT>' not found), completed/pending 1/1∑2 (5%/20), job_failed
2025-07-31 13:56:40: Sobol, failed: 24 ('VAL_ACC: <FLOAT>' not found), running 1∑1 (5%/20), finishing jobs (_get_next_trials), finished 1 job
2025-07-31 13:56:47: Sobol, failed: 24 ('VAL_ACC: <FLOAT>' not found), running 1∑1 (5%/20), getting new HP set
2025-07-31 13:56:59: Sobol, failed: 24 ('VAL_ACC: <FLOAT>' not found), completed 1∑1 (0%/20), requested 1 jobs, got 1, 13.21 s/job
2025-07-31 13:57:06: Sobol, failed: 24 ('VAL_ACC: <FLOAT>' not found), completed 1∑1 (0%/20), eval #1/1 start
2025-07-31 13:57:18: Sobol, failed: 24 ('VAL_ACC: <FLOAT>' not found), completed 1∑1 (0%/20), starting new job
2025-07-31 13:57:25: Sobol, failed: 24 ('VAL_ACC: <FLOAT>' not found), completed/unknown 1/1∑2 (5%/20), started new job
2025-07-31 13:57:31: Sobol, failed: 24 ('VAL_ACC: <FLOAT>' not found), completed/pending 1/1∑2 (5%/20), job_failed
2025-07-31 13:57:44: Sobol, failed: 25 ('VAL_ACC: <FLOAT>' not found), running 1∑1 (5%/20), finishing jobs (_get_next_trials), finished 1 job
2025-07-31 13:58:01: Sobol, failed: 25 ('VAL_ACC: <FLOAT>' not found), running 1∑1 (0%/20), getting new HP set
2025-07-31 13:58:13: Sobol, failed: 25 ('VAL_ACC: <FLOAT>' not found), completed 1∑1 (0%/20), requested 1 jobs, got 1, 18.37 s/job
2025-07-31 13:58:19: Sobol, failed: 25 ('VAL_ACC: <FLOAT>' not found), completed 1∑1 (0%/20), eval #1/1 start
2025-07-31 13:58:25: Sobol, failed: 25 ('VAL_ACC: <FLOAT>' not found), completed 1∑1 (0%/20), starting new job
2025-07-31 13:58:32: Sobol, failed: 25 ('VAL_ACC: <FLOAT>' not found), completed/unknown 1/1∑2 (5%/20), started new job
2025-07-31 13:58:38: Sobol, failed: 25 ('VAL_ACC: <FLOAT>' not found), completed/running 1/1∑2 (5%/20), job_failed
2025-07-31 13:58:51: Sobol, failed: 26 ('VAL_ACC: <FLOAT>' not found), running 1∑1 (5%/20), finishing jobs (_get_next_trials), finished 1 job
2025-07-31 13:58:58: Sobol, failed: 26 ('VAL_ACC: <FLOAT>' not found), running 1∑1 (5%/20), getting new HP set
2025-07-31 13:59:10: Sobol, failed: 26 ('VAL_ACC: <FLOAT>' not found), running 1∑1 (5%/20), requested 1 jobs, got 1, 13.00 s/job
2025-07-31 13:59:16: Sobol, failed: 26 ('VAL_ACC: <FLOAT>' not found), running 1∑1 (5%/20), eval #1/1 start
2025-07-31 13:59:23: Sobol, failed: 26 ('VAL_ACC: <FLOAT>' not found), running 1∑1 (0%/20), starting new job
2025-07-31 13:59:31: Sobol, failed: 26 ('VAL_ACC: <FLOAT>' not found), completed/unknown 1/1∑2 (5%/20), started new job
2025-07-31 13:59:45: Sobol, failed: 26 ('VAL_ACC: <FLOAT>' not found), completed/running 1/1∑2 (5%/20), job_failed
2025-07-31 13:59:57: Sobol, failed: 27 ('VAL_ACC: <FLOAT>' not found), running 1∑1 (0%/20), finishing jobs (_get_next_trials), finished 1 job
2025-07-31 14:00:13: Sobol, failed: 27 ('VAL_ACC: <FLOAT>' not found), completed 1∑1 (0%/20), getting new HP set
2025-07-31 14:00:26: Sobol, failed: 27 ('VAL_ACC: <FLOAT>' not found), completed 1∑1 (0%/20), requested 1 jobs, got 1, 13.87 s/job
2025-07-31 14:00:34: Sobol, failed: 27 ('VAL_ACC: <FLOAT>' not found), completed 1∑1 (0%/20), eval #1/1 start
2025-07-31 14:00:40: Sobol, failed: 27 ('VAL_ACC: <FLOAT>' not found), completed 1∑1 (0%/20), starting new job
2025-07-31 14:00:48: Sobol, failed: 27 ('VAL_ACC: <FLOAT>' not found), completed/unknown 1/1∑2 (5%/20), started new job
2025-07-31 14:00:56: Sobol, failed: 27 ('VAL_ACC: <FLOAT>' not found), completed/pending 1/1∑2 (5%/20), job_failed
2025-07-31 14:01:11: Sobol, failed: 28 ('VAL_ACC: <FLOAT>' not found), running 1∑1 (5%/20), finishing jobs (_get_next_trials), finished 1 job
2025-07-31 14:01:17: Sobol, failed: 28 ('VAL_ACC: <FLOAT>' not found), running 1∑1 (5%/20), getting new HP set
2025-07-31 14:01:29: Sobol, failed: 28 ('VAL_ACC: <FLOAT>' not found), running 1∑1 (0%/20), requested 1 jobs, got 1, 12.14 s/job
2025-07-31 14:01:35: Sobol, failed: 28 ('VAL_ACC: <FLOAT>' not found), completed 1∑1 (0%/20), eval #1/1 start
2025-07-31 14:01:41: Sobol, failed: 28 ('VAL_ACC: <FLOAT>' not found), completed 1∑1 (0%/20), starting new job
2025-07-31 14:01:48: Sobol, failed: 28 ('VAL_ACC: <FLOAT>' not found), completed/unknown 1/1∑2 (5%/20), started new job
2025-07-31 14:01:55: Sobol, failed: 28 ('VAL_ACC: <FLOAT>' not found), completed/pending 1/1∑2 (5%/20), job_failed
2025-07-31 14:02:07: Sobol, failed: 29 ('VAL_ACC: <FLOAT>' not found), running 1∑1 (5%/20), finishing jobs (_get_next_trials), finished 1 job
2025-07-31 14:02:15: Sobol, failed: 29 ('VAL_ACC: <FLOAT>' not found), running 1∑1 (5%/20), getting new HP set
2025-07-31 14:02:28: Sobol, failed: 29 ('VAL_ACC: <FLOAT>' not found), completed 1∑1 (0%/20), requested 1 jobs, got 1, 13.11 s/job
2025-07-31 14:02:36: Sobol, failed: 29 ('VAL_ACC: <FLOAT>' not found), completed 1∑1 (0%/20), eval #1/1 start
2025-07-31 14:02:48: Sobol, failed: 29 ('VAL_ACC: <FLOAT>' not found), completed 1∑1 (0%/20), starting new job
2025-07-31 14:02:57: Sobol, failed: 29 ('VAL_ACC: <FLOAT>' not found), completed/unknown 1/1∑2 (5%/20), started new job
2025-07-31 14:03:03: Sobol, failed: 29 ('VAL_ACC: <FLOAT>' not found), completed/pending 1/1∑2 (5%/20), job_failed
2025-07-31 14:03:15: Sobol, failed: 30 ('VAL_ACC: <FLOAT>' not found), running 1∑1 (5%/20), finishing jobs (_get_next_trials), finished 1 job
2025-07-31 14:03:22: Sobol, failed: 30 ('VAL_ACC: <FLOAT>' not found), running 1∑1 (5%/20), getting new HP set
2025-07-31 14:03:34: Sobol, failed: 30 ('VAL_ACC: <FLOAT>' not found), running 1∑1 (0%/20), requested 1 jobs, got 1, 12.60 s/job
2025-07-31 14:03:41: Sobol, failed: 30 ('VAL_ACC: <FLOAT>' not found), completed 1∑1 (0%/20), eval #1/1 start
2025-07-31 14:03:47: Sobol, failed: 30 ('VAL_ACC: <FLOAT>' not found), completed 1∑1 (0%/20), starting new job
2025-07-31 14:03:54: Sobol, failed: 30 ('VAL_ACC: <FLOAT>' not found), completed/unknown 1/1∑2 (5%/20), started new job
2025-07-31 14:04:01: Sobol, failed: 30 ('VAL_ACC: <FLOAT>' not found), completed/pending 1/1∑2 (5%/20), job_failed
2025-07-31 14:04:14: Sobol, failed: 31 ('VAL_ACC: <FLOAT>' not found), running 1∑1 (5%/20), finishing jobs (_get_next_trials), finished 1 job
2025-07-31 14:04:21: Sobol, failed: 31 ('VAL_ACC: <FLOAT>' not found), running 1∑1 (5%/20), getting new HP set
2025-07-31 14:04:33: Sobol, failed: 31 ('VAL_ACC: <FLOAT>' not found), running 1∑1 (0%/20), requested 1 jobs, got 1, 13.03 s/job
2025-07-31 14:04:40: Sobol, failed: 31 ('VAL_ACC: <FLOAT>' not found), completed 1∑1 (0%/20), eval #1/1 start
2025-07-31 14:04:49: Sobol, failed: 31 ('VAL_ACC: <FLOAT>' not found), completed 1∑1 (0%/20), starting new job
2025-07-31 14:04:57: Sobol, failed: 31 ('VAL_ACC: <FLOAT>' not found), completed/unknown 1/1∑2 (5%/20), started new job
2025-07-31 14:05:05: Sobol, failed: 31 ('VAL_ACC: <FLOAT>' not found), completed/pending 1/1∑2 (5%/20), job_failed
2025-07-31 14:05:17: Sobol, failed: 32 ('VAL_ACC: <FLOAT>' not found), running 1∑1 (5%/20), finishing jobs (_get_next_trials), finished 1 job
2025-07-31 14:05:30: Sobol, failed: 32 ('VAL_ACC: <FLOAT>' not found), running 1∑1 (0%/20), getting new HP set
2025-07-31 14:05:42: Sobol, failed: 32 ('VAL_ACC: <FLOAT>' not found), completed 1∑1 (0%/20), requested 1 jobs, got 1, 18.22 s/job
2025-07-31 14:05:48: Sobol, failed: 32 ('VAL_ACC: <FLOAT>' not found), completed 1∑1 (0%/20), eval #1/1 start
2025-07-31 14:05:55: Sobol, failed: 32 ('VAL_ACC: <FLOAT>' not found), completed 1∑1 (0%/20), starting new job
2025-07-31 14:06:03: Sobol, failed: 32 ('VAL_ACC: <FLOAT>' not found), completed/unknown 1/1∑2 (5%/20), started new job
2025-07-31 14:06:10: Sobol, failed: 32 ('VAL_ACC: <FLOAT>' not found), completed/running 1/1∑2 (5%/20), job_failed
2025-07-31 14:06:25: Sobol, failed: 33 ('VAL_ACC: <FLOAT>' not found), running 1∑1 (5%/20), finishing jobs (_get_next_trials), finished 1 job
2025-07-31 14:06:39: Sobol, failed: 33 ('VAL_ACC: <FLOAT>' not found), running 1∑1 (0%/20), getting new HP set
2025-07-31 14:06:51: Sobol, failed: 33 ('VAL_ACC: <FLOAT>' not found), completed 1∑1 (0%/20), requested 1 jobs, got 1, 19.40 s/job
2025-07-31 14:06:57: Sobol, failed: 33 ('VAL_ACC: <FLOAT>' not found), completed 1∑1 (0%/20), eval #1/1 start
2025-07-31 14:07:03: Sobol, failed: 33 ('VAL_ACC: <FLOAT>' not found), completed 1∑1 (0%/20), starting new job
2025-07-31 14:07:11: Sobol, failed: 33 ('VAL_ACC: <FLOAT>' not found), completed/unknown 1/1∑2 (5%/20), started new job
2025-07-31 14:07:23: Sobol, failed: 33 ('VAL_ACC: <FLOAT>' not found), completed/pending 1/1∑2 (5%/20), job_failed
2025-07-31 14:07:36: Sobol, failed: 34 ('VAL_ACC: <FLOAT>' not found), running 1∑1 (5%/20), finishing jobs (_get_next_trials), finished 1 job
Arguments Overview
| Key | Value |
|---|
| config_yaml | None |
| config_toml | None |
| config_json | None |
| num_random_steps | 20 |
| max_eval | 500 |
| run_program | [['cHl0aG9uMyAudGVzdHMvbW5pc3QvdHJhaW4gLS1lcG9jaHMgJWVwb2NocyAtLWxlYXJuaW5nX3JhdGUgJWxyIC0tYmF0Y2hfc2l6ZSAlYmF0Y2hfc2l6ZSAtLWhpZGRlbl9zaXplICVoaWRkZW5f… |
| experiment_name | mnist_gpu_noall |
| mem_gb | 10 |
| parameter | [['epochs', 'range', '10', '200', 'int', 'false'], ['lr', 'range', '0.00001', '0.1', 'float', 'false'], ['batch_size', 'range', '8', '2048', 'int', |
| 'false'], ['hidden_size', 'range', '8', '2048', 'int', 'false'], ['dropout', 'range', '0', '0.5', 'float', 'false'], ['activation', 'fixed', |
| 'leaky_relu'], ['num_dense_layers', 'range', '1', '4', 'int', 'false'], ['init', 'fixed', 'normal'], ['weight_decay', 'range', '0', '1', 'float', |
| 'false']] |
| continue_previous_job | None |
| experiment_constraints | None |
| run_dir | runs |
| seed | None |
| verbose_tqdm | False |
| model | BOTORCH_MODULAR |
| gridsearch | False |
| occ | False |
| show_sixel_scatter | False |
| show_sixel_general | False |
| show_sixel_trial_index_result | False |
| follow | True |
| send_anonymized_usage_stats | True |
| ui_url | aHR0cHM6Ly9pbWFnZXNlZy5zY2Fkcy5kZS9vbW5pYXgvZ3VpP3BhcnRpdGlvbj1hbHBoYSZleHBlcmltZW50X25hbWU9bW5pc3RfZ3B1X25vYWxsJnJlc2VydmF0aW9uPSZhY2NvdW50PSZtZW1fZ2I… |
| root_venv_dir | /home/pwinkler |
| exclude | None |
| main_process_gb | 8 |
| max_nr_of_zero_results | 50 |
| abbreviate_job_names | False |
| orchestrator_file | None |
| checkout_to_latest_tested_version | False |
| live_share | True |
| disable_tqdm | False |
| disable_previous_job_constraint | False |
| workdir | |
| occ_type | euclid |
| result_names | ['VAL_ACC=max'] |
| minkowski_p | 2 |
| signed_weighted_euclidean_weights | |
| generation_strategy | None |
| generate_all_jobs_at_once | False |
| revert_to_random_when_seemingly_exhausted | True |
| load_data_from_existing_jobs | [] |
| n_estimators_randomforest | 100 |
| max_attempts_for_generation | 20 |
| external_generator | None |
| username | None |
| max_failed_jobs | 0 |
| num_cpus_main_job | None |
| calculate_pareto_front_of_job | [] |
| show_generate_time_table | False |
| force_choice_for_ranges | False |
| max_abandoned_retrial | 20 |
| share_password | None |
| dryrun | False |
| db_url | None |
| run_program_once | None |
| dont_warm_start_refitting | False |
| refit_on_cv | False |
| fit_out_of_design | False |
| fit_abandoned | False |
| dont_jit_compile | False |
| num_restarts | 20 |
| raw_samples | 1024 |
| max_num_of_parallel_sruns | 16 |
| no_transform_inputs | False |
| no_normalize_y | False |
| transforms | [] |
| num_parallel_jobs | 20 |
| worker_timeout | 120 |
| slurm_use_srun | False |
| time | 2880 |
| partition | alpha |
| reservation | None |
| force_local_execution | False |
| slurm_signal_delay_s | 0 |
| nodes_per_job | 1 |
| cpus_per_task | 1 |
| account | None |
| gpus | 1 |
| run_mode | local |
| verbose | False |
| verbose_break_run_search_table | False |
| debug | False |
| flame_graph | False |
| no_sleep | False |
| tests | False |
| show_worker_percentage_table_at_end | False |
| auto_exclude_defective_hosts | False |
| run_tests_that_fail_on_taurus | False |
| raise_in_eval | False |
| show_ram_every_n_seconds | 0 |
| show_generation_and_submission_sixel | False |
| just_return_defaults | False |
| prettyprint | False |
1753961585.0846138,20,0,0
1753961601.1131883,20,0,0
1753961601.254728,20,0,0
1753961614.874693,20,0,0
1753961627.7460063,20,0,0
1753961632.9343731,20,0,0
1753961640.0528753,20,0,0
1753961646.0274863,20,1,5
1753961651.7427254,20,1,5
1753961660.5107424,20,1,5
1753961665.2912364,20,1,5
1753961669.7124667,20,1,5
1753961675.8511004,20,2,10
1753961681.7165027,20,2,10
1753961692.096899,20,2,10
1753961698.043548,20,2,10
1753961703.7253246,20,2,10
1753961709.7133648,20,3,15
1753961717.1596045,20,3,15
1753961726.3490083,20,3,15
1753961732.7143905,20,3,15
1753961737.7067153,20,3,15
1753961745.81447,20,4,20
1753961751.1985424,20,4,20
1753961761.8455765,20,4,20
1753961766.7212663,20,4,20
1753961771.7102535,20,4,20
1753961777.2576692,20,5,25
1753961782.2066178,20,5,25
1753961791.2715883,20,5,25
1753961796.119905,20,4,20
1753961807.7378762,20,1,5
1753961813.8853514,20,2,10
1753961819.7014287,20,2,10
1753961819.7087204,20,2,10
1753961819.715876,20,2,10
1753961819.723011,20,2,10
1753961836.2888024,20,1,5
1753961841.1545994,20,1,5
1753961850.7266161,20,0,0
1753961860.894624,20,0,0
1753961865.7370532,20,0,0
1753961872.0927591,20,1,5
1753961877.7345183,20,1,5
1753961877.7410603,20,1,5
1753961891.066462,20,1,5
1753961896.062315,20,1,5
1753961905.7449164,20,0,0
1753961910.8976336,20,0,0
1753961921.0285094,20,0,0
1753961927.0541518,20,1,5
1753961931.9563203,20,1,5
1753961941.815245,20,1,5
1753961957.8919055,20,1,5
1753961973.2974823,20,0,0
1753961979.0002358,20,0,0
1753961985.205827,20,0,0
1753961992.209565,20,1,5
1753961997.7208009,20,1,5
1753962010.7282965,20,1,5
1753962015.7832768,20,1,5
1753962026.729814,20,0,0
1753962031.7113876,20,0,0
1753962041.7286031,20,0,0
1753962048.7749324,20,1,5
1753962053.9650183,20,1,5
1753962064.7237194,20,1,5
1753962070.8366368,20,1,5
1753962083.0076275,20,1,5
1753962090.7238538,20,0,0
1753962101.7558274,20,0,0
1753962108.1387286,20,1,5
1753962113.7257845,20,1,5
1753962125.2206442,20,1,5
1753962130.9738266,20,1,5
1753962141.7272737,20,1,5
1753962147.1872172,20,0,0
1753962163.2472878,20,0,0
1753962171.9146702,20,1,5
1753962177.301048,20,1,5
1753962190.2142355,20,1,5
1753962197.2538815,20,1,5
1753962208.966039,20,0,0
1753962216.7283187,20,0,0
1753962222.707558,20,0,0
1753962229.8990424,20,1,5
1753962235.940692,20,1,5
1753962247.9184818,20,1,5
1753962254.7309601,20,1,5
1753962266.158718,20,1,5
1753962272.0536182,20,0,0
1753962285.9229228,20,0,0
1753962292.7062302,20,1,5
1753962299.1721692,20,1,5
1753962311.7369733,20,1,5
1753962318.7307692,20,1,5
1753962330.8780618,20,0,0
1753962336.731556,20,0,0
1753962348.710288,20,0,0
1753962358.9424353,20,1,5
1753962372.9788964,20,1,5
1753962388.720795,20,0,0
1753962400.708227,20,0,0
1753962413.7175944,20,0,0
1753962419.0998878,20,0,0
1753962424.1930223,20,0,0
1753962430.9053273,20,1,5
1753962436.715738,20,1,5
1753962447.1786587,20,1,5
1753962452.704826,20,1,5
1753962466.8684196,20,1,5
1753962472.235822,20,0,0
1753962483.7130075,20,0,0
1753962490.122252,20,1,5
1753962501.1045468,20,1,5
1753962512.0570414,20,1,5
1753962517.8464417,20,1,5
1753962528.8847635,20,1,5
1753962535.8151307,20,1,5
1753962541.201644,20,1,5
1753962547.9345841,20,2,10
1753962554.8782065,20,2,10
1753962565.9361684,20,1,5
1753962571.7221773,20,1,5
1753962584.708684,20,1,5
1753962591.0447605,20,2,10
1753962604.2957914,20,1,5
1753962604.3026528,20,1,5
1753962619.7213163,20,1,5
1753962631.3070986,20,0,0
1753962643.1308885,20,0,0
1753962648.718921,20,0,0
1753962654.7084935,20,0,0
1753962661.3934639,20,1,5
1753962667.9554849,20,1,5
1753962684.0141678,20,1,5
1753962689.8789434,20,0,0
1753962701.7198439,20,0,0
1753962707.9180524,20,0,0
1753962708.0094533,20,0,0
timestamp,ram_usage_mb,cpu_usage_percent
1753961560,696.3984375,5.4
1753961585,696.3984375,5.2
1753961601,696.3984375,5.3
1753961601,696.3984375,16.7
1753961601,696.8984375,6.1
1753961601,696.8984375,5.2
1753962707,717.8984375,4.7
1753962708,717.8984375,4.5
submitit INFO (2025-07-31 13:34:35,274) - Starting with JobEnvironment(job_id=530624, hostname=c142, local_rank=0(1), node=0(1), global_rank=0(1))
submitit INFO (2025-07-31 13:34:35,276) - Loading pickle: /data/horse/ws/pwinkler-mnist_tst/omniopt/runs/mnist_gpu_noall/0/single_runs/530624/530624_submitted.pkl
Traceback (most recent call last):
File "/data/horse/ws/pwinkler-mnist_tst/omniopt/.tests/mnist/train", line 67, in <module>
if args.device.startswith('cuda'):
^^^^
NameError: name 'args' is not defined
Parameters: {"epochs": 80, "lr": 0.08916501283109189, "batch_size": 1389, "hidden_size": 79, "dropout": 0.2217535823583603, "num_dense_layers": 4, "weight_decay": 0.016469186171889305, "activation": "leaky_relu", "init": "normal"}
Debug-Infos:
========
DEBUG INFOS START:
Program-Code: python3 .tests/mnist/train --epochs 80 --learning_rate 0.08916501283109189158 --batch_size 1389 --hidden_size 79 --dropout 0.22175358235836029053 --activation leaky_relu --num_dense_layers 4 --init normal --weight_decay 0.01646918617188930511
pwd: /data/horse/ws/pwinkler-mnist_tst/omniopt
File: .tests/mnist/train
UID: 2054851
GID: 200270
SLURM_JOB_ID: 530624
Status-Change-Time: 1753961449.0
Size: 12765 Bytes
Permissions: -rwxr-xr-x
Owner: pwinkler
Last access: 1753961786.0
Last modification: 1753961449.0
Hostname: c142
========
DEBUG INFOS END
python3 .tests/mnist/train --epochs 80 --learning_rate 0.08916501283109189158 --batch_size 1389 --hidden_size 79 --dropout 0.22175358235836029053 --activation leaky_relu --num_dense_layers 4 --init normal --weight_decay 0.01646918617188930511
stdout was empty
stderr:
Traceback (most recent call last):
File "/data/horse/ws/pwinkler-mnist_tst/omniopt/.tests/mnist/train", line 67, in <module>
if args.device.startswith('cuda'):
^^^^
NameError: name 'args' is not defined
Result: {'VAL_ACC': None}
Final-results: {'VAL_ACC': None}
EXIT_CODE: 1
submitit INFO (2025-07-31 13:36:39,500) - Job completed successfully
submitit INFO (2025-07-31 13:36:39,502) - Exiting after successful completion
