GUI page with all the settings of this job

Experiment overview

Best RESULT, min (total: 3)

Job Summary per Generation Node

Experiment parameters

Number of evaluations

Result names and types

Last progressbar status

Git-Version

Copy raw data to clipboard

Download »results.csv« as file

trial_index,submit_time,queue_time,worker_generator_uuid,start_time,end_time,run_time,program_string,exit_code,signal,hostname,OO_Info_int_param,OO_Info_int_param_two,OO_Info_float_param,OO_Info_choice_param,arm_name,trial_status,generation_node,RESULT,int_param,float_param,int_param_two,choice_param
0,1767002094,2,0988ce06-6b62-4d55-8e2c-71abdd2a6214,1767002096,1767002102,6,./.tests/optimization_example  --int_param='-28' --float_param='-66.41277462244033813477' --choice_param='1' --int_param_two='-25' --nr_results=1,0,,c1,-28,-25,-66.412774622440338134765625,1,0_0,COMPLETED,SOBOL,-71029.163792754596215672791004180908,-28,-66.412774622440338134765625,-25,1
1,1767002105,3,0988ce06-6b62-4d55-8e2c-71abdd2a6214,1767002108,1767002114,6,./.tests/optimization_example  --int_param='-71' --float_param='-40.76937126927077770233' --choice_param='16' --int_param_two='-77' --nr_results=1,0,,c1,-71,-77,-40.76937126927077770233154296875,16,1_0,COMPLETED,SOBOL,-146826.073463843000354245305061340332,-71,-40.76937126927077770233154296875,-77,16
2,1767002138,3,0988ce06-6b62-4d55-8e2c-71abdd2a6214,1767002141,1767002147,6,./.tests/optimization_example  --int_param='-100' --float_param='-100' --choice_param='16' --int_param_two='-100' --nr_results=1,0,,c1,-100,-100,-100,16,2_0,COMPLETED,BOTORCH_MODULAR,-331437.320000000006984919309616088867,-100,-100,-100,16

Copy raw data to clipboard

Download »results.csv« as file

Copy raw data to clipboard

Download »oo_errors.txt« as file

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

execute_nvidia_smi: An error occurred: Command '['nvidia-smi', '--query-gpu=timestamp,name,pci.bus_id,driver_version,pstate,pcie.link.gen.max,pcie.link.gen.current,temperature.gpu,utilization.gpu,utilization.memory,memory.total,memory.free,memory.used', '--format=csv,noheader']' returned non-zero exit status 255.

Copy raw data to clipboard

Download »oo_errors.txt« as file

Copy raw data to clipboard

Download »progressbar« as file

2025-12-29 10:54:53 (0988ce06-6b62-4d55-8e2c-71abdd2a6214): SOBOL, Started OmniOpt2 run...
2025-12-29 10:54:53 (0988ce06-6b62-4d55-8e2c-71abdd2a6214): SOBOL, getting new HP set (no sbatch)
2025-12-29 10:54:53 (0988ce06-6b62-4d55-8e2c-71abdd2a6214): SOBOL, requested 1 jobs, got 1, 0.08 s/job
2025-12-29 10:54:54 (0988ce06-6b62-4d55-8e2c-71abdd2a6214): SOBOL, eval #1/1 start                    
2025-12-29 10:54:54 (0988ce06-6b62-4d55-8e2c-71abdd2a6214): SOBOL, starting new job                   
2025-12-29 10:54:54 (0988ce06-6b62-4d55-8e2c-71abdd2a6214): SOBOL, started new job                    
2025-12-29 10:55:03 (0988ce06-6b62-4d55-8e2c-71abdd2a6214): SOBOL, new result: RESULT: -71029.163793  
2025-12-29 10:55:05 (0988ce06-6b62-4d55-8e2c-71abdd2a6214): SOBOL, best RESULT: -71029.1637927546, finishing jobs, finished 1 job
2025-12-29 10:55:05 (0988ce06-6b62-4d55-8e2c-71abdd2a6214): SOBOL, best RESULT: -71029.1637927546, getting new HP set (no sbatch)
2025-12-29 10:55:05 (0988ce06-6b62-4d55-8e2c-71abdd2a6214): SOBOL, best RESULT: -71029.1637927546, requested 1 jobs, got 1, 0.08 s/job
2025-12-29 10:55:05 (0988ce06-6b62-4d55-8e2c-71abdd2a6214): SOBOL, best RESULT: -71029.1637927546, eval #1/1 start                    
2025-12-29 10:55:05 (0988ce06-6b62-4d55-8e2c-71abdd2a6214): SOBOL, best RESULT: -71029.1637927546, starting new job                   
2025-12-29 10:55:05 (0988ce06-6b62-4d55-8e2c-71abdd2a6214): SOBOL, best RESULT: -71029.1637927546, started new job                    
2025-12-29 10:55:15 (0988ce06-6b62-4d55-8e2c-71abdd2a6214): SOBOL, best RESULT: -71029.1637927546, new result: RESULT: -146826.073464 
2025-12-29 10:55:16 (0988ce06-6b62-4d55-8e2c-71abdd2a6214): SOBOL, best RESULT: -146826.073463843, finishing jobs, finished 1 job     
2025-12-29 10:55:38 (0988ce06-6b62-4d55-8e2c-71abdd2a6214): BOTORCH_MODULAR, best RESULT: -146826.073463843, getting new HP set (no sbatch)
2025-12-29 10:55:38 (0988ce06-6b62-4d55-8e2c-71abdd2a6214): BOTORCH_MODULAR, best RESULT: -146826.073463843, requested 1 jobs, got 1, 21.29 s/job
2025-12-29 10:55:38 (0988ce06-6b62-4d55-8e2c-71abdd2a6214): BOTORCH_MODULAR, best RESULT: -146826.073463843, eval #1/1 start                     
2025-12-29 10:55:38 (0988ce06-6b62-4d55-8e2c-71abdd2a6214): BOTORCH_MODULAR, best RESULT: -146826.073463843, starting new job                    
2025-12-29 10:55:38 (0988ce06-6b62-4d55-8e2c-71abdd2a6214): BOTORCH_MODULAR, best RESULT: -146826.073463843, started new job                     
2025-12-29 10:55:47 (0988ce06-6b62-4d55-8e2c-71abdd2a6214): BOTORCH_MODULAR, best RESULT: -146826.073463843, new result: RESULT: -331437.320000  
2025-12-29 10:55:49 (0988ce06-6b62-4d55-8e2c-71abdd2a6214): BOTORCH_MODULAR, best RESULT: -331437.32, finishing jobs, finished 1 job             

Copy raw data to clipboard

Download »progressbar« as file

Copy raw data to clipboard

Download »job_submit_durations.txt« as file

         Job submission durations          
┏━━━━━━━━━┳━━━━━━━━━┳━━━━━━┳━━━━━━━━━━━━━━┓
┃   Batch ┃ Seconds ┃ Jobs ┃ Time per job ┃
┡━━━━━━━━━╇━━━━━━━━━╇━━━━━━╇━━━━━━━━━━━━━━┩
│       1 │   0.213 │    1 │        0.213 │
│       2 │   0.212 │    1 │        0.212 │
│       3 │   0.203 │    1 │        0.203 │
├─────────┼─────────┼──────┼──────────────┤
│ Average │   0.209 │      │              │
│  Median │   0.212 │      │              │
│   Total │   0.627 │      │              │
│     Max │   0.213 │      │              │
│     Min │   0.203 │      │              │
└─────────┴─────────┴──────┴──────────────┘

Copy raw data to clipboard

Download »job_submit_durations.txt« as file

Copy raw data to clipboard

Download »generation_times.txt« as file

           Model generation times            
┏━━━━━━━━━━━┳━━━━━━━━━┳━━━━━━┳━━━━━━━━━━━━━━┓
┃ Iteration ┃ Seconds ┃ Jobs ┃ Time per job ┃
┡━━━━━━━━━━━╇━━━━━━━━━╇━━━━━━╇━━━━━━━━━━━━━━┩
│         1 │   0.076 │    1 │        0.076 │
│         2 │   0.078 │    1 │        0.078 │
│         3 │  21.288 │    1 │       21.288 │
├───────────┼─────────┼──────┼──────────────┤
│   Average │   7.147 │      │              │
│    Median │   0.078 │      │              │
│     Total │  21.442 │      │              │
│       Max │  21.288 │      │              │
│       Min │   0.076 │      │              │
└───────────┴─────────┴──────┴──────────────┘

Copy raw data to clipboard

Download »generation_times.txt« as file

Arguments Overview

Copy raw data to clipboard

Download »cpu_ram_usage.csv« as file

timestamp,ram_usage_mb,cpu_usage_percent
1767002087,800.640625,13.9

Copy raw data to clipboard

Download »cpu_ram_usage.csv« as file

RESULT (goal: minimize)

Best value: -331437.32
Achieved at:
- run_time = 6
- OO_Info_int_param = -100
- OO_Info_int_param_two = -100
- OO_Info_float_param = -100
- OO_Info_choice_param = 16
- int_param = -100
- float_param = -100
- int_param_two = -100
- choice_param = 16

Parameter statistics