experiment_impact_tracker.gpu package¶
Submodules¶
experiment_impact_tracker.gpu.exceptions module¶
-
exception
experiment_impact_tracker.gpu.exceptions.GPUAttributeAssertionError¶ Bases:
Exception
experiment_impact_tracker.gpu.nvidia module¶
-
experiment_impact_tracker.gpu.nvidia.assert_gpus_by_attributes(attributes_set)¶ Assert that you’re running on GPUs with a certain set of attributes.
This helps when running jobs in a cluster setting with heterogeneous GPUs to filter out sets of GPUs that you’d rather avoid. Current NVIDIA attributes, include product_name (e.g., GeForce GTX TITAN X, Titan xp, Tesla k40m, etc.), must be an exact match based on string seen in nvidia-smi -q -x.
- Parameters
attributes_set (dict) – set of attribute key pairs
- Raises
GPUAttributeAssertionError on encountered asserted attribute mismatch –
-
experiment_impact_tracker.gpu.nvidia.get_gpu_info()¶
-
experiment_impact_tracker.gpu.nvidia.get_nvidia_gpu_power(pid_list, logger=None, **kwargs)¶