Skip to content

GitLab

Closed
Created by Thilo Fryen@ThiloFryenMaintainer

NVMLError

Exception in thread StatsThr:
Traceback (most recent call last):
  File "/usr/lib/python3.9/threading.py", line 973, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.9/threading.py", line 910, in run
    self._target(*self._args, **self._kwargs)
  File "/home/eppe/Scilab-RL/venv/lib/python3.9/site-packages/wandb/sdk/internal/stats.py", line 133, in _thread_body
    stats = self.stats()
  File "/home/eppe/Scilab-RL/venv/lib/python3.9/site-packages/wandb/sdk/internal/stats.py", line 179, in stats
    handle = pynvml.nvmlDeviceGetHandleByIndex(i)
  File "/home/eppe/Scilab-RL/venv/lib/python3.9/site-packages/wandb/vendor/pynvml/pynvml.py", line 819, in nvmlDeviceGetHandleByIndex
    _nvmlCheckReturn(ret)
  File "/home/eppe/Scilab-RL/venv/lib/python3.9/site-packages/wandb/vendor/pynvml/pynvml.py", line 310, in _nvmlCheckReturn
    raise NVMLError(ret)
wandb.vendor.pynvml.pynvml.NVMLError_Unknown: Unknown Error

Find out what causes this error and try to fix it.