【发布时间】:2021-05-31 03:08:48
【问题描述】:
我的 docker 中有两个 NVIDIA 设备。这是两个模型同时运行时的 GPU 使用信息。
+-----------------------------------------------------------------------------+
| Processes: GPU Memory |
| GPU PID Type Process name Usage |
|=============================================================================|
+-----------------------------------------------------------------------------+
Mon May 31 10:51:54 2021
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 418.43 Driver Version: 418.43 CUDA Version: 10.1 |
|-------------------------------+----------------------+----------------------+
| GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. |
|===============================+======================+======================|
| 0 GeForce GTX 108... Off | 00000000:03:00.0 Off | N/A |
| 37% 64C P2 81W / 250W | 10909MiB / 11178MiB | 0% Default |
+-------------------------------+----------------------+----------------------+
| 1 GeForce GTX 108... Off | 00000000:04:00.0 Off | N/A |
| 28% 50C P8 9W / 250W | 147MiB / 11178MiB | 0% Default |
+-------------------------------+----------------------+----------------------+
+-----------------------------------------------------------------------------+
| Processes: GPU Memory |
| GPU PID Type Process name Usage |
|=============================================================================|
+-----------------------------------------------------------------------------+
显然有两个型号正在使用设备0。这里我有两个问题:
- 我如何知道使用的是哪个设备?
- 如果一个模型使用设备
0,我们可以自动让另一个模型使用设备1吗?
【问题讨论】: