由于权限问题而更改缓存目录

Question

我尝试在我大学的 HPC 上使用 SLURM 运行 cupy。我收到以下错误：

PermissionError: [Errno 13] Permission denied: '/home/username'

我认为这是因为计算节点没有访问 /home 的权限。 由于整个错误说

    Traceback (most recent call last):
  File "/shared-storage/username/tests/cuml_test.py", line 12, in <module>
    dbscan_float.fit(gdf_float)
  File "cuml/cluster/dbscan.pyx", line 219, in cuml.cluster.dbscan.DBSCAN.fit
  File "/shared-storage/username/miniconda/lib/python3.6/site-packages/cuml/ut
ils/input_utils.py", line 139, in input_to_cuml_array
    X_m = CumlArray(data=cuml.utils.numba_utils.row_matrix(X))
  File "/shared-storage/username/miniconda/lib/python3.6/site-packages/cuml/ut
ils/memory_utils.py", line 55, in cupy_rmm_wrapper
    return func(*args, **kwargs)
  File "/shared-storage/username/miniconda/lib/python3.6/site-packages/cuml/ut
ils/numba_utils.py", line 36, in row_matrix
    col_major = df.as_gpu_matrix(order='F')
  File "/shared-storage/username/miniconda/lib/python3.6/site-packages/cudf/co
re/dataframe.py", line 1926, in as_gpu_matrix
    matrix[:, colidx] = dense
  File "cupy/core/core.pyx", line 1248, in cupy.core.core.ndarray.__setitem__
  File "cupy/core/_routines_indexing.pyx", line 49, in cupy.core._routines_index
ing._ndarray_setitem
  File "cupy/core/_routines_indexing.pyx", line 800, in cupy.core._routines_inde
xing._scatter_op
  File "cupy/core/core.pyx", line 517, in cupy.core.core.ndarray.fill
  File "cupy/core/_kernel.pyx", line 648, in cupy.core._kernel.ElementwiseKernel
.__call__
  File "cupy/core/_kernel.pyx", line 678, in cupy.core._kernel.ElementwiseKernel
._get_elementwise_kernel
  File "cupy/core/_kernel.pyx", line 478, in cupy.core._kernel._get_elementwise_
kernel
  File "cupy/core/_kernel.pyx", line 41, in cupy.core._kernel._get_simple_elemen
twise_kernel
  File "cupy/core/_kernel.pyx", line 61, in cupy.core._kernel._get_simple_elemen
twise_kernel
  File "cupy/core/carray.pxi", line 194, in cupy.core.core.compile_with_cache
  File "/shared-storage/username/miniconda/lib/python3.6/site-packages/cupy/cu
da/compiler.py", line 287, in compile_with_cache
    extra_source, backend)
  File "/shared-storage/username/miniconda/lib/python3.6/site-packages/cupy/cu
da/compiler.py", line 318, in _compile_with_cache_cuda
    os.makedirs(cache_dir)
  File "/shared-storage/username/miniconda/lib/python3.6/os.py", line 210, in 
makedirs
    makedirs(head, mode, exist_ok)
  File "/shared-storage/username/miniconda/lib/python3.6/os.py", line 210, in 
makedirs
    makedirs(head, mode, exist_ok)
  File "/shared-storage/username/miniconda/lib/python3.6/os.py", line 220, in 
makedirs
    mkdir(name, mode)
PermissionError: [Errno 13] Permission denied: '/home/username'

我假设它是一个无法在 /home/username 中创建的缓存目录 有没有机会我可以更改此缓存目录以在 /shared-storage/username 中创建？

Answer 1

设置环境变量CUPY_CACHE_DIR，参见https://docs-cupy.chainer.org/en/stable/reference/environment.html。