【发布时间】:2020-08-18 02:16:31
【问题描述】:
由于函数 read_metadata 与旧版本不兼容,为什么 the commit 7138f470f0e55f2ebdb7638ddc4dfe2e78671403 没有触发新的主要版本 dask?提交引入了 4 个值的返回,但旧版本仅返回 3 个。根据语义 versioning 这将是正确的行为。
cudf 被破坏了,因为那次提交。
问题代码:
>>> import cudf
>>> import dask_cudf
>>> dask_cudf.from_cudf(cudf.DataFrame({'a':[1,2,3]}),npartitions=1).to_parquet('test_parquet')
>>> dask_cudf.read_parquet('test_parquet')
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
File "/nvme/0/vjawa/conda/envs/cudf_15_june_25/lib/python3.7/site-packages/dask_cudf/io/parquet.py", line 213, in read_parquet
**kwargs,
File "/nvme/0/vjawa/conda/envs/cudf_15_june_25/lib/python3.7/site-packages/dask/dataframe/io/parquet/core.py", line 234, in read_parquet
**kwargs
File "/nvme/0/vjawa/conda/envs/cudf_15_june_25/lib/python3.7/site-packages/dask_cudf/io/parquet.py", line 17, in read_metadata
meta, stats, parts, index = ArrowEngine.read_metadata(*args, **kwargs)
ValueError: not enough values to unpack (expected 4, got 3)
dask_cudf==0.14 仅与 dask
【问题讨论】:
标签: python dependencies dask cudf