pip install s3fs with sagemaker-training inside docker 导致兼容性问题答案

【问题标题】：pip install s3fs with sagemaker-training inside docker causing compatibility issuespip install s3fs with sagemaker-training inside docker 导致兼容性问题
【发布时间】：2020-09-03 18:14:50
【问题描述】：

我正在尝试将我的培训脚本停靠在 sagemaker 上。这是我的 dockerfile 的样子

FROM python:3.6
RUN pip install --use-feature=2020-resolver pandas
RUN pip install --use-feature=2020-resolver numpy
RUN pip install --use-feature=2020-resolver sklearn
RUN pip install --use-feature=2020-resolver xgboost
RUN pip install --use-feature=2020-resolver xlrd
RUN pip install --use-feature=2020-resolver fsspec
RUN pip install --use-feature=2020-resolver s3fs
RUN pip3 install --use-feature=2020-resolver sagemaker-training
COPY train.py /opt/ml/code/train.py
WORKDIR /opt/ml/code/
# Defines train.py as script entrypoint
ENV SAGEMAKER_PROGRAM train.py

当我构建我的 docker 映像时，我得到以下不兼容错误

第 9/12 步：运行 pip3 install --use-feature=2020-resolver sagemaker-training：

Attempting uninstall: botocore
    Found existing installation: botocore 1.17.44
    Uninstalling botocore-1.17.44:
      Successfully uninstalled botocore-1.17.44
ERROR: aiobotocore 1.1.1 requires botocore<1.17.45,>=1.17.44, but you'll have botocore 1.17.54 which is incompatible.
Successfully installed bcrypt-3.2.0 boto3-1.14.54 botocore-1.17.54 cffi-1.14.2 cryptography-3.1 gevent-20.6.2 greenlet-0.4.16 inotify-simple-1.2.1 paramiko-2.7.2 protobuf-3.13.0 psutil-5.7.2 pycparser-2.20 pynacl-1.4.0 retrying-1.3.3 s3transfer-0.3.3 sagemaker-training-3.6.2 werkzeug-1.0.1 zope.event-4.4 zope.interface-5.1.0

这是我第一次尝试将 docker 与 sagemaker 一起使用。任何帮助将不胜感激。

【问题讨论】：

标签： python docker pip amazon-sagemaker

【解决方案1】：

sagemaker-training 安装最新的boto3，我认为boto3 需要botocore 版本。你能尝试安装一个不同的版本s3fs吗？

【讨论】：