ImportError：curl 客户端需要 pycurl 库 Docker + Django答案

【问题标题】：ImportError: The curl client requires the pycurl library Docker + DjangoImportError：curl 客户端需要 pycurl 库 Docker + Django
【发布时间】：2020-09-12 08:06:57
【问题描述】：

我正在对接 Django 2.2 应用程序并使用 Pipenv 进行环境管理。我想使用 SQS 作为 Django celery 的代理。

我已经使用 Pipenv 安装了 pycurl 库

[packages]
...
pycurl = "*"

当我在本地运行 celery 时

pipenv run celery -A qcg worker -l info

它可以工作，但是当我使用 docker image 运行时

docker run app:latest celery -A qcg worker -l info

报错

ImportError: The curl client requires the pycurl library.

Docerkfile中的命令用来安装依赖

RUN set -ex \
    && BUILD_DEPS=" \
    build-essential \
    libpcre3-dev \
    libpq-dev \
    libcurl4-openssl-dev libssl-dev \
    " \
    && apt-get update && apt-get install -y --no-install-recommends $BUILD_DEPS \
    && export PYCURL_SSL_LIBRARY=nss \
    && pipenv install --deploy --system \
    \
    && apt-get purge -y --auto-remove -o APT::AutoRemove::RecommendsImportant=false $BUILD_DEPS 
    \
    && rm -rf /var/lib/apt/lists/*

完整的错误日志

[2020-05-25 17:16:22,216: CRITICAL/MainProcess] Unrecoverable error: ImportError('The curl client requires the pycurl library.')
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/kombu/asynchronous/http/__init__.py", line 20, in get_client
    return hub._current_http_client
AttributeError: 'Hub' object has no attribute '_current_http_client'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/celery/worker/worker.py", line 205, in start
    self.blueprint.start(self)
  File "/usr/local/lib/python3.7/site-packages/celery/bootsteps.py", line 119, in start
    step.start(parent)
  File "/usr/local/lib/python3.7/site-packages/celery/bootsteps.py", line 369, in start
    return self.obj.start()
  File "/usr/local/lib/python3.7/site-packages/celery/worker/consumer/consumer.py", line 318, in start
    blueprint.start(self)
  File "/usr/local/lib/python3.7/site-packages/celery/bootsteps.py", line 119, in start
    step.start(parent)
  File "/usr/local/lib/python3.7/site-packages/celery/worker/consumer/consumer.py", line 599, in start
    c.loop(*c.loop_args())
  File "/usr/local/lib/python3.7/site-packages/celery/worker/loops.py", line 83, in asynloop
    next(loop)
  File "/usr/local/lib/python3.7/site-packages/kombu/asynchronous/hub.py", line 301, in create_loop
    item()
  File "/usr/local/lib/python3.7/site-packages/vine/promises.py", line 170, in __call__
    return self.throw()
  File "/usr/local/lib/python3.7/site-packages/vine/promises.py", line 167, in __call__
    retval = fun(*final_args, **final_kwargs)
  File "/usr/local/lib/python3.7/site-packages/kombu/transport/SQS.py", line 390, in _schedule_queue
    queue, callback=promise(self._loop1, (queue,)),
  File "/usr/local/lib/python3.7/site-packages/kombu/transport/SQS.py", line 406, in _get_bulk_async
    return self._get_async(queue, maxcount, callback=callback)
  File "/usr/local/lib/python3.7/site-packages/kombu/transport/SQS.py", line 416, in _get_async
    qname, count=count, connection=self.asynsqs(queue=qname),
  File "/usr/local/lib/python3.7/site-packages/kombu/transport/SQS.py", line 566, in asynsqs
    region=self.region
  File "/usr/local/lib/python3.7/site-packages/kombu/asynchronous/aws/sqs/connection.py", line 27, in __init__
    **kwargs
  File "/usr/local/lib/python3.7/site-packages/kombu/asynchronous/aws/connection.py", line 194, in __init__
    **http_client_params)
  File "/usr/local/lib/python3.7/site-packages/kombu/asynchronous/aws/connection.py", line 151, in __init__
    self._httpclient = http_client or get_client()
  File "/usr/local/lib/python3.7/site-packages/kombu/asynchronous/http/__init__.py", line 22, in get_client
    client = hub._current_http_client = Client(hub, **kwargs)
  File "/usr/local/lib/python3.7/site-packages/kombu/asynchronous/http/__init__.py", line 13, in Client
    return CurlClient(hub, **kwargs)
  File "/usr/local/lib/python3.7/site-packages/kombu/asynchronous/http/curl.py", line 43, in __init__
    raise ImportError('The curl client requires the pycurl library.')
ImportError: The curl client requires the pycurl library.

【问题讨论】：

您要么没有安装 pycurl，要么将其安装到产生错误的代码未使用的本地化环境中。
我是在 Pipenv 环境下安装的。我正在使用相同的环境锁 fike 安装在 docker 中。安装的所有其他依赖项都工作正常。
安装后pycurl文件的路径是什么？
它在站点可用目录中。但是在 Dockerfile 中，我使用Pipenv install 再次安装它，所以它必须在 python 的站点可用目录以及容器内提供。
那么，是安装目录错误还是引用目录错误？

标签： django docker amazon-sqs django-celery pycurl

【解决方案1】：

此问题与 libcurl4-nss-dev libssl-dev 安装有关。

在下面的安装脚本中

RUN set -ex \
    && BUILD_DEPS=" \
    build-essential \
    libpcre3-dev \
    libpq-dev \
    libcurl4-openssl-dev libssl-dev \
    " \
    && apt-get update && apt-get install -y --no-install-recommends $BUILD_DEPS \
    && export PYCURL_SSL_LIBRARY=nss \
    && pipenv install --deploy --system \
    \
    && apt-get purge -y --auto-remove -o APT::AutoRemove::RecommendsImportant=false $BUILD_DEPS 
    \
    && rm -rf /var/lib/apt/lists/* ```

libcurl4-nss-dev libssl-dev 安装在Pipenv install 之后被删除。所以找不到包库。

libcurl4-nss-dev libssl-dev 的单独安装对我有用。

RUN apt-get install -y --no-install-recommends libcurl4-nss-dev libssl-dev

【讨论】：