【发布时间】:2020-06-19 13:04:40
【问题描述】:
我正在使用这个 https://github.com/tuanavu/airflow-tutorial git repo,在 docker 容器中运行气流,但我想同时安装其他要求。
我正在尝试安装 git 和一些其他依赖项,为此我在气流教程目录中创建了 Dockerfile。并在文件中添加以下行。
RUN apt-get update && \
apt-get install -y git
RUN pip install dataclasses
然后尝试使用docker-compose up --build 构建它
但它一直失败并且错误是
ModuleNotFoundError: No module named 'dataclasses'
没有我的 Dockerfile 也能正常工作,谁能帮我解决这个问题?
Docker-compose.yml 文件
version: '3'
services:
postgres:
image: postgres:12.3
environment:
- POSTGRES_USER=airflow
- POSTGRES_PASSWORD=airflow
- POSTGRES_DB=airflow
ports:
- "5433:5432"
webserver:
image: puckel/docker-airflow:1.10.1
build:
context: https://github.com/puckel/docker-airflow.git#1.10.1
dockerfile: Dockerfile
args:
AIRFLOW_DEPS: gcp_api,s3
PYTHON_DEPS: sqlalchemy==1.2.0
restart: always
depends_on:
- postgres
environment:
- LOAD_EX=n
- EXECUTOR=Local
- FERNET_KEY=jsDPRErfv8Z_eVTnGfF8ywd19j4pyqE3NpdUBA_oRTo=
- SSH_AUTH_SOCK=/ssh-agent
volumes:
- /home/awaish/work/airflow/dags1:/usr/local/airflow/dags
- /usr/bin/ssh-agent:/ssh-agent
# Uncomment to include custom plugins
# - ./plugins:/usr/local/airflow/plugins
ports:
- "8080:8080"
command: webserver
healthcheck:
test: ["CMD-SHELL", "[ -f /usr/local/airflow/airflow-webserver.pid ]"]
interval: 30s
timeout: 30s
retries: 3
和 Dockerfile
#WORKDIR /usr/src/app
FROM python3.7
RUN apt-get update && \
apt-get install -y git
RUN pip3 install dataclasses
RUN pip3 install git+ssh://git@bitbucket.org/myspace/utilities.git@master
【问题讨论】:
标签: python-3.x docker airflow