GCP 上的气流 - Errno 111 连接被拒绝答案

【问题标题】：Airflow on GCP - Errno 111 Connection refusedGCP 上的气流 - Errno 111 连接被拒绝
【发布时间】：2019-12-19 01:09:41
【问题描述】：

我们有 Airflow 1.10.5，使用 CeleryExecutor，在 Google Cloud Platform 上运行。

偶尔会出现以下错误：

[2019-12-17 19:00:45,990] {{base_task_runner.py:115}} INFO - Job 704: Subtask our-task-name ERROR: (gcloud.container.clusters.get-credentials) [Errno 111] Connection refused
[2019-12-17 19:00:45,990] {{base_task_runner.py:115}} INFO - Job 704: Subtask our-task-name This may be due to network connectivity issues. Please check your network settings, and the status of the service you are trying to reach.
[2019-12-17 19:00:46,279] {{taskinstance.py:1051}} ERROR - Command '['gcloud', 'container', 'clusters', 'get-credentials', 'airflow-pipeline-name', '--zone', 'us-central1-a', '--project', 'project-name']' returned non-zero exit status 1.
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/airflow/models/taskinstance.py", line 926, in _run_raw_task
    result = task_copy.execute(context=context)
  File "/usr/local/lib/python3.7/site-packages/airflow/contrib/operators/gcp_container_operator.py", line 271, in execute
    "--project", self.project_id])
  File "/usr/local/lib/python3.7/subprocess.py", line 363, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['gcloud', 'container', 'clusters', 'get-credentials', 'airflow-pipeline-name', '--zone', 'us-central1-a', '--project', 'project-name']' returned non-zero exit status 1.
[2019-12-17 19:00:46,358] {{taskinstance.py:1082}} INFO - Marking task as FAILED.

这是 Airflow 本身、其插件（如 Kubernetes 的插件）还是 Google Cloud Platform 中的错误？

有什么办法可以解决吗？

【问题讨论】：

标签： google-cloud-platform airflow

【解决方案1】：

问题是元数据服务器在某些时候没有响应。我们的同事解决了这个问题。

【讨论】：