【问题标题】:python mrjob - gaierror: [Errno -2] Name or service not knownpython mrjob - gaierror:[Errno -2] 名称或服务未知
【发布时间】:2013-07-01 18:51:21
【问题描述】:

我正在尝试从 mrjob 模块访问 s3 文件。 这是失败的代码:

from mrjob.emr import S3Filesystem
fs = S3Filesystem("<aws_access_key_id>", "<aws_secret_access_key>", "us-west-2")
fs.get_s3_key("s3n://<bucket>/<folder>/file.txt")

(但使用实际的 aws_access_key_id、aws_secret_access_key、存储桶和文件夹),我得到的错误是:

Traceback (most recent call last):
  File "<input>", line 1, in <module>
  File "/usr/local/lib/python2.7/dist-packages/mrjob/fs/s3.py", line 235, in get_s3_key
    bucket = s3_conn.get_bucket(bucket_name)
  File "/usr/local/lib/python2.7/dist-packages/mrjob/retry.py", line 80, in call_and_maybe_retry
    return f(*args, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/boto/s3/connection.py", line 431, in get_bucket
    bucket.get_all_keys(headers, maxkeys=0)
  File "/usr/local/lib/python2.7/dist-packages/boto/s3/bucket.py", line 375, in get_all_keys
    '', headers, **params)
  File "/usr/local/lib/python2.7/dist-packages/boto/s3/bucket.py", line 332, in _get_all
    query_args=query_args)
  File "/usr/local/lib/python2.7/dist-packages/boto/s3/connection.py", line 547, in make_request
    retry_handler=retry_handler
  File "/usr/local/lib/python2.7/dist-packages/boto/connection.py", line 947, in make_request
    retry_handler=retry_handler)
  File "/usr/local/lib/python2.7/dist-packages/boto/connection.py", line 908, in _mexe
    raise e
gaierror: [Errno -2] Name or service not known

有什么建议吗? 谢谢!

【问题讨论】:

    标签: python amazon-s3 emr mrjob


    【解决方案1】:

    这个 (s3n://)

    fs.get_s3_key("s3n://<bucket>/<folder>/file.txt")
    

    应该是这个(s3://):

    fs.get_s3_key("s3://<bucket>/<folder>/file.txt")
    

    【讨论】:

      猜你喜欢
      • 2021-11-05
      • 2016-11-16
      • 2019-07-26
      • 2019-12-05
      • 1970-01-01
      • 2013-09-24
      • 1970-01-01
      • 1970-01-01
      • 1970-01-01
      相关资源
      最近更新 更多