如何使用谷歌云 Python API 将目录复制到谷歌云存储？

Question

以下函数非常适合将单个文件复制到谷歌云存储。

#!/usr/bin/python3.5
import googleapiclient.discovery

from google.cloud import storage

def upload_blob(bucket_name, source_file_name, destination_blob_name, project):
  storage_client = storage.Client(project=project)
  bucket = storage_client.get_bucket(bucket_name)
  blob = bucket.blob(destination_blob_name)

blob.upload_from_filename(source_file_name)

print('File {} uploaded to {}.'.format(
    source_file_name,
    destination_blob_name))

现在我没有给出文件名，而是尝试输入目录名upload_blob('mybucket','/data/inputdata/', 'myapp/inputdata/','myapp') 但后来我得到这个错误：

AttributeError: 'str' 对象没有属性 'read'

调用函数blob.upload_from_file()复制目录时是否需要额外提供参数？

Answer 1

一次上传多个文件不是 API 的内置功能。您可以循环复制多个文件，也可以改用命令行实用程序，它可以复制整个目录。

Answer 2

您可以使用以下代码来完成此操作：

import os
import glob

def copy_local_directory_to_gcs(local_path, bucket, gcs_path):
    """Recursively copy a directory of files to GCS.

    local_path should be a directory and not have a trailing slash.
    """
    assert os.path.isdir(local_path)
    for local_file in glob.glob(local_path + '/**'):
        if not os.path.isfile(local_file):
            continue
        remote_path = os.path.join(gcs_path, local_file[1 + len(local_path) :])
        blob = bucket.blob(remote_path)
        blob.upload_from_filename(local_file)

像这样使用它：

copy_local_directory_to_gcs('path/to/foo', bucket, 'remote/path/to/foo')

bucket 是来自 Google Cloud Storage API 的常用对象：

from google.cloud import storage    
client = storage.Client(project='your-project')
bucket = client.get_bucket('bucket-name')