使用 Python 创建具有特定内容的多个容器

Question

我的 Blob 存储中有一个包含大约 200k 图像的容器。我想用 Python 编写一个脚本，将 20k 的这些图像批量复制到名为 imageset1、imageset2、...、imageset20 之类的新容器中（最后一个容器中的图像少于 20k，这很好）。

到目前为止，我有以下内容：

from azure.storage.blob import BlockBlobService 
from io import BytesIO from shutil
import copyfileobj 
with BytesIO() as input_blob: 
   with BytesIO() as output_blob:
block_blob_service = BlockBlobService(account_name='my_account_name', account_key='my_account_key')

# Download as a stream 
block_blob_service.get_blob_to_stream('mycontainer', 'myinputfilename', input_blob) 


# Here is where I want to chunk up the container contents into batches of 20k


# Then I want to write the above to a set of new containers using, I think, something like this... 
block_blob_service.create_blob_from_stream('mycontainer', 'myoutputfilename', output_blob)

这是将容器的内容分块并将结果写入新容器，我不知道该怎么做。有人可以帮忙吗？

Answer 1

这是我实现您需求的示例代码，它适用于我的容器。

from azure.storage.blob.baseblobservice import BaseBlobService

account_name = '<your account name>'
account_key = '<your account key>'
container_name = '<the source container name>'

blob_service = BaseBlobService(
    account_name=account_name,
    account_key=account_key
)

blobs = blob_service.list_blobs(container_name)

# The target container index starts with 1
container_index = 1
# The blob number in new container, such as 3 in my testing 
num_per_container = 3
count = 0
# The prefix of new container name
prefix_of_new_container = 'imageset'
flag_of_new_container = False

for blob in blobs:
    if flag_of_new_container == False:
        flag_of_new_container = blob_service.create_container("%s%d" % (prefix_of_new_container, container_index))
    print(blob.name, "%s%d" % (prefix_of_new_container,container_index))
    blob_service.copy_blob("%s%d" % (prefix_of_new_container, container_index), blob.name, "https://%s.blob.core.windows.net/%s/%s" % (account_name, container_name, blob.name))
    count += 1
    if count == num_per_container:
        container_index += 1
        count = 0
        flag_of_new_container = False

注意：我只使用BaseBlobService，因为它足以满足您的需求，即使对于 AppendBlob 或 PageBlob 也是如此。此外，您可以使用BlockBlobService 代替它。