在 settings.py 中设置 DEFAULT_FILE_STORAGE 会破坏应用程序

Question

问题：

在 settings.py 中启用 DEFAULT_FILE_STORAGE 会创建 TypeError: Unicode-objects must be encoded before hashing（以下日志）

• DEFAULT_FILE_STORAGE = '' 创建类型错误
• DEFAULT_FILE_STORAGE = 'app.aws.utils.MediaRootS3Boto3Storage' 创建类型错误

我在做什么？

• 我正在尝试为静态和媒体文件设置 S3 存储。
• 我特别想在我的 AWS 存储桶的 /media/ 文件夹中启用 photologue 存储。

什么有效？

• 如果我在 settings.py 中注释掉 #DEFAULT_FILE_STORAGE = 'app.aws.utils.MediaRootS3Boto3Storage'
• 我可以跑python manage.py collectstatic 我所有的静态文件都成功上传到aws上的/static/文件夹
• 静态资产正在运行
• 媒体资产在本地正常运行

出了什么问题？

• DEFAULT_FILE_STORAGE 设置为 any 值会创建此错误消息。

日志：

    Unhandled exception in thread started by <function check_errors.<locals>.wrapper at 0x1103e3ea0>
Traceback (most recent call last):
  File "/env/lib/python3.6/site-packages/django/utils/autoreload.py", line 225, in wrapper
    fn(*args, **kwargs)
  File "/env/lib/python3.6/site-packages/django/core/management/commands/runserver.py", line 113, in inner_run
    autoreload.raise_last_exception()
  File "/env/lib/python3.6/site-packages/django/utils/autoreload.py", line 248, in raise_last_exception
    raise _exception[1]
  File "/env/lib/python3.6/site-packages/django/core/management/__init__.py", line 327, in execute
    autoreload.check_errors(django.setup)()
  File "/env/lib/python3.6/site-packages/django/utils/autoreload.py", line 225, in wrapper
    fn(*args, **kwargs)
  File "/env/lib/python3.6/site-packages/django/__init__.py", line 24, in setup
    apps.populate(settings.INSTALLED_APPS)
  File "/env/lib/python3.6/site-packages/django/apps/registry.py", line 112, in populate
    app_config.import_models()
  File "/env/lib/python3.6/site-packages/django/apps/config.py", line 198, in import_models
    self.models_module = import_module(models_module_name)
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/importlib/__init__.py", line 126, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 994, in _gcd_import
  File "<frozen importlib._bootstrap>", line 971, in _find_and_load
  File "<frozen importlib._bootstrap>", line 955, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 665, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 678, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/env/lib/python3.6/site-packages/photologue/models.py", line 76, in <module>
    "Signature: 8a477f597d28d172789f06886806bc55"))
  File "/env/lib/python3.6/site-packages/django/core/files/storage.py", line 49, in save
    return self._save(name, content)
  File "/env/lib/python3.6/site-packages/storages/backends/s3boto3.py", line 452, in _save
    self._save_content(obj, content, parameters=parameters)
  File "/env/lib/python3.6/site-packages/storages/backends/s3boto3.py", line 467, in _save_content
    obj.upload_fileobj(content, ExtraArgs=put_parameters)
  File "/env/lib/python3.6/site-packages/boto3/s3/inject.py", line 513, in object_upload_fileobj
    ExtraArgs=ExtraArgs, Callback=Callback, Config=Config)
  File "/env/lib/python3.6/site-packages/boto3/s3/inject.py", line 431, in upload_fileobj
    return future.result()
  File "/env/lib/python3.6/site-packages/s3transfer/futures.py", line 73, in result
    return self._coordinator.result()
  File "/env/lib/python3.6/site-packages/s3transfer/futures.py", line 233, in result
    raise self._exception
  File "/env/lib/python3.6/site-packages/s3transfer/tasks.py", line 126, in __call__
    return self._execute_main(kwargs)
  File "/env/lib/python3.6/site-packages/s3transfer/tasks.py", line 150, in _execute_main
    return_value = self._main(**kwargs)
  File "/env/lib/python3.6/site-packages/s3transfer/upload.py", line 692, in _main
    client.put_object(Bucket=bucket, Key=key, Body=body, **extra_args)
  File "/env/lib/python3.6/site-packages/botocore/client.py", line 314, in _api_call
    return self._make_api_call(operation_name, kwargs)
  File "/env/lib/python3.6/site-packages/botocore/client.py", line 593, in _make_api_call
    request_signer=self._request_signer, context=request_context)
  File "/env/lib/python3.6/site-packages/botocore/hooks.py", line 242, in emit_until_response
    responses = self._emit(event_name, kwargs, stop_on_response=True)
  File "/env/lib/python3.6/site-packages/botocore/hooks.py", line 210, in _emit
    response = handler(**kwargs)
  File "/env/lib/python3.6/site-packages/botocore/handlers.py", line 210, in conditionally_calculate_md5
    calculate_md5(params, **kwargs)
  File "/env/lib/python3.6/site-packages/botocore/handlers.py", line 188, in calculate_md5
    binary_md5 = _calculate_md5_from_file(body)
  File "/env/lib/python3.6/site-packages/botocore/handlers.py", line 202, in _calculate_md5_from_file
    md5.update(chunk)
TypeError: Unicode-objects must be encoded before hashing

问题：

• 这是我安装的软件包的问题吗？
• 为什么启用此设置DEFAULT_FILE_LOCATION 会触发此错误。
• 我还可以提供哪些其他信息来帮助我查明这个问题？

包：

boto3==1.6.4
botocore==1.9.4
Django==2.0.3
django-photologue==3.8.1
django-sortedm2m==1.5.0
django-storages==1.6.5
docutils==0.14
ExifRead==2.1.2
jmespath==0.9.3
Pillow==5.0.0
psycopg2==2.7.4
python-dateutil==2.6.1
python-decouple==3.1
pytz==2018.3
s3transfer==0.1.13
six==1.11.0

版本号

• Python 3.6.4
• Django 2.0.3

我使用过的资源

• https://www.caktusgroup.com/blog/2014/11/10/Using-Amazon-S3-to-store-your-Django-sites-static-and-media-files/
• https://www.codingforentrepreneurs.com/blog/s3-static-media-files-for-django/

提前感谢您的帮助！

Answer 1

好的，所以我看到第二篇文章建议对 DEFAULT_FILE_STORAGE 使用该设置，但它看起来有点不寻常。

引用http://django-storages.readthedocs.io/en/latest/backends/amazon-S3.html，你会使用：

DEFAULT_FILE_STORAGE = 'storages.backends.s3boto3.S3Boto3Storage'

用于您的媒体根目录。

编辑： 使用 Prologue 和 S3，它只支持 Python 2.7 和旧的 Boto 库。