【问题标题】:aws s3 php: fails to upload directory using UploadSyncBuilderaws s3 php:无法使用 UploadSyncBuilder 上传目录
【发布时间】:2014-09-17 16:06:18
【问题描述】:

我正在尝试使用 aws php sdk 将 14MB 目录上传到 s3。这些是以下场景及其结果

  1. 从我的本地系统(印度)上传到 s3(us-east-1):成功
  2. 从 ec2(ap-southeast-1) 上传到 s3(ap-southeast-1):成功
  3. 从 ec2(ap-southeast-1) 上传到 s3(us-east-1):失败

以下代码我用过

require('application/classes/vendor/autoload.php');
use Aws\S3\S3Client;
use Aws\Common\Credentials\Credentials;
use Aws\S3\Sync\UploadSyncBuilder;
use Guzzle\Log\ClosureLogAdapter;
use Guzzle\Plugin\Log\LogPlugin;

$newCredentials = new Credentials("API_KEY", "SECRET_KEY");
$s3 = S3Client::factory();
//$logPlugin = Guzzle\Plugin\Log\LogPlugin::getDebugPlugin();
$stream = fopen('out.log', 'w');

$logPlugin = new LogPlugin(new ClosureLogAdapter(function ($m) use ($stream) {
    fwrite($stream, $m . PHP_EOL);
}), "# Request:\n{request}\n\n# Response:\n{response}\n\n# Errors: {curl_code} {curl_error}", true);

$s3->addSubscriber($logPlugin);

$s3->setCredentials($newCredentials);
$s3->setRegion("us-east-1");
UploadSyncBuilder::getInstance()
->setClient($s3)
->setBucket("BUCKET")
->setAcl("public-read")
->uploadFromDirectory("/mnt/1410503562Welcome to Leap!.zip_ext")
->setKeyPrefix("customs3/game10906/1410501964WelcometoLeap.zip_ext")
->setConcurrency(5)
->build()
->transfer();

异常

PHP Fatal error:  Uncaught exception 'Guzzle\Service\Exception\CommandTransferException' with message 'Errors during multi transfer (Guzzle\Http\Exception\RequestException) ./application/classes/vendor/guzzle/guzzle/src/Guzzle/Http/Message/Request.php line 569

Error completing request

#0 ./application/classes/vendor/guzzle/guzzle/src/Guzzle/Http/Message/Request.php(378): Guzzle\Http\Message\Request->processResponse(Array)
#1 ./application/classes/vendor/guzzle/guzzle/src/Guzzle/Http/Message/EntityEnclosingRequest.php(49): Guzzle\Http\Message\Request->setState('complete', Array)
#2 ./application/classes/vendor/guzzle/guzzle/src/Guzzle/Http/Curl/CurlMulti.php(286): Guzzle\Http\Message\EntityEnclosingRequest->setState('complete', Array)
#3 ./application/classes/vendor/guzzle/guzzle/src/Guzzle/Http/Curl/CurlMulti.php(244): Guzzle\Http\Curl\CurlMulti->processResponse(Object(Guzzle\Http\Message\EntityEnclosingRequest), Object(Guzzle\Http\Curl\CurlHandle), Array)
#4 ./application/classes/vendor/guzzle/guzzle in /vol/selfserve/application/classes/vendor/guzzle/guzzle/src/Guzzle/Service/Exception/CommandTransferException.php on line 25

我也有设置日志来调试和挖掘 Guzzle 库。我发现当它失败时,对于请求没有响应。当我将并发设置为 1 时,它会成功但需要很长时间。即使并发 2 也失败。

如果任何文件失败,则整个上传失败,使其处于部分上传状态。我找不到任何方法来设置选项以在失败时重试。

感谢您的帮助!

【问题讨论】:

  • 可能不相关,但最好在实例化客户端时设置凭据和区域,而不是使用 setRegion/setCredentials 方法。所以 $s3 = S3Client::factory(array('region' => 'us-east-1', 'credentials' => new Credentials('foo', 'bar')));

标签: php amazon-web-services amazon-s3 aws-php-sdk


【解决方案1】:

联系 AWS 支持后,我在他们的帮助下解决了这个问题。问题出在 guzzle 库中。以下是 AWS 支持的回复

当 cURL 无法倒带流并且没有 将错误与 curl 句柄相关联。我们已将支票添加到帐户 对于这种情况并自动重试。请确保他们 正在使用最新版本的 SDK 和 3.9.2+ 版本的 Guzzle。

【讨论】:

    猜你喜欢
    • 1970-01-01
    • 1970-01-01
    • 2021-10-27
    • 2021-04-16
    • 1970-01-01
    • 2018-12-24
    • 2017-01-29
    • 2018-08-13
    • 2018-07-12
    相关资源
    最近更新 更多