【问题标题】:S3 java v1 => v2: putObject only works when debugging - SdkClientException: Unable to execute HTTP request: Read timed outS3 java v1 => v2:putObject 仅在调试时有效 - SdkClientException:无法执行 HTTP 请求:读取超时
【发布时间】:2019-03-12 12:08:42
【问题描述】:

我想从 S3 java v1 迁移到 v2,现在由于某种原因,一个小集成测试开始失败。在调试和单步执行时,它正在工作。这是代码(我有一个 localstack https://github.com/localstack/localstack 实例正在运行):

@RunWith(SpringRunner::class)
@SpringBootTest(webEnvironment = SpringBootTest.WebEnvironment.RANDOM_PORT)
class S3ConfigurationTest {

@Autowired
@Qualifier("historicalDataS3")
lateinit var s3: S3Client

@Test
fun `can write and read object on s3`() {
    var bucket = s3.listBuckets().buckets().first()

    val uid = UUID.randomUUID().toString()

    s3.putObject(
        PutObjectRequest.builder().bucket(bucket.name()).key(uid)
            .build(),
        RequestBody.fromString("test test test"))

    val read =
        String(s3.getObject(GetObjectRequest.builder().bucket(bucket.name()).key(uid).build()).readBytes())

    Assertions.assertThat(read).isEqualTo("test test test")
}

这是植根于 putObject 行的异常:

software.amazon.awssdk.core.exception.SdkClientException:无法执行 HTTP 请求:读取超时

at software.amazon.awssdk.core.exception.SdkClientException$BuilderImpl.build(SdkClientException.java:97)
at software.amazon.awssdk.core.internal.http.pipeline.stages.RetryableStage$RetryExecutor.handleThrownException(RetryableStage.java:136)
at software.amazon.awssdk.core.internal.http.pipeline.stages.RetryableStage$RetryExecutor.execute(RetryableStage.java:94)
at software.amazon.awssdk.core.internal.http.pipeline.stages.RetryableStage.execute(RetryableStage.java:62)
at software.amazon.awssdk.core.internal.http.pipeline.stages.RetryableStage.execute(RetryableStage.java:42)
at software.amazon.awssdk.core.internal.http.pipeline.RequestPipelineBuilder$ComposingRequestPipelineStage.execute(RequestPipelineBuilder.java:206)
at software.amazon.awssdk.core.internal.http.StreamManagingStage.execute(StreamManagingStage.java:51)
at software.amazon.awssdk.core.internal.http.StreamManagingStage.execute(StreamManagingStage.java:33)
at software.amazon.awssdk.core.internal.http.pipeline.stages.ApiCallTimeoutTrackingStage.executeWithTimer(ApiCallTimeoutTrackingStage.java:79)
at software.amazon.awssdk.core.internal.http.pipeline.stages.ApiCallTimeoutTrackingStage.execute(ApiCallTimeoutTrackingStage.java:60)
at software.amazon.awssdk.core.internal.http.pipeline.stages.ApiCallTimeoutTrackingStage.execute(ApiCallTimeoutTrackingStage.java:42)
at software.amazon.awssdk.core.internal.http.pipeline.RequestPipelineBuilder$ComposingRequestPipelineStage.execute(RequestPipelineBuilder.java:206)
at software.amazon.awssdk.core.internal.http.pipeline.RequestPipelineBuilder$ComposingRequestPipelineStage.execute(RequestPipelineBuilder.java:206)
at software.amazon.awssdk.core.internal.http.pipeline.stages.ExecutionFailureExceptionReportingStage.execute(ExecutionFailureExceptionReportingStage.java:37)
at software.amazon.awssdk.core.internal.http.pipeline.stages.ExecutionFailureExceptionReportingStage.execute(ExecutionFailureExceptionReportingStage.java:26)
at software.amazon.awssdk.core.internal.http.AmazonSyncHttpClient$RequestExecutionBuilderImpl.execute(AmazonSyncHttpClient.java:240)
at software.amazon.awssdk.core.client.handler.BaseSyncClientHandler.invoke(BaseSyncClientHandler.java:96)
at software.amazon.awssdk.core.client.handler.BaseSyncClientHandler.execute(BaseSyncClientHandler.java:120)
at software.amazon.awssdk.core.client.handler.BaseSyncClientHandler.execute(BaseSyncClientHandler.java:73)
at software.amazon.awssdk.core.client.handler.SdkSyncClientHandler.execute(SdkSyncClientHandler.java:44)
at software.amazon.awssdk.awscore.client.handler.AwsSyncClientHandler.execute(AwsSyncClientHandler.java:55)
at software.amazon.awssdk.services.s3.DefaultS3Client.putObject(DefaultS3Client.java:3053)

这里发生了什么?就示例而言,这应该可以工作https://github.com/awsdocs/aws-doc-sdk-examples/blob/master/javav2/example_code/s3/src/main/java/com/example/s3/S3ObjectOperations.java

【问题讨论】:

    标签: java amazon-web-services amazon-s3 localstack


    【解决方案1】:

    根本原因是您的代码运行速度超过了 AWS 在其内部组件之间的通信速度。

    您需要减慢代码运行速度或让服务员循环并等待 s3Client.doesBucketExistV2(BucketName) 返回真。

    【讨论】:

      猜你喜欢
      • 1970-01-01
      • 1970-01-01
      • 2021-12-31
      • 1970-01-01
      • 2023-04-08
      • 1970-01-01
      • 1970-01-01
      • 1970-01-01
      • 1970-01-01
      相关资源
      最近更新 更多