【问题标题】:Updating lifecycle configuration with filters for S3 bucket fails使用 S3 存储桶的过滤器更新生命周期配置失败
【发布时间】:2021-06-27 05:19:30
【问题描述】:

我正在使用 Java SDK 来管理我的 S3 存储桶。此时,我想为这个存储桶介绍一个新的用例,即我想存储类似的对象,但保留期不同。我了解到我可以通过前缀设置生命周期策略。我想利用 S3 提供的这种便利,为我存储在存储桶中的新对象设置不同的生命周期配置,这些对象可以通过不同的前缀进行识别。

这是我的 Java 程序:

package com.something.aws.s3;

import com.amazonaws.services.s3.AmazonS3;
import com.amazonaws.services.s3.AmazonS3ClientBuilder;
import com.amazonaws.services.s3.model.Bucket;
import com.amazonaws.services.s3.model.BucketLifecycleConfiguration;
import com.amazonaws.services.s3.model.lifecycle.LifecycleFilter;
import com.amazonaws.services.s3.model.lifecycle.LifecyclePrefixPredicate;
import org.junit.Before;
import org.junit.Test;

import java.util.List;

public class S3ClientTest {
    private AmazonS3 s3;

    @Before
    public void setup() {
        s3 = AmazonS3ClientBuilder.defaultClient();
    }

    @Test
    public void test_getBuckets() {
        for (Bucket b : s3.listBuckets()) {
            System.out.println(b.getName());
        }
    }

    @Test
    public void test_addPrefixRules() {
        String bucketName = "test-bucket";
        BucketLifecycleConfiguration.Rule rule = new BucketLifecycleConfiguration.Rule()
                .withId("new-lifecycle-id")
                .withExpirationInDays(1)
                .withFilter(new LifecycleFilter(new LifecyclePrefixPredicate("remote/")));
        List<BucketLifecycleConfiguration.Rule> bucketLifecycleConfigurationRules =
                s3.getBucketLifecycleConfiguration(bucketName).getRules();
        bucketLifecycleConfigurationRules.add(rule.withStatus(BucketLifecycleConfiguration.ENABLED));
        BucketLifecycleConfiguration updatedBucketLifecycleConfiguration =
                new BucketLifecycleConfiguration().withRules(bucketLifecycleConfigurationRules);
        s3.setBucketLifecycleConfiguration(bucketName, updatedBucketLifecycleConfiguration);
    }
}

我的测试 test_addPrefixRules 尝试获取为存储桶定义的所有生命周期配置规则,为前缀对象添加我的新规则,并使用新规则集更新存储桶。

当我运行它时,我遇到了以下异常:

 com.amazonaws.services.s3.model.AmazonS3Exception: Filter element can only be used in Lifecycle V2. (Service: Amazon S3; Status Code: 400; Error Code: InvalidRequest; Request ID: 6E24BE84B13B6440; S3 Extended Request ID: Y5VyIEuXcbGVBoddgdT7TVVa670dU6V1v5Oizlq/UU2pSDNjiAxyzrc155uf0MTfZxPw1GyUvGM=)
, S3 Extended Request ID: Y5VyIEuXcbGVBoddgdT7TVVa670dU6V1v5Oizlq/UU2pSDNjiAxyzrc155uf0MTfZxPw1GyUvGM=
    at com.amazonaws.http.AmazonHttpClient$RequestExecutor.handleErrorResponse(AmazonHttpClient.java:1639)
    at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeOneRequest(AmazonHttpClient.java:1304)
    at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeHelper(AmazonHttpClient.java:1056)
    at com.amazonaws.http.AmazonHttpClient$RequestExecutor.doExecute(AmazonHttpClient.java:743)
    at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeWithTimer(AmazonHttpClient.java:717)
    at com.amazonaws.http.AmazonHttpClient$RequestExecutor.execute(AmazonHttpClient.java:699)
    at com.amazonaws.http.AmazonHttpClient$RequestExecutor.access$500(AmazonHttpClient.java:667)
    at com.amazonaws.http.AmazonHttpClient$RequestExecutionBuilderImpl.execute(AmazonHttpClient.java:649)
    at com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:513)
    at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:4325)
    at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:4272)
    at com.amazonaws.services.s3.AmazonS3Client.setBucketLifecycleConfiguration(AmazonS3Client.java:2326)
    at com.amazonaws.services.s3.AmazonS3Client.setBucketLifecycleConfiguration(AmazonS3Client.java:2293)
    at com.appdynamics.eum.aws.s3.S3ClientTest.test_addPrefixRules(S3ClientTest.java:53)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:498)
    at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
    at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
    at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
    at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
    at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
    at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
    at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
    at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
    at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
    at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
    at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
    at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
    at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
    at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
    at org.junit.runner.JUnitCore.run(JUnitCore.java:160)
    at com.intellij.junit4.JUnit4IdeaTestRunner.startRunnerWithArgs(JUnit4IdeaTestRunner.java:68)
    at com.intellij.rt.execution.junit.IdeaTestRunner$Repeater.startRunnerWithArgs(IdeaTestRunner.java:47)
    at com.intellij.rt.execution.junit.JUnitStarter.prepareStreamsAndStart(JUnitStarter.java:242)
    at com.intellij.rt.execution.junit.JUnitStarter.main(JUnitStarter.java:70)

我在论坛中发现可以解释此错误的文档和讨论很少。有人可以帮助我了解我在这里可能做错了什么吗?

【问题讨论】:

  • 它告诉你在错误的生命周期中使用了过滤器。
  • @lajos-arpad 是的。你能详细说明一下吗?我应该什么时候使用它?
  • "过滤元素只能在 Lifecycle V2 中使用。" (不管那是什么意思)
  • 是的。这意味着什么是我正在努力寻找的。​​span>

标签: amazon-web-services amazon-s3


【解决方案1】:

如果您在单个生命周期策略中同时具有 PrefixFilter 基本标记,则会引发此异常。这些标签不能组合在一个策略中。您现有的策略可能已经有一些 Prefix 基本标签,因此当您尝试使用 Filter 基本标签添加新规则时会引发错误。

一种可能的解决方法是用Filter 标签包装Prefix 基本标签。

参考:https://forums.aws.amazon.com/message.jspa?messageID=812878

【讨论】:

    猜你喜欢
    • 1970-01-01
    • 2014-07-18
    • 1970-01-01
    • 2019-06-19
    • 1970-01-01
    • 2020-12-17
    • 2020-04-12
    • 2022-01-02
    • 1970-01-01
    相关资源
    最近更新 更多