S3 DeleteObjects errors on multi-region access point due to checksum headers

[winter-s]

Describe the bug

SDK 2.30.17 fails with an InvalidRequestException when trying to delete objects on an S3 multi-region access point.
The same code works with SDK 2.29.52

Regression Issue

• Select this option if this issue appears to be a regression.

Expected Behavior

The S3 DeleteObjects API should work as it did with SDK 2.29

Current Behavior

software.amazon.awssdk.services.s3.model.InvalidRequestException: x-amz-sdk-checksum-algorithm specified, but no corresponding x-amz-checksum-* or x-amz-trailer headers were found. (Service: S3, Status Code: 400, Request ID: 7FBWJHRPYNQXGZ4G, Extended Request ID: 7q8nLrvVN+p/hIB3gCe/KlIFComVGNdSVGkPPV+8mnpxuLWyF8vyITHt3qzAyVMwi29DLVInycQ=)

Reproduction Steps

      var s3Client = S3Client.builder()
          .region("eu-west-1);
          .build();
      var apArn = "arn:aws:s3::1234567890:accesspoint/abcdefg.mrap";

      var paginatedResponse = s3Client.listObjectsV2Paginator(ListObjectsV2Request.builder()
          .bucket(apArn)
          .prefix(path)
          .maxKeys(1000)
          .build());
      for (var aPage : paginatedResponse) {
        var objectIds = aPage.contents().stream()
            .map(s3Object -> ObjectIdentifier.builder()
            .key(s3Object.key())
            .build())
            .toList();
        if (objectIds.isEmpty()) {
          break;
        }
        s3Client.deleteObjects(DeleteObjectsRequest.builder()
            .bucket(apArn)
            .delete(Delete.builder()
                .objects(objectIds)
                .build())
            .build());
      }

Possible Solution

Downgrade to SDK 2.29

Additional Information/Context

No response

AWS Java SDK version used

2.30.17

JDK version used

21.0.5-11

Operating System and version

AWS ECS Fargate arm64 running a bellsoft/liberica-openjre-alpine-musl:21.0.5-11 container

[bhoradc]

Hello @winter-s,

Thank you for reporting the issue. I am able to reproduce the checksum error on SDK version 2.30.0 and above when trying to delete objects using Multi-Region Access Point as the bucket parameter.

public class Main {
    public static void main(String[] args) {
        
        var s3Client = S3Client.builder()
                .region(Region.US_EAST_1)
                .build();

        var apArn = "arn:aws:s3::****:accesspoint/***.mrap";
        var paginatedResponse = s3Client.listObjectsV2Paginator(ListObjectsV2Request.builder()
                .bucket(apArn)
                .maxKeys(1000)
                .build());

        for (var aPage : paginatedResponse) {
            var objectIds = aPage.contents().stream()
                    .map(s3Object -> ObjectIdentifier.builder()
                            .key(s3Object.key())
                            .build())
                    .collect(Collectors.toList());
            if (objectIds.isEmpty()) {
                break;
            }

            s3Client.deleteObjects(DeleteObjectsRequest.builder()
                    .bucket(apArn)
                    .delete(Delete.builder()
                            .objects(objectIds)
                            .build())
                    .build());
        }
    }
}

Looking into this further, we'll keep you posted.

Regards,
Chaitanya

[steveloughran]

Related to this?

#5801

[zoewangg]

We released a fix in 2.30.19. Please try with the latest version and let us know if you continue to see the issue.