Sending a PutObject request with checksum fails if LogMode is set to LogRequestWithBody

[dayaffe]

Describe the bug

Request succeeds with LogMode is set to LogRequest but fails when it is set to LogRequestWithBody.

Expected behavior

Request should succeed as it does when LogMode is set to LogRequest.

Current behavior

Error is thrown: Exception in thread "main" aws.sdk.kotlin.services.s3.model.S3Exception: The request signature we calculated does not match the signature you provided. Check your key and signing method.

Steps to Reproduce

The following code fails:

fun main(): Unit = runBlocking {
    val client = S3Client.fromEnvironment {
        region = "us-west-2"
        logMode = LogMode.LogRequestWithBody
    }

    println(client.putObject {
        bucket = "dayaffe-testing"
        key = "my-metadata-key.txt"
        checksumAlgorithm = ChecksumAlgorithm.Crc32
        body = ByteStream.fromFile(File("non_sparse_file_small.dat"))
    })
}

Whereas the follow code succeeds:

fun main(): Unit = runBlocking {
    val client = S3Client.fromEnvironment {
        region = "us-west-2"
        logMode = LogMode.LogRequest
    }

    println(client.putObject {
        bucket = "dayaffe-testing"
        key = "my-metadata-key.txt"
        checksumAlgorithm = ChecksumAlgorithm.Crc32
        body = ByteStream.fromFile(File("non_sparse_file_small.dat"))
    })
}

Possible Solution

No response

Context

No response

AWS Kotlin SDK version used

Latest

Platform (JVM/JS/Native)

JVM

Operating System and version

Mac 14.2.1

[aajtodd]

I've been able to reproduce this. Interestingly it happens whether we request a flexible checksum or not. As long as we trigger chunked signing I'm seeing this.

Will work on a fix, thanks.

[lauzadis]

I think it might be caused by this code segment in dumpRequest which changes the type of the body to ByteArray (no longer an AwsChunkedSource/AwsChunkedByteReadChannel)

[github-actions]

⚠️COMMENT VISIBILITY WARNING⚠️

Comments on closed issues are hard for our team to see.
If you need more assistance, please either tag a team member or open a new issue that references this one.
If you wish to keep having a conversation with other community members under this issue feel free to do so.