Add UploadedBytes to UploadOutput in feature/s3/manager #1397
Labels
feature/s3/manager
Pertains to S3 transfer manager HLL (feature/s3/manager).
feature-request
A feature should be added or improved.
m
Effort estimation: medium
p3
This is a minor priority issue
Is your feature request related to a problem? Please describe.
I'm migrating a service from https://github.com/minio/minio-go to the V2 SDK and using the s3Manager to handle uploads (the service is essentially an HTTP proxy that sites in front S3 where clients can stream uploads). Since we're uploading using an
io.Reader
(from the http request body) we don't know the size of the content being uploaded. For auditing and monitoring purposes, it would be useful if theUploadOutput
struct returned this data.Describe the solution you'd like
A field is added to
UploadOutput
that shows the total upload size of contentDescribe alternatives you've considered
Currently, I'm working around the issue by using a custom Build middleware that's injected for each call to
Upload
that tracks the content-length for single and multi-part uploads (by inspecting thex-id
query parameter in thehttp.Request
).Long term, we've also considered event based solutions such as creating a Lambda to trigger via
s3:ObjectCreated:*
events from S3, or creating a DynamoDB stream (our content meta-data index) that preforms aHeadObject
call when an item is marked as uploaded.The text was updated successfully, but these errors were encountered: