S3Control Batch Operation - S3PutObjectTagging Request Invalid

[be-rock]

Hi,

When trying to run a S3Control Batch create_job 'S3PutObjectTagging' Operation, I am getting an error message:

botocore.exceptions.ClientError: An error occurred (InvalidRequest) when calling the CreateJob operation: Request invalid

Does anyone have tips on how to troubleshoot this generic error message? I have enabled DEBUG-level logging but not yet able to determine the cause. I have also created a job successfully (using the same IAM role) in the console and compared the created job spec using describe_job and it is still unclear as to what the problem is.

The job spec is as follows:

response = client.create_job(
    AccountId=str(job_spec.account_number), # 123456789012
    ConfirmationRequired=False,
    Operation={
        "S3PutObjectTagging": {  # Directs the specified job to run a PUT Object tagging call on every object in the manifest.
            "TagSet": [
                {"Key": "confirm-object-permanent-delete", "Value": "true"},
            ]
        },
    },
    Report={
        "Bucket": job_spec.bucket_name,   # test-s3batch-1234567890
        "Format": job_spec.report_format, # Report_CSV_20180820
        "Enabled": True,
        # 'Prefix': 's3_batch_operation_report', # optional
        "ReportScope": "AllTasks",
    },
    # ClientRequestToken='string', # This field is autopopulated if not provided.
    Manifest={
        "Spec": {
            "Format": "S3BatchOperations_CSV_20180820",
            "Fields": [
                "Bucket",
                "Key",
            ],
        },
        "Location": {
            "ObjectArn": job_spec.s3_manifest_file_arn, # e.g. "arn:aws:s3:::my-unique-s3-bucket-qjdidqkaodgj/test_files/manifest.csv"
            'ETag': job_spec.manifest_file_etag # e.g. aHashedEtagValue
        },
    },
    Description="our cool s3 batch operation",
    Priority=10,
    RoleArn=job_spec.iam_role_arn, # e.g. arn:aws:iam::123456789012:role/MyFullControlRole
)

[be-rock]

It appears that the Report.Bucket key requires an ARN instead of a bucket name. I see this in the docs here but was initially overlooked.

Can we update the key name to Report.BucketArn similar to Manifest.Location.ObjectArn to make this more clear?

[aaoswal]

Hi @be-rock,
I apologize but the key name is Report.Bucket to have consistency across all the S3 commands and hence would not be updated to Report.BucketArn.

Hope this helps!