Claude 3.5 V2 Sonnet doesn't support file attachments on the API, works in playground

[bdavj]

Describe the bug

Using a 2.5mb PDF, and a 300kb image, same result with both.

On the playground, both upload OK and can converse effectively around the documents.

On the API, I get the following response:

botocore.exceptions.EventStreamError: An error occurred (validationException) when calling the ConverseStream operation: The model returned the following errors: Input is too long for requested model.

This is using ChatBedrock, and the message section formatted as either:
{"image": {"format": get_file_format(file_obj), "source": {"base64": base64.b64encode(binary_data).decode('utf-8')}}} or

{
                            "document": {
                                "name": sanitize_filename(file_obj.name),
                                "format": get_file_format(file_obj),
                                "source": {
                                    "base64": base64.b64encode(binary_data).decode('utf-8')
                                },
                            }
                        }

This has also been tried using the raw binary data as bytes in the source.

Regression Issue

• Select this option if this issue appears to be a regression.

Expected Behavior

To be able to converse as per the playground on enclosing an image / document

Current Behavior

botocore.exceptions.EventStreamError: An error occurred (validationException) when calling the ConverseStream operation: The model returned the following errors: Input is too long for requested model.

Reproduction Steps

Possible Solution

No response

Additional Information/Context

No response

SDK version used

1.35.57

Environment details (OS name and version, etc.)

Mac OS Sonoma, Python 3.12.5

[tim-finnigan]

Thanks for reaching out. Here is the converse_stream documentation for reference. The command is calling the Bedrock ConverseStream API, and it looks like the issue here is with the API validation. I'm not sure why the behavior isn't consistent with the console.

Can you provide a complete code snippet for reproducing the issue? You mentioned using ChatBedrock, so I'm also wondering if the issue could be with the third-party integration. If you want to share debug logs as well (with any sensitive info redacted) by adding boto3.set_stream_logger('') to your script then that could also help provide more insight here.

[github-actions]

Greetings! It looks like this issue hasn’t been active in longer than five days. We encourage you to check if this is still an issue in the latest release. In the absence of more information, we will be closing this issue soon. If you find that this is still a problem, please feel free to provide a comment or upvote with a reaction on the initial post to prevent automatic closure. If the issue is already closed, please feel free to open a new one.