Skip to content

Commit

Permalink
Update bedrock documentation
Browse files Browse the repository at this point in the history
  • Loading branch information
marklysze authored Dec 16, 2024
1 parent 6d98ea8 commit 5a28894
Showing 1 changed file with 15 additions and 6 deletions.
21 changes: 15 additions & 6 deletions website/docs/topics/non-openai-models/cloud-bedrock.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -10,26 +10,26 @@
"source": [
"# Amazon Bedrock\n",
"\n",
"AutoGen allows you to use Amazon's generative AI Bedrock service to run inference with a number of open-weight models and as well as their own models.\n",
"AG2 allows you to use Amazon's generative AI Bedrock service to run inference with a number of open-weight models and as well as their own models.\n",
"\n",
"Amazon Bedrock supports models from providers such as Meta, Anthropic, Cohere, and Mistral.\n",
"\n",
"In this notebook, we demonstrate how to use Anthropic's Sonnet model for AgentChat in AutoGen.\n",
"In this notebook, we demonstrate how to use Anthropic's Sonnet model for AgentChat in AG2.\n",
"\n",
"## Model features / support\n",
"\n",
"Amazon Bedrock supports a wide range of models, not only for text generation but also for image classification and generation. Not all features are supported by AutoGen or by the Converse API used. Please see [Amazon's documentation](https://docs.aws.amazon.com/bedrock/latest/userguide/conversation-inference.html#conversation-inference-supported-models-features) on the features supported by the Converse API.\n",
"Amazon Bedrock supports a wide range of models, not only for text generation but also for image classification and generation. Not all features are supported by AG2 or by the Converse API used. Please see [Amazon's documentation](https://docs.aws.amazon.com/bedrock/latest/userguide/conversation-inference.html#conversation-inference-supported-models-features) on the features supported by the Converse API.\n",
"\n",
"At this point in time AutoGen supports text generation and image classification (passing images to the LLM).\n",
"At this point in time AG2 supports text generation and image classification (passing images to the LLM).\n",
"\n",
"It does not, yet, support image generation ([contribute](https://microsoft.github.io/autogen/docs/contributor-guide/contributing/)).\n",
"\n",
"## Requirements\n",
"To use Amazon Bedrock with AutoGen, first you need to install the `pyautogen[bedrock]` package.\n",
"To use Amazon Bedrock with AG2, first you need to install the `ag2[bedrock]` package.\n",
"\n",
"## Pricing\n",
"\n",
"When we combine the number of models supported and costs being on a per-region basis, it's not feasible to maintain the costs for each model+region combination within the AutoGen implementation. Therefore, it's recommended that you add the following to your config with cost per 1,000 input and output tokens, respectively:\n",
"When we combine the number of models supported and costs being on a per-region basis, it's not feasible to maintain the costs for each model+region combination within the AG2 implementation. Therefore, it's recommended that you add the following to your config with cost per 1,000 input and output tokens, respectively:\n",
"```\n",
"{\n",
" ...\n",
Expand Down Expand Up @@ -125,6 +125,15 @@
"```"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"## Using within an AWS Lambda function\n",
"\n",
"If you are using your AG2 code within an AWS Lambda function, you can utilise the attached role to access the Bedrock service and do not need to provide access, token, or profile values."
]
},
{
"cell_type": "markdown",
"metadata": {},
Expand Down

0 comments on commit 5a28894

Please sign in to comment.