Watsonx + Granite 3.0 Multi Agent System with Crew AI

For this demo, all the dependencies can be installed within the notebook, and either the watsonx.ai or ollama can be used to provide LLM base model.

LLM Model with Ollama serve

Ollama Set up

Find the available versions to download at ollama.com.

LLM Model from watsonx.ai

Watsonx Set up

Please, refer to watsonx docs for instantiating and getting connection details. Note that also, a IAM key is needed to autenticate into the watsonx.ai APIs. Create your own API IAM key following the steps in here.

Links

• Granite tool calling
• Base Article
• Crew AI