Using open source llms with agency swarm

[hamidg20032]

is it possible to use open source llms with agency swarm through ollama, if not can you please implement this feature

[Tedfulk]

Idk, it seems open source models don't have the capability to do function calling. I think we gotta wait the models get better. Gpt-4 still king.

[hamidg20032]

was hoping at least adding the base_url function to agency swarm so we have the chance to try to use open source llms by putting a local url (like llm studio or janAI)

[cbruyndoncx]

There is an OpenOpenAI github repo to host the OpenAI assistants API, so as far as i can tell, locally hosting is feasible if you put in the work.