Integrate OpenAI realtime API #281

sternakt · 2024-12-23T14:50:58Z

Why are these changes needed?

This PR will rewrite the internals of OpenAIRealtimeClient to use the official implementation of the client.

I've included any doc changes needed for https://docs.ag2.ai/. See https://docs.ag2.ai/docs/contributor-guide/documentation to build and test documentation locally.
I've added tests (if relevant) corresponding to the changes introduced in this PR.
I've made sure all auto checks have passed.

Integrate OpenAI realtime API

3437af4

sternakt requested a deployment to openai1 December 23, 2024 14:51 — with GitHub Actions Waiting

davorrunje self-assigned this Dec 23, 2024

Refactor client to use official OpenAIClient

a64a4f6

sternakt requested a deployment to openai1 December 24, 2024 08:33 — with GitHub Actions Waiting

sternakt requested a deployment to openai1 December 24, 2024 08:34 — with GitHub Actions Waiting

Fix realtime websocket notebook

10fa708

sternakt requested a deployment to openai1 December 24, 2024 09:53 — with GitHub Actions Waiting

sternakt marked this pull request as ready for review December 24, 2024 09:55

sonichi requested a review from davorinrusevljan December 26, 2024 17:21

davorrunje requested a deployment to openai1 December 30, 2024 17:26 — with GitHub Actions Waiting

davorrunje approved these changes Dec 30, 2024

View reviewed changes

fastapi added to test extra

4f22f00

davorrunje had a problem deploying to openai1 December 30, 2024 17:34 — with GitHub Actions Failure

davorrunje temporarily deployed to openai1 December 30, 2024 17:34 — with GitHub Actions Inactive

davorrunje had a problem deploying to openai1 December 30, 2024 17:34 — with GitHub Actions Error

davorrunje temporarily deployed to openai1 December 30, 2024 17:34 — with GitHub Actions Inactive

davorrunje had a problem deploying to openai1 December 30, 2024 17:34 — with GitHub Actions Error

OpenAI test fix in CI

029d6cb

davorrunje temporarily deployed to openai1 December 30, 2024 17:45 — with GitHub Actions Inactive

davorrunje had a problem deploying to openai1 December 30, 2024 17:45 — with GitHub Actions Failure

davorrunje temporarily deployed to openai1 December 30, 2024 17:45 — with GitHub Actions Inactive

davorrunje temporarily deployed to openai1 December 30, 2024 17:46 — with GitHub Actions Inactive

davorrunje approved these changes Dec 30, 2024

View reviewed changes

davorrunje enabled auto-merge December 30, 2024 17:53

davorrunje added this pull request to the merge queue Dec 30, 2024

Merged via the queue into main with commit c84000a Dec 30, 2024
214 of 215 checks passed