Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

openai compatible worker #314

Open
wants to merge 14 commits into
base: main
Choose a base branch
from
Open

openai compatible worker #314

wants to merge 14 commits into from

Conversation

benxu3
Copy link
Contributor

@benxu3 benxu3 commented Dec 9, 2024

updates worker.py to be openai-endpoint compatible and use VoceAssistantPipeline

  • manages chat context
  • sends flag to communicate agent state to client
  • receives flags from client to clear chat context
  • supports image requests using livekit video stream

updates default.py and fast.py profiles to be compatible with new interpreter
updates server.py to be use new interpreter

  • changes are made to the docs to reflect these updates

benxu3 and others added 14 commits November 25, 2024 20:10
@benxu3
LiveKit Pipeline Agent (#4)
1720b78 
* init processors

* fix image append for chat messages

* add pre tts cb

* stash non-functional worker changes

* add complete flag parsing worker

* stash worker changes

* update worker.py to handle message context correctly

* draft worker -- currently mismanages chat ctx

* stash draft delta changes

* working worker on push to talk happy path

* final working worker on push to talk

* refactor append image

* updated video frame processing

* rm text processor

* working draft main

* draft working poetry
@benxu3
add token in qr
de2a7cb
@benxu3
fix dependency issues
76f0847
@benxu3
Merge branch 'main' of https://github.com/benxu3/01
37198d8
@benxu3
update livekit server and profile docs
2f53be0
@benxu3
send multimodal message on startup of multimodal agent
f6c13a1
@benxu3
add voice assistant state communication and clear chat context
07672f4
@benxu3
update logging with debug env variable
178ffc8
@benxu3
update profiles to be compatible with new interpreter
c2de04a
@benxu3
update server to use new interpreter
bba33db
@benxu3
upgrade interpreter and livekit agents
ba2813d
@benxu3
use participant token in meet_url
cedda96
@benxu3
remove assistant fnc
8f6d5fd
@benxu3
remove duplicate fnc_ctx declaration
4e77a57
@benxu3 benxu3 marked this pull request as ready for review December 10, 2024 00:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@benxu3