Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Question: how to send extract the command message in a stream chat model #305

Open
BeamLiu opened this issue Nov 22, 2024 · 2 comments
Open
Assignees
Labels
advice Information how to use/implement the component

Comments

@BeamLiu
Copy link

BeamLiu commented Nov 22, 2024

hi there, it is a great component, it works fine with my product.

I have a usecase:
The end user chat through the stream chat, I want the LLM to response the tool function call first, to drive the UI action, such as openCurrentDocument command, I will response the command in my vue3 fronend, but how to deliver the command json to my frontend? After that, the LLM will response "the document is opened" .

I have no idea how to simply use deep-chat to archive that (this is my prior choice), otherwise I need but another websocket channel by myself?

@BeamLiu BeamLiu changed the title how to send extract the command message in a stream chat model Question: how to send extract the command message in a stream chat model Nov 22, 2024
@OvidijusParsiunas
Copy link
Owner

Hey @BeamLiu.
Forgive me but I don't seem to understand your use-case. Could you perhaps elaborate a little more with examples on what it is you are trying to achieve. Thanks!

@OvidijusParsiunas OvidijusParsiunas self-assigned this Nov 28, 2024
@OvidijusParsiunas OvidijusParsiunas added the advice Information how to use/implement the component label Nov 28, 2024
@BeamLiu
Copy link
Author

BeamLiu commented Dec 6, 2024

My fault, I think it is may not be a correct usage for SSE in my case, I used another webscoket to communite with server. The usecase is simple, I wrapped UI action as LLM tool together with the server side functions. But the UI action need to be sent as commands from server side to client to execute through SSE.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
advice Information how to use/implement the component
Projects
None yet
Development

No branches or pull requests

2 participants