-
Notifications
You must be signed in to change notification settings - Fork 121
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
dev model agnostic structured output #22
Conversation
Hey @ohdearquant you can check on the new issue #23, feel free to propose new changes. Thanks cc @marklysze |
@ohdearquant let's work out a plan here. I would encourage to start from smaller PRs. Thank you! |
ok, @qingyun-wu I can make smaller PRs in future. Above requires a lot of architecture changes, maybe not the right move. |
@qingyun-wu @marklysze @davorrunje thoughts on making message into objects? Why Object-Based Messages?
Implementation StrategyWe could pursue a hybrid approach that balances structure and flexibility. For example, for structured output content formatting (per @marklysze's recent point), adding a custom However, requiring specialized handling for every structured output can burden users. Not every output needs custom formatting, but conversation context benefits from flexible structure. One potential solution: maintain the Pydantic structure while adding optional uniform formatting capabilities alongside the |
Why are these changes needed?
Related issue number
See #23 and please feel free to discuss the feature in there and the code development in here.
Checks