-
Notifications
You must be signed in to change notification settings - Fork 0
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Import Utility for Evaluations #7
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks, I added a few more suggestions to make the LLM definition more complete. So is the remaining work to add a JSON utility to upload the models, prompts, and responses in a combined JSON file?
Co-authored-by: Patrick Deziel <[email protected]> Signed-off-by: Benjamin Bengfort <[email protected]>
Yes, I'm working on that uploader right now. |
@pdeziel I added those fields to the models and also added validation fields for the prompt and responses. |
Suspect IssuesThis pull request was deployed and Sentry observed the following issues:
Did you find this useful? React with a 👍 or 👎 |
Scope of changes
Updates the models with fields recommended by @pdeziel and creates an import utility to load the data.
Type of change
Acceptance criteria
Can we start uploading data into the app after this PR is merged and the app is deployed?
Author checklist
Reviewer(s) checklist