Skip to content

Issues: IBM/unitxt

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

85 Open 108 Closed
85 Open 108 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

get_from_catalog does not return a fresh copy of the catalog object
#1364 opened Nov 18, 2024 by yoavkatz
4
Simple API to run load and evaluate datasets based on tasks and input data
#1327 opened Nov 4, 2024 by yoavkatz
@gitMichal @elronbandel @yoavkatz
4
Fix LLMAsJudge validation with OpenAIInferenceEngine
#1293 opened Oct 16, 2024 by lilacheden
Allow dynamically created tasks in llm_as_judge
#1292 opened Oct 16, 2024 by lilacheden
Simplify rag-eval templates and tasks preparation
#1291 opened Oct 16, 2024 by lilacheden
@lilacheden
No documentation for inference engines
#1235 opened Sep 25, 2024 by elronbandel
Demo pool is returned as a stream and goes through demo verbalization.
#1210 opened Sep 10, 2024 by yoavkatz
@elronbandel
Align Bold and Attaq card with a documented catalog task
#1165 opened Aug 18, 2024 by elronbandel
HFSystemFormat Exception
#1144 opened Aug 13, 2024 by allyssonf
Checking types of initialization values passed to artifacts
#1133 opened Aug 12, 2024 by yoavkatz
@elronbandel
Remove all if __name__ == "__main__": from prepare/*
#1132 opened Aug 11, 2024 by elronbandel
Create OptionSelectingInferenceEngine
#1128 opened Aug 9, 2024 by elronbandel
Create a documentation page comparing unitxt and other related platforms
#1127 opened Aug 8, 2024 by elronbandel
Create Rename and deprecate RenameFields
#1125 opened Aug 8, 2024 by yoavkatz
@elronbandel
Remove StandardRecipe from main examples in documentation
#1108 opened Aug 4, 2024 by yoavkatz
@elronbandel
Add a reduced version of ClapNQ
#1051 opened Jul 23, 2024 by benjaminsznajder
@benjaminsznajder
Catalog preparation takes over 30 minutes which is too long bug Something isn't working
#1042 opened Jul 22, 2024 by yoavkatz
1
consolidate the 2 "data_classification_policy" fields in the recipe
#1040 opened Jul 22, 2024 by OfirArviv
Allow selection of demonstrations in ICL based on similarity to current instance
#1028 opened Jul 18, 2024 by yoavkatz
@yoavkatz
Issue with Backward Compatibility in Version Updates
#999 opened Jul 7, 2024 by eliyahabba
1
MMLU Template Instruction Inconsistency
#990 opened Jul 3, 2024 by RonaldBXu
1
Better support for chat format
#989 opened Jul 3, 2024 by yoavkatz
Add speed ups guide
#986 opened Jul 2, 2024 by elronbandel
1
Make model based metrics rely on InferenceEngine
#985 opened Jul 2, 2024 by elronbandel
3 tasks
Operators in card loader (and in general) can delete and modify metadata field Unitxt rely on.
#967 opened Jun 30, 2024 by OfirArviv
ProTip! Exclude everything labeled bug with -label:bug.