Skip to content

Pull requests: huggingface/lighteval

New pull request New
23 Open 300 Closed
23 Open 300 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Fix math extraction
#503 opened Jan 17, 2025 by hynky1999 Loading…
Fix TGI (Text Generation Inference) Endpoint Inference and TGI JSON Grammar Generation
#502 opened Jan 15, 2025 by cpcdoy Loading…
1
Improve readability of the quick tour.
#501 opened Jan 14, 2025 by vxw3t8fhjsdkghvbdifuk Loading…
6
llm_as_a_judge_for_oallv2_arabic
#498 opened Jan 13, 2025 by Manel-Hik Loading…
Initial proposal for model lazy loading
#497 opened Jan 11, 2025 by JoelNiklaus • Draft
Fixed issue with o1 in litellm.
#493 opened Jan 10, 2025 by JoelNiklaus Loading…
4
Made judge response processing more robust.
#491 opened Jan 7, 2025 by JoelNiklaus Loading…
Hotfix for litellm judge
#490 opened Jan 7, 2025 by JoelNiklaus Loading…
5
Implemented the possibility to load predictions from details files and continue evaluating from there
#488 opened Jan 7, 2025 by JoelNiklaus Loading…
1
3
Added diskcache to base model.
#480 opened Dec 30, 2024 by JoelNiklaus Loading…
8
feat: add asian language support to CorpusLevelTranslationMetric
#479 opened Dec 27, 2024 by ryan-minato Loading…
4
Align code with error message and raise timeout after 30 min
#477 opened Dec 27, 2024 by albertvillanova Loading…
9
Fix attribute and parameter names in loggers
#476 opened Dec 26, 2024 by albertvillanova Loading…
2
Config fixes for VLLMModel
#472 opened Dec 20, 2024 by anton-l Loading…
7
feat: add JGLUE tasks
#469 opened Dec 19, 2024 by ryan-minato Loading…
9
Add Doc Strings to Config Files
#465 opened Dec 19, 2024 by ParagEkbote Loading…
1
33
Support custom results/details push to hub
#457 opened Dec 18, 2024 by albertvillanova Loading…
1 task
7
Use config dict in TaskConfigLogger for easier serialization
#454 opened Dec 18, 2024 by albertvillanova Loading…
8
Support custom results/details path
#451 opened Dec 16, 2024 by albertvillanova • Draft
1 task
7
Added custom model inference.
#437 opened Dec 11, 2024 by JoelNiklaus Loading…
1
14
Added cache for openai models.
#435 opened Dec 11, 2024 by JoelNiklaus Loading…
1
5
Add swiss legal evals as new community tasks
#389 opened Nov 11, 2024 by JoelNiklaus Loading…
36
Adding chat completion task to endpoint models
#281 opened Aug 27, 2024 by sadra-barikbin Loading…
9
ProTip! Add no:assignee to see everything that’s not assigned.