Skip to content

Pull requests: evaleval/every_eval_ever

New pull request New
14 Open 121 Closed
14 Open 121 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Add BenchPress score-matrix adapter (utils/benchpress)
#197 opened Jun 30, 2026 by borgr Collaborator Loading…
Move validator business logic into every_eval_ever and update to de-duplication logic
#194 opened Jun 29, 2026 by nelaturuharsha Collaborator Loading…
16
[Submission] Add tau-bench leaderboard adapter
#192 opened Jun 22, 2026 by benshi34 Loading…
6
[DRAFT] feat: add generalized Kaggle Community Benchmarks adapter
#191 opened Jun 21, 2026 by mrshu Contributor • Draft
[Adapter] Add AlpacaEval 1.0 and 2.0 leaderboard adapter
#190 opened Jun 20, 2026 by karthikchundi-commits Contributor Loading…
Add BountyBench converter to utils
#188 opened Jun 15, 2026 by borgr Collaborator Loading…
@nelaturuharsha
1
arc_agi adapter for flat storage with manifest and instance_level indexes for hf
#184 opened Jun 11, 2026 by DeepLumiere Loading…
@nelaturuharsha
Add LEXam public leaderboard converter
#160 opened Jun 8, 2026 by JoelNiklaus Loading…
3
Add Vectara Hallucination Leaderboard adapter
#157 opened Jun 3, 2026 by mohammadrezakarami Loading…
[Feature] Add text-to-image modality support stale
#137 opened May 18, 2026 by felifri Loading…
5 tasks done
10
Fix LLM Stats evaluator provenance schema
#136 opened May 16, 2026 by tommasocerruti Member Loading…
1
[DRAFT] Transparent Compression
#133 opened May 8, 2026 by Erotemic Collaborator Loading…
Canonical identity and schema upgrade tooling
#116 opened Apr 24, 2026 by yananlong Contributor Loading…
19
Draft Proposal: Agent Session Result Layer stale
#70 opened Mar 17, 2026 by elronbandel Contributor • Draft
1
ProTip! Follow long discussions with comments:>50.