Skip to content
Navigation Menu
Sign in
Appearance settings
Platform
AI CODE CREATION
GitHub Copilot
Write better code with AI
GitHub Copilot app
Direct agents from issue to merge
MCP Registry
Integrate external tools
DEVELOPER WORKFLOWS
Actions
Automate any workflow
Codespaces
Instant dev environments
Issues
Plan and track work
Code Review
Manage code changes
Code Quality
Enforce quality at merge
APPLICATION SECURITY
GitHub Advanced Security
Find and fix vulnerabilities
Code security
Secure your code as you build
Secret protection
Stop leaks before they start
EXPLORE
Why GitHub
Documentation
Blog
Changelog
Marketplace
View all features
Solutions
BY COMPANY SIZE
Enterprises
Small and medium teams
Startups
Nonprofits
BY USE CASE
App Modernization
DevSecOps
DevOps
CI/CD
View all use cases
BY INDUSTRY
Healthcare
Financial services
Manufacturing
Government
View all industries
View all solutions
Resources
EXPLORE BY TOPIC
AI
Software Development
DevOps
Security
View all topics
EXPLORE BY TYPE
Customer stories
Events & webinars
Ebooks & reports
Business insights
GitHub Skills
SUPPORT & SERVICES
Documentation
Customer support
Community forum
Trust center
Partners
View all resources
Open Source
COMMUNITY
GitHub Sponsors
Fund open source developers
PROGRAMS
Security Lab
Maintainer Community
GitHub Stars
Archive Program
REPOSITORIES
Topics
Trending
Collections
Enterprise
ENTERPRISE SOLUTIONS
Enterprise platform
AI-powered developer platform
AVAILABLE ADD-ONS
GitHub Advanced Security
Enterprise-grade security features
Copilot for Business
Enterprise-grade AI features
Premium Support
Enterprise-grade 24/7 support
Pricing
Search
/
Sign in
Sign up
Appearance settings
You signed in with another tab or window.
Reload
to refresh your session.
You signed out in another tab or window.
Reload
to refresh your session.
You switched accounts on another tab or window.
Reload
to refresh your session.
Dismiss alert
{{ message }}
openai
/
frontier-evals
Public
Notifications
You must be signed in to change notification settings
Fork
179
Star
1.3k
Code
Issues
24
Pull requests
47
Actions
Projects
Security and quality
0
Insights
Additional navigation options
Code
Issues
Pull requests
Actions
Projects
Security and quality
Insights
Commits
Breadcrumbs
History for
frontier-evals
project
on
main
User selector
All users
Datepicker
All time
Commit history
Commits on Apr 8, 2026
[evmbench] Add EVMBench maintenance note (#110)
justinlinw
authored
8ea5c65
View commit details
Copy full SHA for 8ea5c65
View code at this point
Browse repository at this point
Commits on Mar 4, 2026
[evmbench] update Tempo tasks (#105)
justinwang-oai
authored
20ba718
View commit details
Copy full SHA for 20ba718
View code at this point
Browse repository at this point
Commits on Feb 18, 2026
[evmbench] initial release (#101)
justinwang-oai
authored
e4d27fe
View commit details
Copy full SHA for e4d27fe
View code at this point
Browse repository at this point
Commits on Dec 6, 2025
[pb] slimmer CI (#97)
thesofakillers
authored
e8aa3d9
View commit details
Copy full SHA for e8aa3d9
View code at this point
Browse repository at this point
Commits on Dec 2, 2025
[alctz/swelancer] Minor fixes following up the stricter alctz NetworkMode.NONE (#96)
thesofakillers
authored
5305e93
View commit details
Copy full SHA for 5305e93
View code at this point
Browse repository at this point
[alctz] Stricter operation of NetworkMode.NONE and sync from upstream (#95)
thesofakillers
authored
6431818
View commit details
Copy full SHA for 6431818
View code at this point
Browse repository at this point
Commits on Dec 1, 2025
[PB] Minor cleanup (#94)
thesofakillers
authored
f0c12fb
View commit details
Copy full SHA for f0c12fb
View code at this point
Browse repository at this point
[PB] Support Generic Computer Interface (#93)
thesofakillers
authored
47b94f3
View commit details
Copy full SHA for 47b94f3
View code at this point
Browse repository at this point
[PB] Use chz for configuring Monitor and Judge scripts (#92)
thesofakillers
authored
f47a276
View commit details
Copy full SHA for f47a276
View code at this point
Browse repository at this point
[PB] cleanup small TODOs (#91)
thesofakillers
authored
785c7e8
View commit details
Copy full SHA for 785c7e8
View code at this point
Browse repository at this point
[PB] Remove stale files (#90)
thesofakillers
authored
a4c9ec3
View commit details
Copy full SHA for a4c9ec3
View code at this point
Browse repository at this point
Commits on Nov 28, 2025
[PB] Add BasicAgent solver (#89)
thesofakillers
authored
066fa38
View commit details
Copy full SHA for 066fa38
View code at this point
Browse repository at this point
[TurnCompleter] pin openai version in turn completer (#88)
thesofakillers
authored
ed56310
View commit details
Copy full SHA for ed56310
View code at this point
Browse repository at this point
[Alctz] Various updates to alcatraz comp interface (#87)
thesofakillers
authored
26715cb
View commit details
Copy full SHA for 26715cb
View code at this point
Browse repository at this point
Commits on Nov 25, 2025
[PB] Small patch to LFS instructions (#86)
thesofakillers
authored
9b89ef5
View commit details
Copy full SHA for 9b89ef5
View code at this point
Browse repository at this point
Commits on Oct 31, 2025
[PB] Enabling installing without `UV_GIT_LFS=1` (#84)
thesofakillers
authored
8c95675
View commit details
Copy full SHA for 8c95675
View code at this point
Browse repository at this point
Commits on Oct 28, 2025
[PB] Packaging fixes to various lib to enable non-editable installing (#82)
stalkermustang
authored
7acfcc7
View commit details
Copy full SHA for 7acfcc7
View code at this point
Browse repository at this point
Commits on Oct 21, 2025
[PB] Add retries to alcatraz computer start (#81)
thesofakillers
authored
650e03a
View commit details
Copy full SHA for 650e03a
View code at this point
Browse repository at this point
Commits on Sep 24, 2025
[common] fix ruff config path in pre-commit setup (#76)
simonpfish
authored
7586f37
View commit details
Copy full SHA for 7586f37
View code at this point
Browse repository at this point
[common] move ruff config to shared tooling and update pre-commit (#75)
simonpfish
authored
e20dbd1
View commit details
Copy full SHA for e20dbd1
View code at this point
Browse repository at this point
[common][paperbench][swelancer] move libs to common and update paths (#74)
simonpfish
authored
5df4c00
View commit details
Copy full SHA for 5df4c00
View code at this point
Browse repository at this point
Commits on Aug 28, 2025
[PB] dont pass around boundloggers; instantiate when needed (#70)
thesofakillers
authored
2ab508c
View commit details
Copy full SHA for 2ab508c
View code at this point
Browse repository at this point
[swel] Remove RunnerArgs instance and update readme/tests (#69)
thesofakillers
authored
8bc401e
View commit details
Copy full SHA for 8bc401e
View code at this point
Browse repository at this point
Commits on Aug 26, 2025
[SWEL] minor fix necessary for monolith image (#68)
thesofakillers
authored
d3f8425
View commit details
Copy full SHA for d3f8425
View code at this point
Browse repository at this point
[SWEL] Update readme (#67)
Show description for e78d66d
thesofakillers
and
ryanka-openai
authored
e78d66d
View commit details
Copy full SHA for e78d66d
View code at this point
Browse repository at this point
Commits on Aug 15, 2025
[TurnCompleter] updates to turn completer (#63)
thesofakillers
authored
3a7dbcc
View commit details
Copy full SHA for 3a7dbcc
View code at this point
Browse repository at this point
hot patches to disable internt alctz functionality (#64)
Show description for 687898f
thesofakillers
and
ryanka-openai
authored
687898f
View commit details
Copy full SHA for 687898f
View code at this point
Browse repository at this point
Commits on Aug 14, 2025
modified disable internet function, allows for container specific blockers (#62)
Show description for 1291ba6
ryanka-openai
authored
1291ba6
View commit details
Copy full SHA for 1291ba6
View code at this point
Browse repository at this point
Commits on Jul 31, 2025
Fix swelancer readme to use correct image build example (#59)
ryanka-openai
authored
5552c75
View commit details
Copy full SHA for 5552c75
View code at this point
Browse repository at this point
Commits on Jul 29, 2025
[swel] fix 42153-manager-0 being broken over two lines (#58)
thesofakillers
authored
9c978dc
View commit details
Copy full SHA for 9c978dc
View code at this point
Browse repository at this point
Commits on Jul 28, 2025
manager tasks fixes and cleanup (#57)
Show description for ada4fb3
ryanka-openai
authored
ada4fb3
View commit details
Copy full SHA for ada4fb3
View code at this point
Browse repository at this point
Commits on Jul 21, 2025
[TurnCompleter] Responses API TurnCompleter (#55)
thesofakillers
authored
e4fe613
View commit details
Copy full SHA for e4fe613
View code at this point
Browse repository at this point
Commits on Jul 18, 2025
[TurnCompleter] Add ruff+mypy to minimono_turn_completer, fix typing (#54)
thesofakillers
authored
d06ab64
View commit details
Copy full SHA for d06ab64
View code at this point
Browse repository at this point
[PB] Direct submission solver (#52)
thesofakillers
authored
5a34f2d
View commit details
Copy full SHA for 5a34f2d
View code at this point
Browse repository at this point
[PB] Fix reproduce.sh salvaging logic (#51)
thesofakillers
authored
fb095f6
View commit details
Copy full SHA for fb095f6
View code at this point
Browse repository at this point
Previous
Next
You can’t perform that action at this time.
