Skip to content
Navigation Menu
Sign in
Appearance settings
Platform
AI CODE CREATION
GitHub Copilot
Write better code with AI
GitHub Copilot app
Direct agents from issue to merge
MCP Registry
Integrate external tools
DEVELOPER WORKFLOWS
Actions
Automate any workflow
Codespaces
Instant dev environments
Issues
Plan and track work
Code Review
Manage code changes
Code Quality
Enforce quality at merge
APPLICATION SECURITY
GitHub Advanced Security
Find and fix vulnerabilities
Code security
Secure your code as you build
Secret protection
Stop leaks before they start
EXPLORE
Why GitHub
Documentation
Blog
Changelog
Marketplace
View all features
Solutions
BY COMPANY SIZE
Enterprises
Small and medium teams
Startups
Nonprofits
BY USE CASE
App Modernization
DevSecOps
DevOps
CI/CD
View all use cases
BY INDUSTRY
Healthcare
Financial services
Manufacturing
Government
View all industries
View all solutions
Resources
EXPLORE BY TOPIC
AI
Software Development
DevOps
Security
View all topics
EXPLORE BY TYPE
Customer stories
Events & webinars
Ebooks & reports
Business insights
GitHub Skills
SUPPORT & SERVICES
Documentation
Customer support
Community forum
Trust center
Partners
View all resources
Open Source
COMMUNITY
GitHub Sponsors
Fund open source developers
PROGRAMS
Security Lab
Maintainer Community
GitHub Stars
Archive Program
REPOSITORIES
Topics
Trending
Collections
Enterprise
ENTERPRISE SOLUTIONS
Enterprise platform
AI-powered developer platform
AVAILABLE ADD-ONS
GitHub Advanced Security
Enterprise-grade security features
Copilot for Business
Enterprise-grade AI features
Premium Support
Enterprise-grade 24/7 support
Pricing
Search
/
Sign in
Sign up
Appearance settings
You signed in with another tab or window.
Reload
to refresh your session.
You signed out in another tab or window.
Reload
to refresh your session.
You switched accounts on another tab or window.
Reload
to refresh your session.
Dismiss alert
{{ message }}
braintrustdata
autoevals
Repository navigation
Code
Issues
11
(11)
Pull requests
34
(34)
Actions
Projects
Security and quality
Insights
More
items
Actions: braintrustdata/autoevals
Actions
All workflows
Workflows
publish
publish
Copilot
Copilot
Copilot code review
Copilot code review
Dependabot Updates
Dependabot Updates
Dependency Graph
Dependency Graph
Enforce pnpm
Enforce pnpm
js
js
lint
lint
python
python
Run pnpm evals
Run pnpm evals
Show more workflows...
Management
Caches
Deployments
python
python
Actions
Loading...
Loading
Sorry, something went wrong.
Uh oh!
There was an error while loading.
Please reload this page
.
will be ignored since log searching is not yet available
Show workflow options
Create status badge
Create status badge
Loading
Uh oh!
There was an error while loading.
Please reload this page
.
python.yaml
will be ignored since log searching is not yet available
280 workflow runs
280 workflow runs
Event
Filter by Event
Sorry, something went wrong.
Filter
Loading
Sorry, something went wrong.
No matching events.
Status
Filter by Status
Sorry, something went wrong.
Filter
Loading
Sorry, something went wrong.
No matching statuses.
Branch
Filter by Branch
Sorry, something went wrong.
Filter
Loading
Sorry, something went wrong.
No matching branches.
Actor
Filter by Actor
Sorry, something went wrong.
Filter
Loading
Sorry, something went wrong.
No matching users.
feat: add voice task success scorer
python
#769:
Pull request
#232
synchronize by
kevchoi
41s
kevchoi/20261002-voice-task-success-sdk
kevchoi/20261002-voice-task-success-sdk
41s
View #232
View workflow file
feat: add voice task success scorer
python
#768:
Pull request
#232
synchronize by
kevchoi
40s
kevchoi/20261002-voice-task-success-sdk
kevchoi/20261002-voice-task-success-sdk
40s
View #232
View workflow file
feat: add voice task success scorer
python
#767:
Pull request
#232
synchronize by
kevchoi
44s
kevchoi/20261002-voice-task-success-sdk
kevchoi/20261002-voice-task-success-sdk
44s
View #232
View workflow file
feat: add voice task success scorer
python
#766:
Pull request
#232
synchronize by
kevchoi
41s
kevchoi/20261002-voice-task-success-sdk
kevchoi/20261002-voice-task-success-sdk
41s
View #232
View workflow file
feat: add voice task success scorer
python
#765:
Pull request
#232
opened by
kevchoi
47s
kevchoi/20261002-voice-task-success-sdk
kevchoi/20261002-voice-task-success-sdk
47s
View #232
View workflow file
fix(ragas): score empty retrieval contexts as zero
python
#764:
Pull request
#231
opened by
SiluPanda
Action required
SiluPanda:fix/context-relevancy-empty-223
SiluPanda:fix/context-relevancy-empty-223
Action required
View #231
View workflow file
Use GPT-6 Luna as default scoring model (#230)
python
#763:
Commit
38228ee
pushed by
ankrgyl
46s
main
main
46s
View workflow file
Use GPT-6 Luna as default scoring model
python
#762:
Pull request
#230
synchronize by
ankrgyl
47s
ankur/default-scorer-gpt-6-luna
ankur/default-scorer-gpt-6-luna
47s
View #230
View workflow file
Use GPT-6 Luna as default scoring model
python
#761:
Pull request
#230
opened by
ankrgyl
1m 20s
ankur/default-scorer-gpt-6-luna
ankur/default-scorer-gpt-6-luna
1m 20s
View #230
View workflow file
Add SpeechClarity, TurnTaking, and VoiceTaskSuccess voice scorers
python
#760:
Pull request
#229
opened by
kevchoi
38s
kevchoi/20261001-voice-scorers
kevchoi/20261001-voice-scorers
38s
View #229
View workflow file
feat: add speech clarity and turn-taking voice scorers
python
#759:
Pull request
#228
synchronize by
kevchoi
43s
kevchoi/20260928-autoevals-voice-scorers
kevchoi/20260928-autoevals-voice-scorers
43s
View #228
View workflow file
feat: add speech clarity and turn-taking voice scorers
python
#758:
Pull request
#228
opened by
kevchoi
41s
kevchoi/20260928-autoevals-voice-scorers
kevchoi/20260928-autoevals-voice-scorers
41s
View #228
View workflow file
Stop HTML-escaping scorer values in the ragas prompts
python
#757:
Pull request
#227
opened by
feiiiiii5
Action required
feiiiiii5:fix/ragas-prompts-no-html-escaping
feiiiiii5:fix/ragas-prompts-no-html-escaping
Action required
View #227
View workflow file
fix(ragas): resolve the judge model through the library default
python
#756:
Pull request
#226
opened by
feiiiiii5
Action required
feiiiiii5:fix/ragas-default-model
feiiiiii5:fix/ragas-default-model
Action required
View #226
View workflow file
fix(ragas): score 0 when Faithfulness gets no statements
python
#755:
Pull request
#225
opened by
feiiiiii5
Action required
feiiiiii5:fix/faithfulness-empty-statements
feiiiiii5:fix/faithfulness-empty-statements
Action required
View #225
View workflow file
fix(json): do not treat booleans as numbers in JSONDiff
python
#754:
Pull request
#224
synchronize by
feiiiiii5
Action required
feiiiiii5:fix/json-diff-bool-is-not-number
feiiiiii5:fix/json-diff-bool-is-not-number
Action required
View #224
View workflow file
fix(json): do not treat booleans as numbers in JSONDiff
python
#753:
Pull request
#224
synchronize by
feiiiiii5
Action required
feiiiiii5:fix/json-diff-bool-is-not-number
feiiiiii5:fix/json-diff-bool-is-not-number
Action required
View #224
View workflow file
fix(json): do not treat booleans as numbers in JSONDiff
python
#752:
Pull request
#224
opened by
feiiiiii5
Action required
feiiiiii5:fix/json-diff-bool-is-not-number
feiiiiii5:fix/json-diff-bool-is-not-number
Action required
View #224
View workflow file
fix: allow npm consumers to install the package (#216)
python
#751:
Commit
9546b28
pushed by
AbhiPrasad
46s
main
main
46s
View workflow file
fix(python): preserve explicit token limits for Responses API
python
#750:
Pull request
#222
synchronize by
kingsleyli920
-1s
kingsleyli920:codex/responses-token-limit
kingsleyli920:codex/responses-token-limit
-1s
View #222
View workflow file
fix(python): preserve explicit token limits for Responses API
python
#749:
Pull request
#222
opened by
kingsleyli920
Action required
kingsleyli920:codex/responses-token-limit
kingsleyli920:codex/responses-token-limit
Action required
View #222
View workflow file
fix(python): honor ValidJSON schemas across scorer call paths
python
#748:
Pull request
#221
opened by
JianYan11
30d 0h 3m 6s
JianYan11:fix/python-validjson-schema
JianYan11:fix/python-validjson-schema
30d 0h 3m 6s
View #221
View workflow file
fix: return ExactMatch mismatches for non-JSON primitives
python
#747:
Pull request
#220
opened by
Bortlesboat
30d 0h 0m 29s
Bortlesboat:fix/exact-match-non-json-values
Bortlesboat:fix/exact-match-non-json-values
30d 0h 0m 29s
View #220
View workflow file
fix: allow npm consumers to install the package
python
#746:
Pull request
#216
opened by
SiluPanda
57s
SiluPanda:fix/npm-consumer-install
SiluPanda:fix/npm-consumer-install
57s
View #216
View workflow file
fix: do not crash isWrapped on plain OpenAI-compatible clients
python
#745:
Pull request
#214
opened by
BetterAndBetterII
30d 0h 0m 43s
BetterAndBetterII:fix/iswrapped-plain-client
BetterAndBetterII:fix/iswrapped-plain-client
30d 0h 0m 43s
View #214
View workflow file
Previous
1
2
3
4
5
…
11
12
Next
You can’t perform that action at this time.