Repository navigation

ci: make `/evals` compare a PR with its base by default - #1402

Open

Caleb Evans (calebevans-ab) wants to merge 7 commits into

mainfrom

devin/1792195132-evals-compare

Open

ci: make `/evals` compare a PR with its base by default#1402
Caleb Evans (calebevans-ab) wants to merge 7 commits into
mainfrom
devin/1792195132-evals-compare

Commits on Oct 17, 2026
- ci: pass `/evals` CLI arguments through to Cloud MCP evals (#1401)
  
  Alexandre Girard (girarda)
  authored and
  Caleb Evans (calebevans-ab)
  committed
  fbc9419
- feat(ci): add eval comparison mode
  devin-ai-integration[bot]
  committed
  9bf7958
- ci: skip the evidence download in compare mode
  devin-ai-integration[bot]
  committed
  2fb9dd6
- docs(ci): clarify eval repeat argument syntax
  devin-ai-integration[bot]
  committed
  5d37ac9
- feat(ci): compare evals against arbitrary targets
  devin-ai-integration[bot]
  committed
  e08ba7d
- feat(ci): paste the evals results comment in /evals
  devin-ai-integration[bot]
  committed
  b4196ee
Commits on Oct 18, 2026
- feat(ci): compare with the base by default in /evals
  devin-ai-integration[bot]
  committed
  cc84ee9