Repository navigation

Add a harness-neutral agent contract and adopt it for Copilot CLI - #1008

Merged

Sun Haoran (haoranpb) merged 7 commits into

core/harness-01-shared-typesfrom

core/harness-02-contract

Nov 3, 2026

Merged

Add a harness-neutral agent contract and adopt it for Copilot CLI#1008
Sun Haoran (haoranpb) merged 7 commits into
core/harness-01-shared-typesfrom
core/harness-02-contract

Commits on Nov 3, 2026
- Add a harness-neutral agent contract to bcbench-core
  
  Sun Haoran (haoranpb)
  and
  Copilot
  committed
  ac3e21c
- Return AgentResult from BC-Bench agent harnesses
  
  Sun Haoran (haoranpb)
  and
  Copilot
  committed
  266df18
- Implement the harness contract for GitHub Copilot CLI and drop the transcript type
  
  Sun Haoran (haoranpb)
  and
  Copilot
  committed
  5fa9224
- Carry the AgentIdentity on EvaluationContext and keep env out of the contract
  
  Sun Haoran (haoranpb)
  and
  Copilot
  committed
  d534398
- Type the harness name, declare CopilotHarness as a Harness, and make its timeout a field
  
  Sun Haoran (haoranpb)
  and
  Copilot
  committed
  9be520e
- Trim the harness contract to what harnesses use today
  
  Sun Haoran (haoranpb)
  and
  Copilot
  committed
  9996d8b
- Fall back to the default Copilot timeout only when none is requested
  
  Sun Haoran (haoranpb)
  and
  Copilot
  committed
  44cd5ec