Skip to content

Actions: OpenRouterTeam/benchmark-harness

Actions

CI

Actions

Loading...
Loading

Show workflow options

Create status badge

Loading
ci.yml
446 workflow runs
446 workflow runs

Filter by Event

⌥ + click/return to exclude

Filter by Status

⌥ + click/return to exclude

Filter by Branch

⌥ + click/return to exclude

Filter by Actor

⌥ + click/return to exclude
feat: accept max reasoning effort (#137) CI #446: Commit bd5c6d0 pushed by ayush-or
23s main
main
23s
feat: accept max reasoning effort CI #445: Pull request #137 opened by ayush-or
21s devin/1791425200-max-reasoning-effort
devin/1791425200-max-reasoning-effort
21s
deps: bump the dependencies group across 1 directory with 17 updates CI #444: Pull request #136 opened by dependabot Bot
14s dependabot/bun/dependencies-7f64df538c
dependabot/bun/dependencies-7f64df538c
14s
deps: batch low-risk CVE bumps (smol-toml, @grpc/grpc-js, brace-expan… CI #443: Commit e20970c pushed by alexb-openrouter
27s main
main
27s
deps: batch low-risk CVE bumps (smol-toml, @grpc/grpc-js, brace-expansion, tinypool) CI #442: Pull request #135 opened by alexb-openrouter
39s devin/cve-batch-2026-10-06
devin/cve-batch-2026-10-06
39s
feat(bench): add toolcall_formats benchmark (#133) CI #441: Commit d22d57b pushed by abhinav-pola
23s main
main
23s
feat(bench): add toolcall_formats benchmark CI #440: Pull request #133 synchronize by devin-ai-integration Bot
25s devin/1790984183-toolcall-formats
devin/1790984183-toolcall-formats
25s
feat(bench): add toolcall_formats benchmark CI #439: Pull request #133 synchronize by devin-ai-integration Bot
23s devin/1790984183-toolcall-formats
devin/1790984183-toolcall-formats
23s
feat(bench): add toolcall_formats benchmark CI #438: Pull request #133 opened by abhinav-pola
28s devin/1790984183-toolcall-formats
devin/1790984183-toolcall-formats
28s
fix(bench): keep effect/Context out of config schemas and record the … CI #437: Commit 78154b8 pushed by jamespsterling
20s main
main
20s
fix(bench): record the effective search request body CI #436: Pull request #114 synchronize by jamespsterling
21s devin/1790265311-workflow-safe-variant-strip
devin/1790265311-workflow-safe-variant-strip
21s
feat(harness): run a single epoch of a run CI #435: Pull request #132 opened by abhinav-pola
25s feat/run-single-epoch
feat/run-single-epoch
25s
fix(agent-cli): keep pi-reported generation cost without a resolver o… CI #434: Commit 7601137 pushed by ayush-or
24s main
main
24s
fix(agent-cli): keep pi-reported generation cost without a resolver or token usage CI #433: Pull request #131 opened by ayush-or
20s codex/agent-cli-reported-cost
codex/agent-cli-reported-cost
20s
feat(agent-cli): forward Switchyard candidate models to the in-sandbo… CI #432: Commit 1a8b00b pushed by ayush-or
28s main
main
28s
fix(sandbox): match Modal region pins through the openrouter/ routing prefix CI #431: Pull request #99 synchronize by devin-ai-integration Bot
24s devin/1789746575-modal-regions-routing-prefix
devin/1789746575-modal-regions-routing-prefix
24s
feat(agent-cli): forward Switchyard candidate models to the in-sandbox pi agent (2/2) CI #430: Pull request #129 synchronize by ayush-or
41s codex/sandbox-candidate-models
codex/sandbox-candidate-models
41s
fix(agent-cli): count server-tool child generation cost in pi billed … CI #429: Commit e842619 pushed by ayush-or
23s main
main
23s
feat(agent-cli): forward the switchyard-router plugin through sandbox… CI #428: Commit 6987db9 pushed by ayush-or
26s main
main
26s
fix(sandbox): reject blank or whitespace Modal region identifiers (#121) CI #427: Commit 3dc8661 pushed by ayush-or
21s main
main
21s
feat(agent-cli): forward Switchyard candidate models to the in-sandbox pi agent (2/2) CI #426: Pull request #129 synchronize by ayush-or
25s codex/sandbox-candidate-models
codex/sandbox-candidate-models
25s
feat(agent-cli): forward Switchyard candidate models to the in-sandbox pi agent (2/2) CI #425: Pull request #129 opened by ayush-or
26s codex/sandbox-candidate-models
codex/sandbox-candidate-models
26s
fix(bench): record the effective search request body CI #424: Pull request #114 synchronize by jamespsterling
26s devin/1790265311-workflow-safe-variant-strip
devin/1790265311-workflow-safe-variant-strip
26s
fix(agent-cli): count server-tool child generation cost in pi billed cost CI #423: Pull request #128 opened by ayush-or
29s devin/1790787526-server-tool-child-cost
devin/1790787526-server-tool-child-cost
29s
deps: bump the dependencies group across 1 directory with 18 updates CI #422: Pull request #82 synchronize by dependabot Bot
15s dependabot/bun/dependencies-b73ccc376e
dependabot/bun/dependencies-b73ccc376e
15s