Repository navigation

Add autonomous WebArena-Verified browser evaluation - #8

Merged

lanyue-llk merged 132 commits into

mainfrom

codex/webarena-verified-pilot

Sep 15, 2026

Merged

Add autonomous WebArena-Verified browser evaluation#8
lanyue-llk merged 132 commits into
mainfrom
codex/webarena-verified-pilot

Commits on Sep 8, 2026
- Add autonomous WebArena-Verified browser evaluation
  kevin
  committed
  2455720
- Harden autonomous evaluation inputs
  kevin
  committed
  de7e70b
- Preflight Astra model access
  kevin
  committed
  109c1c5
- Clarify Astra interface and resumable pilot runs
  kevin
  committed
  f68a398
- Record evaluator-compatible network HAR
  kevin
  committed
  3f6996a
- Gate trials on stable site readiness
  kevin
  committed
  f6e5198
- Document official HAR scoring evidence
  kevin
  committed
  7f6fd10
- Preserve evidence across cleanup failures
  kevin
  committed
  9032301
- Start every trial on the official task URL
  kevin
  committed
  900950b
- Test official start-page isolation
  kevin
  committed
  e9949fe
- Normalize encoded JSON HAR bodies
  kevin
  committed
  f0cdbc8
- Publish measured runtime identities
  kevin
  committed
  95b8aa1
- Reject malformed encoded HAR bodies
  kevin
  committed
  254c736
- Expose pre-registered cohort hash
  kevin
  committed
  b7a6204
Commits on Sep 9, 2026
- Harden autonomous browser evaluation evidence
  kevin
  committed
  a6a3656
- Allow slow official environment restores
  kevin
  committed
  0979faa
- Make official Magento images reliable on ARM
  kevin
  committed
  3b9a056
- Allow explicit provider credential file
  kevin
  committed
  5381174
- Document and verify ARM report delivery
  kevin
  committed
  64fcbca
- Run official Reddit PHP reliably on ARM
  kevin
  committed
  1cb9c09
- Publish verified browser agent pilot report
  kevin
  committed
  d020854
- Fix browser agent request and runtime guards
  kevin
  committed
  e4feb28
- Restructure browser agent report
  kevin
  committed
  703d817
- Preserve Artifact Hub site identity
  kevin
  committed
  b92aa96
- Rebuild browser agent report as evidence application
  kevin
  committed
  1a358cd
- Honor Artifact Hub root paths in report pages
  kevin
  committed
  7d6d930
- Expose browser-agent ground truth and trajectories
  kevin
  committed
  283eb95
- Complete browser-agent report evidence parity
  kevin
  committed
  cb5e6a7
- Format browser-agent report implementation
  kevin
  committed
  ac79556
Commits on Sep 10, 2026
- Merge remote-tracking branch 'origin/main' into codex/webarena-verified-pilot
  kevin
  committed
  6c3f695
- Restructure browser agent evidence report
  kevin
  committed
  013633f
- Document browser agent deployment flow
  kevin
  committed
  7efac70
- Refine browser agent report publication
  kevin
  committed
  13b7d72
- Correct browser agent report evidence model
  kevin
  committed
  09c9458
- Refine browser benchmark comparison report
  kevin
  committed
  1171937
- Redesign scalable browser comparisons
  kevin
  committed
  4dd9410
- Migrate browser evaluation tracks and harden report gates
  kevin
  committed
  8bf7c37
- refine browser use diagnosis and result details
  kevin
  committed
  6224505
- bind browser use report publication
  kevin
  committed
  d762fdb
- state only proven browser use failure points
  kevin
  committed
  7962519
- bind updated browser use report version
  kevin
  committed
  b5f29a3
- promote failure evidence in report interpretation
  kevin
  committed
  d70ef71
- bind interpretation-focused report version
  kevin
  committed
  2c89837
- Merge remote-tracking branch 'origin/main' into codex/webarena-verified-pilot
  kevin
  committed
  a914016
- fix browser use failure causes at source
  kevin
  committed
  f233565
- gate browser use root causes on review
  kevin
  committed
  6d2100c
- bind verified browser use release
  kevin
  committed
  98f18ed
- bind failure review provenance
  kevin
  committed
  c346b7f
- bind final reviewed report version
  kevin
  committed
  4126339
- honor draft failure review policy
  kevin
  committed
  7eb7fc0
- resolve remaining browser use review findings
  kevin
  committed
  31780a9
- expand browser use cohort to 90 tasks
  kevin
  committed
  51a3752
- make browser report task count dynamic
  kevin
  committed
  76c0c13
- clarify missing response evaluator errors
  kevin
  committed
  d015c38
- derive browser report scope from evidence
  kevin
  committed
  c4e8b85
- exclude internal report work logs
  kevin
  committed
  7eae483
- report measured environment preparation
  kevin
  committed
  b843594
- generate report conclusions from current evidence
  kevin
  committed
  893a39a
- localize dynamic browser report scope
  kevin
  committed
  ec81667
- recover transient browser context readiness
  kevin
  committed
  ed56f79
- make browser report article check data independent
  kevin
  committed
  9b571f4
- publish reviewed 90-task browser use report
  kevin
  committed
  bed8469
Commits on Sep 11, 2026
- Expand browser evaluation across model cohorts
  kevin
  committed
  eb9963e
- Record published Browser Use report version
  kevin
  committed
  fbd73c8
- Redesign browser use report and publish workflow
  kevin
  committed
  7500c21
- Turn browser use report into diagnostic workbench
  kevin
  committed
  50a3812
- Record diagnostic report site version
  kevin
  committed
  7379460
- Fix report evidence provenance and localization
  kevin
  committed
  3d16c26
- Record corrected browser use report version
  kevin
  committed
  0e74531
- Resolve remaining report review findings
  kevin
  committed
  3085201
- Bind final diagnostic report release
  kevin
  committed
  4a90f89
- Redesign browser use failure analysis
  kevin
  committed
  e1bed72
- Reuse bound browser use visual QA receipts
  kevin
  committed
  ed9bb9c
- Add hosted execution evidence viewer
  kevin
  committed
  46806d0
- Bind published browser use report version
  kevin
  committed
  2006673
- Fix browser trace frame accounting
  kevin
  committed
  cd5117f
- Clean browser report diagnostics code
  kevin
  committed
  e842763
- Report Artifact Hub response failures clearly
  kevin
  committed
  934f1fa
- Bind latest browser use report release
  kevin
  committed
  353edfa
- Localize excluded task separators
  kevin
  committed
  e3d8b79
- Bind corrected browser use report release
  kevin
  committed
  c446202
- Add verified WebArena trajectory dataset pipeline
  kevin
  committed
  9a681ba
Commits on Sep 14, 2026
- feat: promote verified WebArena replay trajectories
  kevin
  committed
  2a0295e
- Make audited browser comparison the canonical homepage
  kevin
  committed
  8f4cb61
- Audit browser results and isolate environment lanes
  kevin
  committed
  79ad122
- Sync browser report publication baseline
  kevin
  committed
  582162d
- Verify published report by stable shell
  kevin
  committed
  db6a5d4
- Prepare isolated 90-task trajectory replay
  kevin
  committed
  ef3e9dc
- Compile replay refs into stable selectors
  kevin
  committed
  6a780b1
- Add reference-browser replay qualification
  kevin
  committed
  e48d0b4
- Preserve snapshot-ref replay semantics
  kevin
  committed
  92c3fbb
- Bind published Browser Use report version
  kevin
  committed
  f399e67
- Restore full Browser Use report scope
  kevin
  committed
  f2c2542
- Clear persisted filters in task 676 replay
  kevin
  committed
  7af6b68
- Separate trajectory qualification from comparison
  kevin
  committed
  dcf6868
- Use final logical results throughout report
  kevin
  committed
  6b196ff
- Correct complete Browser Use publication
  kevin
  committed
  d38a56f
- Qualify repaired trajectory shards
  kevin
  committed
  64d32ac
- Repair remaining Chromium replay trajectories
  kevin
  committed
  6b99a83
- Stabilize cart cleanup and invitation replay
  kevin
  committed
  b9a489c
- Wait for checkout success evidence
  kevin
  committed
  a8a2521
- Honor declared replay wait durations
  kevin
  committed
  5dc70e8
- Merge incremental trajectory qualification proofs
  kevin
  committed
  128371b
- Retry failed trajectory replays once
  kevin
  committed
  ec20b6a
- Stabilize cancelled-order replay trajectory
  kevin
  committed
  7509990
- Version corrected replay candidate identity
  kevin
  committed
  31386e9
- Correct replay trajectories and evaluator bindings
  kevin
  committed
  e052882
- Scope replay correction evidence per task
  kevin
  committed
  8bd1126
- Add formal replay correction shards
  kevin
  committed
  6de0a97
- Merge formal replay correction evidence
  kevin
  committed
  96517af
- Promote complete replay trajectory dataset
  kevin
  committed
  a6aa729
- Bind replay failures to reviewed root causes
  kevin
  committed
  70118e9
- Add evidence-backed trajectory replay report
  kevin
  committed
  5881e93
- Harden replay cleanup and environment locking
  kevin
  committed
  b8c1022
- Localize replay report interface labels
  kevin
  committed
  cf53a11
- Make replay release checks registry driven
  kevin
  committed
  2cd804f
- Handle replay release check edge cases
  kevin
  committed
  f70963c
- Derive replay report prose from evidence
  kevin
  committed
  3f66f56
Commits on Sep 15, 2026
- Make Artifact Site the replay release target
  kevin
  committed
  17f2d1d
- Resolve final replay review findings
  kevin
  committed
  3c7fe3c
- Localize replay release and recover uploads
  kevin
  committed
  1e02984
- Validate replay resume receipt fields
  kevin
  committed
  6a5bcc6
- Harden replay cleanup and publication recovery
  kevin
  committed
  240f233
- Recover first replay site publication
  kevin
  committed
  4fcfb0c
- Improve trajectory replay report drilldown and hosted navigation
  kevin
  committed
  2722649
- Clarify replay submission failures and scale browser comparison
  kevin
  committed
  832b7c6
- Merge latest main and bind published replay report version
  kevin
  committed
  4b792d3
- Handle all-pass trajectory report visual checks
  kevin
  committed
  a8a9725
- Refine replay report dataset and review drilldown
  kevin
  committed
  6b6e6e2
- Merge remote-tracking branch 'origin/main' into codex/webarena-verified-pilot
  kevin
  committed
  f5bfcf5
- Merge remote-tracking branch 'origin/codex/webarena-verified-pilot' into codex/webarena-verified-pilot
  kevin
  committed
  e8e45bd
- Restore aligned replay trajectory and step evidence dialog
  kevin
  committed
  0004bb8

Commits

Commits on Sep 8, 2026

Commits on Sep 9, 2026

Commits on Sep 10, 2026

Commits on Sep 11, 2026

Commits on Sep 14, 2026

Commits on Sep 15, 2026