Repository navigation
docs: organize benchmarks and add Web Fetch results - #1380
lanyue-llk wants to merge 8 commits into
Conversation
3128c50 to
d5ce037
Compare
CI Regression ReportSource CI run · source state at render:
Release regression — ✅ HEAD/base failures 0/0; raw binary 0.00%Package and image size
Startup latency and PSS
Concurrency matrix
Frontend differential — ✅ 1,020/1,020 cases matched; 0 issues
Agent episodes · Moli vs Chromium — ✅ 8/8 Moli episodes passed; 0 failures
Runtime and CDP session contracts — ✅ 26 contract cases; 0 failures
CDP smoke — ✅ 52/52 groups passed; 621 scenariosWorkers: 4 · cumulative group time: 153.98 s · failed groups: 0
WebMainBench · 545 pages — ✅ 545/545 completed; 0 unexpected failures
Frozen HTML · Linux · Diagnostics: All artifact fields are parsed by the trusted default-branch renderer; missing or invalid inputs remain visible as unavailable. |
1fa32d8 to
ac9afe6
Compare
Spider Bench A/B✅ All benchmark browser service runs completed; results are informational. Public HEAD: 184 / 240 rows; 38 / 48 sites produced rows; 10 unexpected empty sites. ✅ Deterministic fixture contract is clean. Common ancestor Public 48-site run · informational
Public-site content, timing, and memory are noisy. This single A/B run reports evidence only; site outcome counts explain missing rows without treating them as a deterministic regression. CPU and memory timelinesThese are bounded 40-point views of the same complete process-tree samples used by the HTML report. CPU uses 100% per occupied logical core; memory lines are RSS first and PSS second when complete PSS samples are available. Basexychart-beta
title "Base CPU"
x-axis "Elapsed seconds" [1.038, 1.539, 2.54, 4.043, 5.044, 6.545, 8.046, 9.047, 10.549, 12.051, 13.052, 14.553, 15.554, 17.056, 18.558, 19.56, 21.063, 22.064, 23.566, 25.067, 26.068, 26.569, 27.569, 28.571, 30.073, 31.574, 32.574, 34.075, 35.578, 36.579, 38.081, 39.082, 40.582, 42.083, 43.085, 44.585, 45.586, 46.588]
y-axis "CPU percent" 0 --> 200
line [3.99, 93.94, 5.99, 129.72, 153.98, 185.97, 139.94, 173.56, 151.84, 61.95, 77.97, 147.95, 127.87, 113.88, 137.6, 23.94, 23.94, 97.93, 43.93, 113.85, 59.93, 0, 101.9, 141.87, 145.77, 133.79, 24.01, 153.65, 147.81, 101.87, 87.89, 51.94, 140.1, 19.97, 21.96, 24, 137.87, 189.73]
xychart-beta
title "Base memory: RSS then PSS"
x-axis "Elapsed seconds" [0.037, 1.038, 1.539, 2.54, 4.043, 5.044, 6.545, 8.046, 9.047, 10.549, 12.051, 13.052, 14.553, 15.554, 17.056, 18.558, 19.56, 21.063, 22.064, 23.566, 25.067, 26.068, 26.569, 27.569, 28.571, 30.073, 31.574, 32.574, 34.075, 35.578, 36.579, 38.081, 39.082, 40.582, 42.083, 43.085, 44.585, 45.586, 46.588, 46.968]
y-axis "Memory MiB" 0 --> 500
line [12.59, 62.14, 95.3, 101.05, 134.24, 152.77, 165.7, 172.97, 179.29, 184.8, 171.72, 161.11, 184.52, 190.52, 154.98, 182.59, 149.12, 150.12, 149.49, 175.43, 150.59, 150.63, 150.63, 262.07, 199.41, 215.19, 196.04, 167.46, 192.36, 170.34, 158.57, 153.11, 165.84, 233.77, 190.24, 175.82, 164.84, 190, 202.87, 0]
line [9.39, 58.61, 91.81, 97.5, 130.72, 149.24, 162.27, 169.59, 178.21, 181.28, 168.17, 157.56, 180.99, 187.16, 151.43, 179.01, 145.33, 146.6, 145.95, 171.8, 146.62, 147.05, 147.05, 258.39, 195.87, 211.82, 192.64, 164.03, 188.36, 166.85, 155.17, 149.7, 162.48, 229.34, 186.84, 172.41, 161.45, 186.59, 199.4, 0]
HEADxychart-beta
title "HEAD CPU"
x-axis "Elapsed seconds" [1.539, 3.04, 4.542, 6.043, 7.045, 7.546, 9.046, 10.548, 12.05, 14.053, 15.553, 17.054, 18.556, 20.058, 21.559, 23.061, 24.563, 26.065, 27.567, 29.069, 30.57, 31.071, 32.072, 33.573, 35.075, 36.577, 38.079, 39.581, 41.583, 43.086, 44.589, 46.091, 47.593, 49.095, 50.595, 51.596, 52.097, 53.6]
y-axis "CPU percent" 0 --> 500
line [129.92, 134.07, 129.82, 79.81, 0, 2, 173.86, 95.92, 51.96, 101.75, 156.1, 133.91, 4, 2, 99.93, 107.92, 25.98, 117.67, 104.05, 155.8, 99.7, 107.88, 133.94, 117.78, 145.92, 161.91, 93.83, 107.84, 45.9, 163.62, 11.97, 0, 2, 37.94, 20.01, 205.56, 55.87, 147.83]
xychart-beta
title "HEAD memory: RSS then PSS"
x-axis "Elapsed seconds" [0.037, 1.539, 3.04, 4.542, 6.043, 7.045, 7.546, 9.046, 10.548, 12.05, 14.053, 15.553, 17.054, 18.556, 20.058, 21.559, 23.061, 24.563, 26.065, 27.567, 29.069, 30.57, 31.071, 32.072, 33.573, 35.075, 36.577, 38.079, 39.581, 41.583, 43.086, 44.589, 46.091, 47.593, 49.095, 50.595, 51.596, 52.097, 53.6, 55.054]
y-axis "Memory MiB" 0 --> 500
line [12.5, 115.21, 127.61, 136.63, 166.73, 147.64, 146.56, 188.55, 171.17, 176.61, 180.46, 165.28, 162.11, 147.75, 148.77, 144.18, 159.7, 144.71, 152.11, 194.48, 161.91, 217.27, 272.86, 201.65, 222.38, 152.27, 167.76, 201.25, 157.86, 154.2, 213.77, 170.97, 169.82, 169.81, 176.01, 167.14, 178.28, 180.12, 187.21, 0]
line [9.22, 111.51, 123.49, 132.91, 162.98, 143.89, 142.81, 184.82, 168.33, 172.81, 176.79, 161.59, 158.27, 143.95, 144.98, 140.41, 155.9, 140.92, 148.31, 191.12, 158.17, 213.51, 270.2, 197.87, 218.63, 148.56, 164.74, 197.53, 154.15, 150.4, 210.59, 167.17, 166.16, 166.15, 172.35, 163.48, 175.24, 176.56, 183.71, 0]
Deterministic fixture · required contractThe fixture exercises 15 routes: 8 are expected to emit rows and 7 intentionally exercise empty, loading, or timeout behavior.
Full HTML, JSON, CSV, logs, and page snapshots: workflow run and full The public-web A/B is informational. The exact HEAD fixture contract runs as a separate required CI check; timing and public-site content deltas remain non-blocking. |
Sequential Navigation Soak A/B✅ HEAD completed the 200-navigation resilience and memory observation. One browser process, one target, and one CDP session navigate CSDN → SegmentFault → Huaban → example.com repeatedly. This run issued 200 Common ancestor Session resilience
A public-page failure is reported separately from an unrecoverable session. The soak requires all navigation attempts, zero failed recovery, zero lifecycle/network ordering violations, and complete resource evidence. Process-tree memory
HEAD memory by 50-navigation quarter
Raw reports and per-navigation boundary samples: workflow run and full Public-site timing and memory are observational. Use the A/B deltas and trend shape as evidence, not as a deterministic performance threshold. |
8a39036 to
1f99b9f
Compare
|
Closing as obsolete. This writes an earlier benchmark snapshot into the product README; the current report and evidence are owned by browser-eval and the historical numbers are no longer the publication source. |
内容
统一整理六种语言 README(英文、中文、日文、德文、法文、西班牙文)的评测结构:内容提取、自动化兼容性、资源开销与功能覆盖。
721bd2e。用结果表和简短摘要说明其综合相似度、代码保真度及 545/545 正文生成覆盖。Stack
GitHub 原生依赖链:#1334 → #1335 → #1336 → #1337 → #1380 → #1428 → #1431 → #1432。
本 PR 直接依赖 #1337,GitHub base 为
codex/content-rendered-state。差异仅含英文README.md和docs/下的五种语言 README。按从左到右的顺序合入;#1428 直接以本分支为 base;#1431 与 #1432 再逐层堆叠,每层只显示自己的产品修复。#919 不在这条依赖链中。验证