Repository navigation
t27b ledger: 14 specs on master have no row; bless from lab run a97cb9e55 #8170
Copy link
Copy link
Closed
Labels
Description
Problem
After #8059, #8056, #7913, #7918 and #7925 landed, master's docs/reports/t27b_expectations.json (source: lab run 6b6386e) lags the newest t27b lab run on master (a97cb9e, finished 2026-10-09T11:24:58Z). tri t27b ratchet --run <that run> is red: UNLISTED 14 (specs merged without a ledger row, all of them t27b pass: agent-claims-honest, agent-media-kie, agent-neuro-kie, port/scripts gen_w310/311/314/315/316/318/322, jtag/tdo_verdict, trios-cli cmd/gates, queen/dispatch_exit, verified/silicon_queue). Everything else is zero.
Master also stores max_not_pass 26 over 25 non-passing rows.
Boundary
- Edits only
docs/reports/t27b_expectations.json(bytri t27b ratchet --bless, no hand edit) and adds onedocs/now/entry. - Leaves
specs/ml/recurrent/self_attention.t27to spec(self_attention): declare default_input, so the reference verdict is the same on every host (Closes #8051) #8145, andspecs/tri/t27b/eval_arith.t27to t27b: eval::arith, the reference interpreter's exact arithmetic, moves to specs/tri/t27b/eval_arith.t27 (Closes #8057) #8086 (not on master yet). - Data only; no code.
Requirements
- Bless from lab run a97cb9e;
max_not_passequals the real non-pass count. - Rows sorted, no duplicate paths, every path exists on the tree.
Success Criteria
tri t27b ratchet --run runs/a97cb9e55...jsonis green (all kinds 0).- path count == unique path count;
max_not_pass== count of rows that are neitherpassnorpass_vacuous(25).
Refs #6063
User Scenarios
- Given the
docs/reports/t27b_expectations.jsonreflects lab run 6b6386e, when the t27b ratchet is run against the newer lab run a97cb9e, then it reports 14 UNLISTED specs and a mismatchedmax_not_passvalue. - Given the 14 missing specs all pass in lab run a97cb9e, when the expectations are blessed from that run, then the ratchet shows zero UNLISTED, zero NEW_FAIL, and zero other discrepancies.
- Given the blessed expectations are committed with a
docs/now/entry, whentri t27b ratchet --run runs/a97cb9e55...jsonexecutes, then it exits green with all kind counts at 0.
Requirements
- FR-001: The
docs/reports/t27b_expectations.jsonfile MUST be updated by runningtri t27b ratchet --bless --run a97cb9e55(or equivalent) so that it reflects lab run a97cb9e. - FR-002: The
max_not_passfield in the expectations MUST equal the actual count of rows that are neitherpassnorpass_vacuous(25). - FR-003: Every row in the expectations MUST have a unique path that exists in the repository tree, and rows MUST be sorted.
- FR-004: A new entry MUST be added under
docs/now/documenting this bless operation. - FR-005: The specs
specs/ml/recurrent/self_attention.t27andspecs/tri/t27b/eval_arith.t27MUST NOT be added or modified in this change (they are tracked in spec(self_attention): declare default_input, so the reference verdict is the same on every host (Closes #8051) #8145 and t27b: eval::arith, the reference interpreter's exact arithmetic, moves to specs/tri/t27b/eval_arith.t27 (Closes #8057) #8086 respectively).
Reactions are currently unavailable
Activity
t27b ledger: add gen_w_blocks.t27 as pass from lab run cd47f56 (Closes …
t27b ledger: add seal_identity.t27 as pass (Closes #8170)
t27b ledger: carry #8078's rows and cap 24, so the cap line merges cl…
t27b ledger: add speed_quality.t27 and gen_w662.t27 as pass (Closes #…
t27b ledger: bless lab run a97cb9e, 14 unlisted pass rows, cap 26 -> …