Skip to content

Refresh harness baseline for the merged signature tests - #3

Merged
WaterPancake merged 1 commit into
mainfrom
learned-audio-signature
Oct 18, 2026
Merged

WaterPancake merged 1 commit into
mainfrom
learned-audio-signature

Conversation

@WaterPancake

Copy link
Copy Markdown
Owner

What

The canary baseline refresh that PR #2 needed: the 45 signature tests (tests/test_signature_p0.py: 32, tests/test_signature_admission.py: 13) arrived on main via PR #2 without their human-only baseline refresh, so both CI jobs fail the count canary:

  • cast: got 723, expected 678
  • baseline: got 756, expected 711

This PR regenerates tests/harness_baseline.json via scripts/refresh_harness_baseline.py (measures both environments in isolated uv subprocesses) at the merged tree: cast 678 → 723, baseline 711 → 756. Exactly the two count lines change; frozen-file hashes unchanged.

Verification

Both graded selections verified green locally after the refresh (cast exit 0, baseline exit 0). Accounting: 723 − 678 = 32 + 13 signature tests, nothing unexplained.

Still owed (unchanged by this PR)

  • Line-by-line human review of the two signature test files (flagged by experiments/military_signature/CURRENT_STATUS.md before the merge); summaries prepared in docs/CODE_REVIEW_PENDING.md.
  • The CAST-4B joint-metric branch (cast4b/joint-metric-fixtures) will need its own same-commit refresh (+12 tests) when reviewed and merged.

The military-signature P0/P1 tests (tests/test_signature_p0.py: 32,
tests/test_signature_admission.py: 13) arrived through merge bef43c9
without the human-only baseline refresh that CURRENT_STATUS.md flagged
as required. The canary correctly failed red (723 vs 678 cast,
756 vs 711 baseline).

This is the owed refresh, regenerated by the user-authorized
scripts/refresh_harness_baseline.py run in the main checkout at
bef43c9. Both graded selections verified green after the refresh:
cast 723, baseline 756. Frozen-file hashes unchanged (7 files).

Note: the line-by-line review of the two merged signature test files
flagged by experiments/military_signature/CURRENT_STATUS.md remains
owed before their next suite change.
@WaterPancake
WaterPancake merged commit 3cc64ac into main Oct 18, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant