Skip to content

Specs with no tests cannot be proven: add real tests to 46 specs #7642

Closed

Description

@dmitrii-f-t27

Goal

About 46 specs added by merged PRs have no tests, so a seal records total == 0 and proves nothing. Under the Queen coverage rule (a closed issue counts when its specs are sealed with passed == total > 0) their issues stay uncovered. Each spec needs at least one real test that exercises its decisions; a vacuous assert does not count.

Specs

  • specs/functions/neuro-image-generate.t27
  • specs/functions/render-avatar-video-run.t27
  • specs/tools/mcp/gitbutler.t27
  • specs/tools/mcp/needle.t27
  • specs/tools/mcp/neon.t27
  • specs/tools/mcp/notebooklm.t27
  • specs/tools/mcp/railway-mcp-server.t27
  • specs/tools/mcp/t27-traceability.t27
  • specs/tools/tri/gen.t27
  • specs/tools/tri/harness.t27
  • specs/tools/tri/health.t27
  • specs/tools/tri/hooks.t27
  • specs/tools/tri/issues.t27
  • specs/tools/tri/jumps.t27
  • specs/tools/tri/kinds.t27
  • specs/tools/tri/lean.t27
  • specs/tools/tri/ledgers.t27
  • specs/tools/tri/loop.t27
  • specs/tools/tri/merging.t27
  • specs/tools/tri/misread.t27
  • specs/tools/tri/mods.t27
  • specs/tools/tri/mutate.t27
  • specs/tools/tri/now.t27
  • specs/tools/tri/one-away.t27
  • specs/tools/tri/orphaned.t27
  • specs/tools/tri/pr.t27
  • specs/tools/tri/prose.t27
  • specs/tools/tri/quantifiers.t27
  • specs/tools/tri/red.t27
  • specs/tools/tri/reseal.t27
  • specs/tools/tri/rtl.t27
  • specs/tools/tri/seals.t27
  • specs/tools/tri/serve.t27
  • specs/tools/tri/skill.t27
  • specs/tools/tri/status.t27
  • specs/tools/tri/sweep.t27
  • specs/tools/tri/vsim.t27
  • specs/tools/tri/window.t27
  • specs/tools/tri/worktrees.t27
  • specs/tools/trinity/tri/mesh.t27
  • specs/tools/trinity/tri/needle-check.t27
  • specs/tools/trinity/tri/needle-search.t27
  • specs/tools/trinity/tri/needle.t27
  • specs/tools/trinity/tri/omega.t27
  • specs/tools/trinity/tri/particles.t27
  • specs/tools/trinity/tri/phi.t27

Success Criteria

Per spec: at least one test with runtime asserts executed (t27c test-report shows more than 0), sealed with passed == total > 0.

Scope note

Tests only; the behaviour in the specs does not change.

User Scenarios

  • Given a spec file with zero tests, when the spec is compiled and tested with t27c, then the test report shows total == 0 and the seal cannot prove the spec.
  • Given each of the 46 cited specs, when a real test exercising its decisions is added and t27c seal runs, then the seal records passed == total > 0.
  • Given the Queen coverage rule, when all 46 specs have sealed tests with passed == total > 0, then their associated issues become covered.

Requirements

  • FR-001: Each cited spec file MUST contain at least one test case that executes runtime asserts against the spec's decisions.
  • FR-002: Added tests MUST NOT be vacuous asserts; they MUST exercise observable behavior defined by the spec.
  • FR-003: After changes, t27c test-report for each spec MUST show total > 0.
  • FR-004: Each spec MUST seal with passed == total > 0 via t27c seal.
  • FR-005: The behavior specified in each .t27 file MUST NOT change; only test additions are allowed.

Success Criteria

  • t27c test-report specs/functions/neuro-image-generate.t27 shows total > 0 and exits 0
  • t27c test-report specs/functions/render-avatar-video-run.t27 shows total > 0 and exits 0
  • t27c test-report specs/tools/mcp/gitbutler.t27 shows total > 0 and exits 0
  • t27c test-report specs/tools/mcp/needle.t27 shows total > 0 and exits 0
  • t27c test-report specs/tools/mcp/neon.t27 shows total > 0 and exits 0
  • t27c test-report specs/tools/mcp/notebooklm.t27 shows total > 0 and exits 0
  • t27c test-report specs/tools/mcp/railway-mcp-server.t27 shows total > 0 and exits 0
  • t27c test-report specs/tools/mcp/t27-traceability.t27 shows total > 0 and exits 0
  • t27c test-report specs/tools/tri/gen.t27 shows total > 0 and exits 0
  • t27c test-report specs/tools/tri/harness.t27 shows total > 0 and exits 0
  • t27c test-report specs/tools/tri/health.t27 shows total > 0 and exits 0
  • t27c test-report specs/tools/tri/hooks.t27 shows total > 0 and exits 0
  • All 46 cited specs seal with passed == total > 0 via t27c seal (46 seals)

Boundary

  • specs/functions/neuro-image-generate.t27
  • specs/functions/render-avatar-video-run.t27
  • specs/tools/mcp/gitbutler.t27
  • specs/tools/mcp/needle.t27
  • specs/tools/mcp/neon.t27
  • specs/tools/mcp/notebooklm.t27
  • specs/tools/mcp/railway-mcp-server.t27
  • specs/tools/mcp/t27-traceability.t27
  • specs/tools/tri/gen.t27
  • specs/tools/tri/harness.t27
  • specs/tools/tri/health.t27
  • specs/tools/tri/hooks.t27

Activity

  1. dmitrii-f-t27 commented on Oct 10, 2026

    @dmitrii-f-t27
    ContributorAuthor

    Done on master — every spec listed here now has real tests and a seal with passed == total > 0. Closing as completed.

    Checked on master at 295b2c5 (2026-10-10).
    I built t27c from that tree (cargo build --release --manifest-path bootstrap/Cargo.toml, zig 0.16.0) and ran these two commands on each of the 46 specs:

    • t27c test-report <spec> --specs-dir specs: 147/147 tests pass, 0 fail, 0 vacuous passes. Every test executed at least one runtime assert.
    • t27c seal <spec> --verify: 46/46 all hashes MATCH. In each committed seal, tests.passed == tests.total > 0 and failed == 0.

    Where the tests landed (all merged by @gHashTag; none of these PRs referenced this issue, so it stayed open):

    Family Specs Tests per spec PR
    specs/functions/ 2 5 #8288
    specs/tools/mcp/ 6 1 #6816
    specs/tools/tri/ gen…merging 11 4 #7904
    specs/tools/tri/ misread…red 10 4 #7958
    specs/tools/tri/ reseal…worktrees 10 4 #8045
    specs/tools/trinity/tri/ 7 1 #8486

    Not covered by this check: I did not wait for a separate CI run of these specs on that master SHA. The results above come from a local run of t27c built from that exact tree.

    Dmitrii Fedorov (@dmitrii-f-t27)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions