Skip to content

E2E / aspect / benchmark coverage: the workflow was never instantiated (29 repos affected) #65

Open

Description

@hyperpolymath

Removed .github/workflows/e2e.yml in #64. This issue records what it was for, so the intent is not lost with the noise.

What it was

🟡 Check: E2E + aspect + bench claimed to cover four merge-requirement categories:

  • E2E (end-to-end pipeline tests)
  • Aspect (cross-cutting concern validation)
  • Benchmarks (performance regression detection)
  • Readiness (Component Readiness Grade: D/C/B)

What it did

Nothing. Its own header says why:

INSTRUCTIONS: Uncomment and customise the section matching your stack.

Every job block was still commented out, so the file declared jobs: with nothing beneath it — yaml.safe_load returns None for that key. A workflow with no jobs is invalid, so all 20 of 20 runs failed with zero jobs and no log.

This is worse than having no workflow. Anyone auditing the repo's workflow list would conclude those four categories were covered.

Not local — 29 repos

The same un-instantiated file is in 29 repositories, including rsr-template-repo. That is the root: minted repos inherit it, so the count grows with every new repo rather than shrinking.

Fix the template first, then sweep the instances. Either the template ships a working default for its stack, or it ships nothing and the file is created deliberately when wanted — but a scaffold that is invalid until edited will keep being merged unedited.

What actually covers this repo now

rust-ci.yml and proofs.yml, and both genuinely fail when they should: proofs 18 failures in 33 runs, trope conformance 21 in 118. If aspect/benchmark/readiness coverage is wanted here specifically, it should be added to those rather than restored as a template.

Found during the 2026-08-05 estate CI/CD census.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    priority:p2Normal - queue itscope:estateAffects many or all repos across the estatestatus:blockedCannot proceed until a dependency clearstestingTests, benchmarks, fuzzing, property checks, coverage

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions