Skip to content

Run the full validation suite once per final candidate - #1681

Draft
realmarcin wants to merge 1 commit into
masterfrom
perf/single-suite-gates-20261028
Draft

realmarcin wants to merge 1 commit into
masterfrom
perf/single-suite-gates-20261028

Conversation

@realmarcin

@realmarcin realmarcin commented Oct 28, 2026 •

Copy link
Copy Markdown
Collaborator

The old handoff instructions ran the complete pytest suite directly and then repeated it through tox. Use focused tests during development and one full-suite invocation for final PR validation. The maintained runner finishes cheap checks first and stops on failures before the expensive suite; default tox now checks formatting/spelling without editing source files.

The runner records results against a clean committed candidate, rejects changes during validation, preserves earlier evidence, neutralizes tox execution overrides and user defaults, and explicitly discovers tests/ rather than scratch worktrees. CI's Python matrix, scientific assertions, integration markers and graph-release requirements remain unchanged. Duration reporting is enabled on the final run.

Validation: 11 focused subprocess checks passed on Python 3.10.11 locally and on M5 (the M5 run used the normal repository conftest). Changed Python files pass Ruff lint/format checks; independent reviews and git diff checks passed. The real final gate passed lock/config checks, lint, codespell and docstring coverage, then stopped before pytest because existing master has nine formatting differences (tracked in #1682). This PR does not mix those unrelated source edits into the workflow change. The full scientific suite has not been rerun for this policy change.

Installation is already verified on M5's four existing candidate branches, with policy-only commits, backups and receipts. The three legacy /tmp gate entrypoints now forward to the committed runner. Installation helpers are retained in scripts/adhoc/ for provenance. The existing candidate branches have not been pushed by this change.

Fixes #1679.
Fixes #1680.

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Bound final validation discovery to the repository test suite Ensure final validation cannot silently skip tests through tox environment flags

1 participant