Skip to content

ci: name every failing test in the compat matrix output - #3

Merged
danielmlr merged 1 commit into
mainfrom
ci/compat-failure-detail
Sep 25, 2026
Merged

danielmlr merged 1 commit into
mainfrom
ci/compat-failure-detail

Conversation

@danielmlr

Copy link
Copy Markdown
Member

The compat matrix printed only the last 25 lines of a failing run, so a run with many failures showed one. The informational job on #2 failed with SyntaxError: Unexpected end of JSON input thirteen times on the baseline while the gating job passed the same baseline, and the log cannot say which tests those were.

A failing run now prints every failing test with its first error lines, then the summary. Checked locally against a deliberately failing test file (deleted): both failures are listed with their errors.

No changeset: CI script only.

A failing run printed only its last 25 lines, which showed one failure
and hid the rest. The first CI runs on main failed with a dozen
timeouts and, once, with "Unexpected end of JSON input" in the
informational job, and the log could not say which tests those were.
It now prints each failing test with its first error lines, then the
summary.
@danielmlr
danielmlr merged commit 7ba0dc5 into main Sep 25, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant