Skip to content

test: make the web evidence browser test opt-in like its siblings - #175

Merged
Nagi-Inaba merged 2 commits into
mainfrom
agent/e2e-optin
Oct 19, 2026
Merged

Nagi-Inaba merged 2 commits into
mainfrom
agent/e2e-optin

Conversation

@Nagi-Inaba

Copy link
Copy Markdown
Owner

Problem

tests/web-evidence-e2e.test.mjs skipped only when import("playwright") failed. The other browser E2E tests are opt-in through a RUN_*_E2E variable. When a different Playwright version sits in an ancestor node_modules (for example the user profile), the import succeeds and the test fails with unsupported_playwright_version instead of skipping.

Change

Gate the test on RUN_WEB_EVIDENCE_E2E=1, the same convention as RUN_WEB_CAPABILITIES_E2E, and set the variable in .github/workflows/web-evidence-e2e.yml so CI still runs it. A CHANGELOG entry records the new opt-in.

Verification

  • node --test tests/web-evidence-e2e.test.mjs tests/readme-entrypoint.test.mjs: 5 pass, 0 fail, 1 skipped (the E2E is now skipped by default)
  • node scripts/verify-all.mjs passed on the combined branch of all four fixes (95 test files, Windows / Node.js 24.19.0); remote CI runs it here, and the changed workflow runs the E2E with the variable set
  • Codex / Claude parity is not affected (no canonical skill file changed)

Compatibility

  • Schema/profile/procedure version impact: none
  • Migration required: no. Anyone who ran this test locally must set RUN_WEB_EVIDENCE_E2E=1
  • CHANGELOG updated

Security and privacy

  • No credentials, private URLs, local paths, or real audit evidence are included
  • Public-report/privacy boundaries are unchanged
  • Release preparation, publication and remote CI results are reported separately

Issue

Part of the 2026-10-19 review fixes. Closes no issue.

🤖 Generated with Claude Code

Nagi-Inaba and others added 2 commits October 19, 2026 13:55
tests/web-evidence-e2e.test.mjs skipped only when import of playwright failed, so a different Playwright version in an ancestor node_modules made it fail instead of skip. Every sibling browser E2E is opt-in through a RUN_*_E2E variable; use RUN_WEB_EVIDENCE_E2E and set it in the web-evidence-e2e workflow so CI still runs the test.

Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
@chatgpt-codex-connector

chatgpt-codex-connector Bot commented Oct 19, 2026 •

Copy link
Copy Markdown

Codex Review Summary

This comment shows the latest Codex review activity on this pull request.

Review Status Commit Review trigger
📝 Code Review ✅ Completed 2026-10-19T11:13:30.798931Z 0562bab PR opened
ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review" or "@codex security review".

Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings.

@Nagi-Inaba
Nagi-Inaba merged commit 6f7bfd6 into main Oct 19, 2026
7 checks passed
@github-actions
github-actions Bot deleted the agent/e2e-optin branch October 19, 2026 11:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant