Skip to content

fix(tests): target consolidated integration harness - #1954

Merged
chaliy merged 1 commit into
mainfrom
2026-06-05-propose-fix-for-test-target-commands
Jun 5, 2026
Merged

chaliy merged 1 commit into
mainfrom
2026-06-05-propose-fix-for-test-target-commands

Conversation

@chaliy

@chaliy chaliy commented Jun 5, 2026

Copy link
Copy Markdown
Contributor

Motivation

  • Integration tests were consolidated into a single integration test binary, which removed standalone Cargo test targets like spec_tests, proptest_differential, and coreutils_differential_tests, breaking CI and developer recipes that still invoked those targets.
  • Update all scripts and workflows to call the consolidated integration target with module filters so tooling and CI continue to run the same test modules without reintroducing separate binaries.

Description

  • Replace old standalone invocations with module-filtered calls to the consolidated harness, e.g. --test spec_tests → --test integration -- spec_tests::... and --test proptest_differential → --test integration -- proptest_differential::.
  • Patch .github/workflows/coreutils-args-drift.yml to run spec_tests::bash_spec_tests and coreutils_differential_tests:: via the integration binary.
  • Update developer justfile recipes to run spec_tests::bash_comparison_tests and proptest_differential:: through integration.
  • Update scripts/update-spec-expected.sh wrapper and doc comment to target integration with spec_tests::bash_comparison_tests and refresh the spec_tests module usage comment in crates/bashkit/tests/integration/spec_tests.rs.

Testing

  • Ran cargo test -p bashkit --features http_client,ssh,sqlite --test integration --no-run which completed successfully.
  • Listed integration modules with cargo test -p bashkit --test integration -- --list | rg '^(spec_tests::(bash_spec_tests|bash_comparison_tests)|proptest_differential::|coreutils_differential_tests::)' and verified expected modules are present.
  • Verified no remaining stale invocations using search commands against .github/workflows, justfile, and scripts and confirmed replacements removed the old targets.
  • Ran cargo fmt --check which passed.

Codex Task

Copilot AI review requested due to automatic review settings June 5, 2026 19:49

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR updates CI/workflows and developer scripts to target the consolidated Rust integration test harness (--test integration) using module filters, replacing now-removed standalone integration test binaries (e.g., spec_tests, proptest_differential, coreutils_differential_tests).

Changes:

  • Updated workflow and local tooling to invoke cargo test --test integration -- <module>::... for the same test subsets as before.
  • Refreshed the spec test module usage comment to document the new invocation pattern.
  • Adjusted scripts/recipes that previously referenced the old standalone test targets.

Reviewed changes

Copilot reviewed 4 out of 4 changed files in this pull request and generated 2 comments.

File Description
scripts/update-spec-expected.sh Switches wrapper to run spec_tests::bash_comparison_tests via the consolidated integration binary.
justfile Updates recipes to run spec/proptest integration modules through --test integration.
crates/bashkit/tests/integration/spec_tests.rs Updates module doc comment to reference the consolidated integration harness invocation.
.github/workflows/coreutils-args-drift.yml Updates workflow steps to run spec/coreutils drift-related tests via --test integration with module filters.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment on lines +65 to +67
cargo test --test integration -- spec_tests::bash_comparison_tests --ignored --nocapture 2>&1
else
cargo test --test spec_tests -- bash_comparison_tests --ignored 2>&1
cargo test --test integration -- spec_tests::bash_comparison_tests --ignored 2>&1
Comment thread justfile
Comment on lines 56 to +58
# Generate comprehensive compatibility report
compat-report:
cargo test --test spec_tests -- compatibility_report --ignored --nocapture
cargo test --test integration -- spec_tests::bash_comparison_tests --ignored --nocapture
@cloudflare-workers-and-pages

cloudflare-workers-and-pages Bot commented Jun 5, 2026 •

Copy link
Copy Markdown

Deploying with  Cloudflare Workers  Cloudflare Workers

The latest updates on your project. Learn more about integrating Git with Workers.

Status Name Latest Commit Preview URL Updated (UTC)
✅ Deployment successful!
View logs
bashkit 4001e2a Commit Preview URL Jun 05 2026, 08:21 PM

@chaliy
chaliy merged commit f1b03dd into main Jun 5, 2026
26 checks passed
@chaliy
chaliy deleted the 2026-06-05-propose-fix-for-test-target-commands branch June 5, 2026 20:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants