Repository navigation
test(stellar): stabilize fuzz harness and add PR sample - #260
Conversation
- Increase testTimeout to 60 minutes to accommodate 100k-run fuzz campaign - Add test:fuzz:sample script with fixed seed for quick PR checks - Add onFailure callback to print seed and replay instructions on failure - Update CI to run sample on PRs, keep full campaign scheduled nightly
|
@boalambo Great news! 🎉 Based on an automated assessment of this PR, the linked Wave issue(s) no longer count against your application limits. You can now already apply to more issues while waiting for a review of this PR. Keep up the great work! 🚀 |
truthixify
left a comment
There was a problem hiding this comment.
The bounded PR fuzz sample passes all 12 property tests and keeps the large run in nightly CI. Approved.
truthixify
left a comment
There was a problem hiding this comment.
Two regressions remain in the harness change. package.json now contains duplicate test:leak keys, so one definition is silently discarded. Also onFailure is not a fast-check Parameters option, so the new callback is ignored and does not print the promised replay command. Remove the duplicate script and use fast-check's supported reporter/run-details API (including seed and counterexample path) with a deliberately failing test that proves the replay output is emitted.
- Remove duplicate test:leak script in package.json - Replace invalid onFailure callback with valid reporter parameter - Add FC_PATH support for replay with counterexample path - Add proof test (gated by FC_PROOF_TEST env var) to demonstrate replay output - Add explicit type annotation to proof test parameter
Fixed in 2c5ecfe. Removed the duplicate |
truthixify
left a comment
There was a problem hiding this comment.
The revision removes the duplicate script, replaces the unsupported fast-check onFailure option with a valid reporter, and carries seed plus counterexample path into replay. The fixed-seed sample (12 properties), build, and public type tests all pass locally.
Summary
Stabilizes the Stellar property fuzz harness and adds a quick sample for pull request checks.
Changes
✅ Fix scheduled fuzz timeout
testTimeoutfrom 20 minutes to 60 minutes invitest.config.ts✅ Add PR sample test
test:fuzz:samplescript runs 100 iterations with fixed seed12345✅ Failure replay instructions
onFailurecallback to print the failing seed and exact replay command✅ Update CI workflow
pnpm test:fuzz:sampleafter the main test suiteTesting
The changes have been implemented and committed. The CI will verify:
Related Issue
Closes #247