Skip to content

Epic: Systematic bug finding with generated oracles #36

Open
5 of 6 issues completed
Open

Description

@CaffeinatedCoder

Goal

Find bugs systematically instead of one at a time. Every documented promise is a claim with a test that holds it, every public member is covered by a claim or waived with a reason, and every oracle is proven able to fail by a seeded defect. What's missing is a worklist rather than something nobody noticed.

In scope and out of scope

In scope: the machinery (#37), holding the unheld claims (#52), and re-extracting claims when a document changes.

Out of scope: fixing what it finds. Each finding is registered in test/oracles/candidates.json against a bug with found-by/oracle plus package/*, area/* and severity/* labels. It belongs to the release epic it ships in (silent ones to the next major), not to this epic. The fixing commit carries the Found-By: OT trailer.

Done when

The machinery is merged and documented, every claim is held or deliberately left open with a reason, and every candidate has a filed issue.

Metadata

Metadata

Assignees

No one assigned

    Labels

    epicTracks a release or a theme; its sub-issues are the worktestsAdds or changes tests only (oracles, harnesses); no library code

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions