Skip to content

Recipe 45: Memory reconciliation #45

Closed

Description

@CompleteDotTech

Recipe 45 of 60 · Level 4 (Advanced) · Memory & context · Choice

Use case

Classify a new memory statement as corroborating, superseding, contradicting, or unrelated to existing evidence so a versioned store can preserve provenance and unresolved conflicts.

What to build

The folder recipes/45-memory-reconciliation/ with notebook.ipynb, README.md, and fixtures/, meeting the recipe contract. Start from python tools/new_recipe.py 45 and the template in recipes/_template/.

Build notes

  • Outcomes: corroborating, superseding, contradicting, unrelated.
  • A versioned store in Python keeps provenance and unresolved conflicts. It never deletes.
  • Tests cover the store's invariants.

Decision design

  • Choice. Options are a fixed set supplied by Python, including the fallback outcome this use case names. Show the choice, the per-option probabilities, and the confidence for individual examples before aggregating.

Level 4 scope

Stateful workflows, provenance, adversarial cases, model calibration, or several integrated decision stages.

Acceptance criteria

  • recipes/45-memory-reconciliation/notebook.ipynb runs top to bottom offline, with no key and no network, and its outputs are committed
  • Live mode is opt-in (JEV_COOKBOOK_LIVE=1 with TYPESAFE_API_KEY) and uses the same question definitions as the offline run
  • Fixtures are synthetic, include the hard cases named in the build notes, carry gold labels, and pass the fixture validator
  • Every response fixture records its provenance, and the notebook states which mode it ran in
  • Evaluation: Label accuracy, and the store invariant tests.
  • State, provenance, or policy rules are enforced in helpers.py and covered by tests that hold for any model answer
  • Fixtures include adversarial, conflicting, or stateful cases, and the notebook walks through at least one
  • No statement about Jev's quality, latency, or cost appears without recorded live inference; in a synthetic run, metrics are labelled as pipeline checks
  • recipes/45-memory-reconciliation/README.md says what the recipe teaches, how to run it, and what was and was not measured live
  • The pull request changes only recipes/45-memory-reconciliation/ and CI is green

Dependencies

Sources

Read these before writing the questions.

Out of scope

  • Changes to shared code, the catalog, or the root README. If the shared package is missing something, open a foundation issue and link it here.
  • Real side effects of any kind. Actions are simulated.

Activity

  1. added this to the M4 · Advanced milestone on Oct 6, 2026
  2. added
    type: recipeA cookbook notebook recipe
    level: 4 advancedStateful workflows, provenance, adversarial cases, calibration
    size: LTwo to three days; consider splitting the work
    status: blockedWaiting on the issues listed under Dependencies
    needs: simulatorDepends on the simulation and state primitives
    on Oct 6, 2026
  3. added
    status: readyNo open blockers; can be picked up
    and removed
    status: blockedWaiting on the issues listed under Dependencies
    on Oct 13, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    cat: memory & contextCategory: Memory & contextdecision: choiceUses a Choice questionlevel: 4 advancedStateful workflows, provenance, adversarial cases, calibrationneeds: simulatorDepends on the simulation and state primitivespriority: p2Scheduled after p1 worksize: LTwo to three days; consider splitting the workstatus: readyNo open blockers; can be picked uptype: recipeA cookbook notebook recipe

    Type

    No type

    Projects

    No projects

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions