Skip to content

Recipe 33: Schema field mapping #33

Closed

Description

@CompleteDotTech

Recipe 33 of 60 · Level 3 (Intermediate) · Data quality & knowledge graphs · Choice

Use case

Map source field descriptions to a bounded target schema with ambiguous and unmapped outcomes before Python validates the proposed mappings.

What to build

The folder recipes/33-schema-field-mapping/ with notebook.ipynb, README.md, and fixtures/, meeting the recipe contract. Start from python tools/new_recipe.py 33 and the template in recipes/_template/.

Build notes

  • One Choice per source field over a bounded set of target fields plus ambiguous and unmapped.
  • Python validates the proposed mapping: type compatibility and one-to-one constraints, with conflicts reported.
  • Include fields with misleading names and correct descriptions.

Decision design

  • Choice. Options are a fixed set supplied by Python, including the fallback outcome this use case names. Show the choice, the per-option probabilities, and the confidence for individual examples before aggregating.

Level 3 scope

Multiple judgments or stages, structured evidence, deterministic composition, and task-level evaluation.

Acceptance criteria

  • recipes/33-schema-field-mapping/notebook.ipynb runs top to bottom offline, with no key and no network, and its outputs are committed
  • Live mode is opt-in (JEV_COOKBOOK_LIVE=1 with TYPESAFE_API_KEY) and uses the same question definitions as the offline run
  • Fixtures are synthetic, include the hard cases named in the build notes, carry gold labels, and pass the fixture validator
  • Every response fixture records its provenance, and the notebook states which mode it ran in
  • Evaluation: Mapping accuracy and the number of conflicts caught by validation.
  • The deterministic composition lives in a Python function with tests in tests/
  • Evaluation is at task level, not only per question
  • No statement about Jev's quality, latency, or cost appears without recorded live inference; in a synthetic run, metrics are labelled as pipeline checks
  • recipes/33-schema-field-mapping/README.md says what the recipe teaches, how to run it, and what was and was not measured live
  • The pull request changes only recipes/33-schema-field-mapping/ and CI is green

Dependencies

Sources

Read these before writing the questions.

Out of scope

  • Changes to shared code, the catalog, or the root README. If the shared package is missing something, open a foundation issue and link it here.
  • Real side effects of any kind. Actions are simulated.

Metadata

Metadata

Assignees

No one assigned

    Labels

    cat: data quality & graphsCategory: Data quality & knowledge graphsdecision: choiceUses a Choice questionlevel: 3 intermediateMultiple judgments or stages with deterministic compositionpriority: p2Scheduled after p1 worksize: MAbout a daystatus: blockedWaiting on the issues listed under Dependenciestype: recipeA cookbook notebook recipe

    Type

    No type

    Projects

    No projects

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions