Repository navigation
Recipe 33: Schema field mapping #33
Copy link
Copy link
Closed
Labels
cat: data quality & graphsCategory: Data quality & knowledge graphsCategory: Data quality & knowledge graphsdecision: choiceUses a Choice questionUses a Choice questionlevel: 3 intermediateMultiple judgments or stages with deterministic compositionMultiple judgments or stages with deterministic compositionpriority: p2Scheduled after p1 workScheduled after p1 worksize: MAbout a dayAbout a daystatus: blockedWaiting on the issues listed under DependenciesWaiting on the issues listed under Dependenciestype: recipeA cookbook notebook recipeA cookbook notebook recipe
Milestone
Description
Recipe 33 of 60 · Level 3 (Intermediate) · Data quality & knowledge graphs ·
Choice
Use case
Map source field descriptions to a bounded target schema with ambiguous and unmapped outcomes before Python validates the proposed mappings.
What to build
The folder recipes/33-schema-field-mapping/ with notebook.ipynb, README.md, and fixtures/, meeting the recipe contract. Start from python tools/new_recipe.py 33 and the template in recipes/_template/.
Build notes
- One Choice per source field over a bounded set of target fields plus
ambiguousandunmapped. - Python validates the proposed mapping: type compatibility and one-to-one constraints, with conflicts reported.
- Include fields with misleading names and correct descriptions.
Decision design
- Choice. Options are a fixed set supplied by Python, including the fallback outcome this use case names. Show the
choice, the per-optionprobabilities, and theconfidencefor individual examples before aggregating.
Level 3 scope
Multiple judgments or stages, structured evidence, deterministic composition, and task-level evaluation.
Acceptance criteria
-
recipes/33-schema-field-mapping/notebook.ipynbruns top to bottom offline, with no key and no network, and its outputs are committed - Live mode is opt-in (
JEV_COOKBOOK_LIVE=1withTYPESAFE_API_KEY) and uses the same question definitions as the offline run - Fixtures are synthetic, include the hard cases named in the build notes, carry gold labels, and pass the fixture validator
- Every response fixture records its provenance, and the notebook states which mode it ran in
- Evaluation: Mapping accuracy and the number of conflicts caught by validation.
- The deterministic composition lives in a Python function with tests in
tests/ - Evaluation is at task level, not only per question
- No statement about Jev's quality, latency, or cost appears without recorded live inference; in a synthetic run, metrics are labelled as pipeline checks
-
recipes/33-schema-field-mapping/README.mdsays what the recipe teaches, how to run it, and what was and was not measured live - The pull request changes only
recipes/33-schema-field-mapping/and CI is green
Dependencies
- Blocked by Foundation: CI executes every notebook offline and validates fixtures #69 (CI executes every notebook offline and validates fixtures)
- Tracked in Epic: Level 3 · Intermediate recipes #77
Sources
Read these before writing the questions.
- S02 · TypeSafe AI: Primitives (Questions): Choice, Noul, Score, independent questions, and dependent follow-up calls.
- S03 · TypeSafe AI: Confidence: Distribution-derived confidence and task-specific thresholds informed by observed outcomes.
- S06 · TypeSafe AI: Cookbooks: Worked patterns for extraction, citation checking, skill selection, hierarchical classification, and feature discovery.
Out of scope
- Changes to shared code, the catalog, or the root README. If the shared package is missing something, open a foundation issue and link it here.
- Real side effects of any kind. Actions are simulated.
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
cat: data quality & graphsCategory: Data quality & knowledge graphsCategory: Data quality & knowledge graphsdecision: choiceUses a Choice questionUses a Choice questionlevel: 3 intermediateMultiple judgments or stages with deterministic compositionMultiple judgments or stages with deterministic compositionpriority: p2Scheduled after p1 workScheduled after p1 worksize: MAbout a dayAbout a daystatus: blockedWaiting on the issues listed under DependenciesWaiting on the issues listed under Dependenciestype: recipeA cookbook notebook recipeA cookbook notebook recipe
Activity