Repository navigation
Recipe 49: Multi-agent task assignment #49
Copy link
Copy link
Closed
Labels
cat: agent orchestrationCategory: Agent orchestrationCategory: Agent orchestrationdecision: scoreUses a Score questionUses a Score questionlevel: 4 advancedStateful workflows, provenance, adversarial cases, calibrationStateful workflows, provenance, adversarial cases, calibrationpriority: p2Scheduled after p1 workScheduled after p1 worksize: LTwo to three days; consider splitting the workTwo to three days; consider splitting the workstatus: readyNo open blockers; can be picked upNo open blockers; can be picked uptype: recipeA cookbook notebook recipeA cookbook notebook recipe
Milestone
Description
Recipe 49 of 60 · Level 4 (Advanced) · Agent orchestration ·
Score
Use case
Score each agent's suitability for a subtask so a deterministic scheduler can assign work under capability, dependency, and budget constraints.
What to build
The folder recipes/49-multi-agent-task-assignment/ with notebook.ipynb, README.md, and fixtures/, meeting the recipe contract. Start from python tools/new_recipe.py 49 and the template in recipes/_template/.
Build notes
- One suitability Score per agent and subtask pair.
- A deterministic scheduler assigns work under capability, dependency, and budget constraints.
- A test shows constraints hold for any scores.
Decision design
- Score. Describe every rubric level in words, in order. Show the
scoreand the distribution over levels. Mapping, weighting, and arithmetic on scores happen in Python.
Level 4 scope
Stateful workflows, provenance, adversarial cases, model calibration, or several integrated decision stages.
Acceptance criteria
-
recipes/49-multi-agent-task-assignment/notebook.ipynbruns top to bottom offline, with no key and no network, and its outputs are committed - Live mode is opt-in (
JEV_COOKBOOK_LIVE=1withTYPESAFE_API_KEY) and uses the same question definitions as the offline run - Fixtures are synthetic, include the hard cases named in the build notes, carry gold labels, and pass the fixture validator
- Every response fixture records its provenance, and the notebook states which mode it ran in
- Evaluation: Assignment quality against gold, and the constraint test.
- State, provenance, or policy rules are enforced in
helpers.pyand covered by tests that hold for any model answer - Fixtures include adversarial, conflicting, or stateful cases, and the notebook walks through at least one
- No statement about Jev's quality, latency, or cost appears without recorded live inference; in a synthetic run, metrics are labelled as pipeline checks
-
recipes/49-multi-agent-task-assignment/README.mdsays what the recipe teaches, how to run it, and what was and was not measured live - The pull request changes only
recipes/49-multi-agent-task-assignment/and CI is green
Dependencies
- Blocked by Foundation: CI executes every notebook offline and validates fixtures #69 (CI executes every notebook offline and validates fixtures)
- Builds on Recipe 28: Skill selection #28 (Skill selection). Merge those first and reuse their patterns; do not copy their fixtures.
- Tracked in Epic: Level 4 · Advanced recipes #78
Sources
Read these before writing the questions.
- S02 · TypeSafe AI: Primitives (Questions): Choice, Noul, Score, independent questions, and dependent follow-up calls.
- S03 · TypeSafe AI: Confidence: Distribution-derived confidence and task-specific thresholds informed by observed outcomes.
- S04 · TypeSafe AI: How to build with TypeSafe: Narrow semantic judgments integrated with workflows, deterministic logic, and side effects controlled by code.
- S06 · TypeSafe AI: Cookbooks: Worked patterns for extraction, citation checking, skill selection, hierarchical classification, and feature discovery.
Out of scope
- Changes to shared code, the catalog, or the root README. If the shared package is missing something, open a foundation issue and link it here.
- Real side effects of any kind. Actions are simulated.
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
cat: agent orchestrationCategory: Agent orchestrationCategory: Agent orchestrationdecision: scoreUses a Score questionUses a Score questionlevel: 4 advancedStateful workflows, provenance, adversarial cases, calibrationStateful workflows, provenance, adversarial cases, calibrationpriority: p2Scheduled after p1 workScheduled after p1 worksize: LTwo to three days; consider splitting the workTwo to three days; consider splitting the workstatus: readyNo open blockers; can be picked upNo open blockers; can be picked uptype: recipeA cookbook notebook recipeA cookbook notebook recipe
Activity