Skip to content

docs: clarify eval policy quickstart#7

Merged
aryeko merged 1 commit into
mainfrom
docs/eval-policy-quickstart
Jul 3, 2026
Merged

docs: clarify eval policy quickstart#7
aryeko merged 1 commit into
mainfrom
docs/eval-policy-quickstart

Conversation

@aryeko

@aryeko aryeko commented Jul 3, 2026

Copy link
Copy Markdown
Contributor

Motivation

Phase 1 clarifies the global eval policy for eval-kit consumers so CI remains fast, offline, and structural while deterministic semantic suites stay local on-demand and Promptfoo/Codex model-assisted evals remain manual/advisory.

Scoped changes

  • Document the three eval lanes across quickstart, integration, reference, design, examples, and skills docs.
  • Update consumer shell examples to use pnpm exec eval-kit while keeping package scripts on plain eval-kit.
  • State that run-producing/model-assisted evals are not default CI gates.
  • Keep the bootstrap doctor contract accurate by separating suite validation checks from CI policy guidance.

Verification

  • pnpm format
  • pnpm check
  • git diff --check

Approved local commit: 75c027ec4787c185c32f5738fe3e957703b4c1b4.

@aryeko aryeko merged commit 7160ab3 into main Jul 3, 2026
1 check passed
@aryeko aryeko deleted the docs/eval-policy-quickstart branch July 3, 2026 19:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant