Repository navigation

feat: build llm eval framework - #119

Merged

tsengwoody merged 12 commits into

mainfrom

Aug 6, 2026

Merged

feat: build llm eval framework#119
tsengwoody merged 12 commits into
mainfrom
feat/llm-eval

Commits on May 13, 2026
- feat: rename eval to eval_legacy and add new evals FEATURE.md
  SimoneCheng
  committed
  a7df9ea
- feat: write first version of llm evals
  SimoneCheng
  committed
  b37853d
- refactor: refactor provider and promptfooconfig in evals
  SimoneCheng
  committed
  5c5b703
Commits on May 28, 2026
- feat: add promptfoo python assertions
  SimoneCheng
  committed
  c4ff0b3
Commits on Jun 5, 2026
- feat: switch promptfoo eval scoring to F2
  SimoneCheng
  committed
  0739d91
Commits on Jun 26, 2026
- feat: add eval cost tracking and local cost estimates
  SimoneCheng
  committed
  9c5f1a8
- test: align provider and integration tests with current OpenAI setup
  SimoneCheng
  committed
  1070316
Commits on Jul 10, 2026
- feat: generate dataset and build evaluation pipeline
  SimoneCheng
  committed
  b9c96cd
Commits on Jul 31, 2026
- feat: update dataset correctness
  SimoneCheng
  committed
  1245b15
Commits on Aug 5, 2026
- feat: update testing OpenAI model to 5.6 luna
  SimoneCheng
  committed
  cda093a
- doc: write document for evals
  SimoneCheng
  committed
  1467e10
- Merge branch 'main' into feat/llm-eval
  SimoneCheng
  committed
  64d5c1e