Validate option - #457

Open

zimmski wants to merge 5 commits into

mainfrom

validate-option

Commits on May 14, 2025

Create the result path directory first so we log everything into it
zimmski
committed
6f78708
Option to validate the configuration of the evaluation to also check if models still exist
zimmski
committed
cb0d224
Validate all models before exiting on an unknown model/provider
zimmski
committed
49465e2
Increase API request attempts for an LLM query to 10 (from 3) because that was our new default in v1.0
zimmski
committed
ed0cdec
Log which repositories got selected
zimmski
committed
e04225d