[whyKirbyy]

Router submission: Corealis Router

Leaderboard name: Corealis Router. Affiliation: Corealis Consulting AG (https://corealis.ch). The file name corealis-router is only the prediction key.

Corealis Router (Corealis Consulting AG) is the router behind Corealis AI. A small router model (typesafe/jev-1.14) reads each request and picks one of three models: GLM-5.3, GLM-5.3 Flash or DeepSeek V4.1 Flash. It then picks how much the chosen model thinks. The @low / @high / @default suffix is that reasoning effort. This is the production version from 2026-10-22, run once on all 8,400 prompts through OpenRouter.

How it routes. The router is prompted, not trained. Its instructions are neutral ("pick the cheapest model that will answer it correctly"), and the model descriptions are written from size and price only. No RouterArena answers, scores or labels were used to fit the router.

Disclosure. Before freezing this version, we scored two earlier versions of our own router on a random quarter of RouterArena and on half of Arena-Hard v2.0. We chose this general version over the earlier one partly on those results. We also read other routers' published prediction files. Nothing was tuned per question or per dataset. Please let us know if you consider this out of bounds.

Files

• router_inference/config/corealis-router.json: the 5-entry pool (3 models × effort)
• router_inference/predictions/corealis-router.json: 8,400 rows with generated_result
• router_inference/predictions/corealis-router-robustness.json: 420 rows, picks only, from a real re-run on the perturbed prompts
• model_cost/model_cost.json: the 5 entries added at the cheapest OpenRouter list prices (USD per 1M tokens). Existing entries are untouched.
• universal_model_names.py: the same 5 names added

Local check. check_config_prediction_files.py passes for full and robustness. Local llm_evaluation/run.py: accuracy 74.85%, $0.79 per 1K queries, score 71.9, robustness 0.95. 78 prompts returned an empty answer (the chosen model hit its thinking limit). They are kept as failed generations (success: false).

Closed-source router. Contact: tim.schmid@corealis.ch

[whyKirbyy]

/evaluate

[github-actions]

Router Evaluation Results

Router: corealis-router
Dataset Split: full

RouterArena Metrics

Metric	Value
RouterArena Score	0.7191
Accuracy	74.85%
Total Cost	$6.637140
Avg Cost per Query	$0.000790
Avg Cost per 1K Queries	$0.7901
Number of Queries	8400
Abnormal Entries	78
Robustness Score	0.9500

⚠️ 78 of 8400 queries (0.9%) had no valid generation (inference failed / empty answer) and were scored as incorrect (0). These queries still count toward the denominator, so accuracy and cost reflect the full query set. Please regenerate predictions for these queries and resubmit for a complete evaluation.

---

Evaluation completed by RouterArena automated workflow