Repository navigation

feat(gateway): route and persist model experiments - #3325

Merged

markijbema merged 58 commits into

mainfrom

mark/experimental-models-gateway

May 25, 2026

Merged

feat(gateway): route and persist model experiments#3325
markijbema merged 58 commits into
mainfrom
mark/experimental-models-gateway

Commits on May 19, 2026
- feat(gateway): capture x-kilo-request and x-kilo-session headers
  Mark IJbema
  committed
  eff9e05
- refactor(gateway): extract buildDirectProvider used by custom_llm path
  Mark IJbema
  committed
  5f346c7
- feat(gateway): add experiment variant picker and routing-cache loader
  Mark IJbema
  committed
  59a7924
- feat(gateway): route experimented public ids to direct upstream
  Mark IJbema
  committed
  72dd511
- feat(r2): add experiment-prompts content-addressed storage helper
  Mark IJbema
  committed
  b81a5b1
- feat(gateway): persist experiment attribution after microdollar write
  Mark IJbema
  committed
  9bf9d4e
- chore(experiments): drop unused MicrodollarUsageContext import
  Mark IJbema
  committed
  ebceefb
- docs(plan): update experimental-models-1 status for PR #3325
  Mark IJbema
  committed
  4cc8df6
- fix(experiments): zero billable cost for provider-funded experiment traffic
  Mark IJbema
  committed
  3f9519c
- docs(plan): record stale membership cache as next-step follow-up
  Mark IJbema
  committed
  b7a4afa
- fix(experiments): refuse experiment routing when org disables data collection
  Mark IJbema
  committed
  a354d37
- fix(experiments): cache encrypted upstream; decrypt only on pick
  Mark IJbema
  committed
  e911597
- fix(experiments): cap prompt capture by UTF-8 bytes, not UTF-16 units
  Mark IJbema
  committed
  6757360
- test(experiments): cover picker, fail-closed paths, and UTF-8 truncation
  Mark IJbema
  committed
  986fde9
- fix(experiments): honor request-level data-collection opt-out
  Mark IJbema
  committed
  33b3baf
- chore(experiments): drop plan references from code comments
  Mark IJbema
  committed
  b6b1ebc
- chore(experiments): leave shared-with-main files for separate chore PR
  Mark IJbema
  committed
  810c76c
- revert(gateway): drop kilo-auto/free experimented-id safeguard
  Mark IJbema
  committed
  da9799e
- Merge remote-tracking branch 'origin/main' into mark/experimental-models-gateway
  Mark IJbema
  committed
  4d10fe0
- chore(experiments): drop unused barrel index.ts
  Mark IJbema
  committed
  0afa453
- Merge remote-tracking branch 'origin/main' into mark/experimental-models-gateway
  Mark IJbema
  committed
  afdbfba
Commits on May 20, 2026
- Merge remote-tracking branch 'origin/main' into mark/experimental-models-gateway
  Mark IJbema
  committed
  f4f2c99
- refactor(experiments): drop system-prompt split, plumb request_kind through capture
  Mark IJbema
  committed
  88de7c0
- refactor(gateway): make balance <= 0 the primary condition on the usage-limit guard
  Mark IJbema
  committed
  454afb8
- fix(experiments): backfill the experimented-public-ids redis cache on miss
  Mark IJbema
  committed
  9bdfbc2
- refactor(experiments): rename subjectPick → allocationSubject, fix lying 'unreachable' comment
  Mark IJbema
  committed
  0498dda
- fix(gateway): return usage identity for zero-cost inserts
  Mark IJbema
  committed
  e0fa122
- fix(gateway): use JS-side identity values to avoid Postgres timestamp format
  Mark IJbema
  committed
  0a54c02
- Merge remote-tracking branch 'origin/main' into mark/experimental-models-gateway
  Mark IJbema
  committed
  478473f
- refactor(gateway): extract experiment variant types
  Mark IJbema
  committed
  3f9e18c
- refactor(gateway): narrow experiment attribution catch
  Mark IJbema
  committed
  92012a2
- refactor(gateway): move prompt storage fallback
  Mark IJbema
  committed
  e5ec33a
- refactor(gateway): simplify prompt hash fallback
  Mark IJbema
  committed
  dd08383
- refactor(gateway): inline experiment attribution insert
  Mark IJbema
  committed
  8fb0a45
- refactor(gateway): remove prompt truncation breadcrumb
  Mark IJbema
  committed
  5f3ba98
- refactor(gateway): inline prompt capture serialization
  Mark IJbema
  committed
  09d6f77
- refactor(gateway): simplify experiment attribution guard
  Mark IJbema
  committed
  7107be8
- fix(web): require BYOK encryption key
  Mark IJbema
  committed
  0ea4021
- refactor(gateway): remove missing BYOK key branch
  Mark IJbema
  committed
  131a6a2
- refactor(gateway): cache experimented ids from Redis only
  Mark IJbema
  committed
  caf2002
Commits on May 21, 2026
- refactor(gateway): load experiment routing from Postgres
  Mark IJbema
  committed
  d404629
- test(gateway): avoid silent Redis membership skips
  Mark IJbema
  committed
  c6c5e08
- feat(gateway): expose active experiment models
  Mark IJbema
  committed
  705bafa
- feat(admin): show experiment request log
  Mark IJbema
  committed
  8a6bfc6
- fix(gateway): allow anonymous experiment models
  Mark IJbema
  committed
  5d728dc
- Merge remote-tracking branch 'origin/main' into mark/experimental-models-gateway
  Mark IJbema
  committed
  4e3350a
- refactor(gateway): treat experiment models as free models
  Mark IJbema
  committed
  a5b56b9
- chore(gateway): remove unrelated review changes
  Mark IJbema
  committed
  2d25fc8
- Merge remote-tracking branch 'origin/main' into mark/experimental-models-gateway
  Mark IJbema
  committed
  5502bc1
- refactor(gateway): fold experiment check into isFreeModel
  Mark IJbema
  committed
  b0e2971
- chore(gateway): revert unnecessary comment edits
  Mark IJbema
  committed
  7098d88
- fix(gateway): refuse experiments under enterprise allow-list
  Mark IJbema
  committed
  17b4afa
- fix(gateway): remove duplicate unfiltered experiment models
  Mark IJbema
  committed
  cd82c5b
- Merge remote-tracking branch 'origin/main' into mark/experimental-models-gateway
  Mark IJbema
  committed
  cb9f60d
- fix(gateway): split membership and isFreeModel out of models.ts
  Mark IJbema
  committed
  1eefb73
- Merge remote-tracking branch 'origin/main' into mark/experimental-models-gateway
  Mark IJbema
  committed
  f931536
Commits on May 25, 2026
- Merge branch 'main' into mark/experimental-models-gateway
  markijbema
  authored
  7bba29a
- docs(experiments): note response model-id leak as v1 followup
  Mark IJbema
  committed
  e4b1ca1

Commits

Commits on May 19, 2026

Commits on May 20, 2026

Commits on May 21, 2026

Commits on May 25, 2026