Skip to content

Add KV-cache quantization (kv_bits 8|4), golden-gated against mlx-lm - #34

Merged
hvasconcelos merged 1 commit into
masterfrom
kv-cache-quantization
Jun 11, 2026
Merged

hvasconcelos merged 1 commit into
masterfrom
kv-cache-quantization

Add KV-cache quantization (kv_bits 8|4), golden-gated against mlx-lm

8d2fea9
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 warning

The logs for this run have expired and are no longer available.