You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
When PAIR omits context_length (uncertain capacity), the client substitutes /api/show metadata or a 32,768 fallback, which may exceed the actual runtime capacity.
Evidence
codex-rs/local/models/src/lib.rs:46-47FALLBACK_CONTEXT_WINDOW = 32_768; lib.rs:104 calls /api/show for Ollama-shaped entries lacking context_length; v1.rs:40 parses context_length as optional.
Proposal
Preserve the uncertainty: use an explicit safe limit or validated runtime capacity instead of the metadata/32k substitute when PAIR omits the field.
Acceptance criteria
Test: PAIR omits context_length while the loaded window is smaller than 32,768; the client does not advertise a window larger than the safe/validated limit.
Behaviour with context_length present is unchanged.
Activity