Skip to content

TUI.md

Latest commit

 

History

History
80 lines (60 loc) · 2.67 KB

TUI.md

File metadata and controls

80 lines (60 loc) · 2.67 KB
Raw

Terminal cockpit (sndr tui)

The cockpit is the friendliest way to drive SNDR Core: one keyboard screen that shows what's running and lets you serve, stop, chat and diagnose — no commands to memorise.

sndr tui

If you prefer the web UI instead, that is sndr up then sndr open. The cockpit is the no-browser, SSH-friendly equivalent.

The cockpit needs the optional tui extra (the Textual library). If it isn't installed, sndr tui prints a one-line install hint and exits cleanly — never a traceback:

pip install 'sndr-platform[tui]'

What you see

Four panes on one screen:

Pane Shows
Engine / health Is a model serving? Live tok/s, KV-cache %, TTFT, running/waiting requests.
Catalog Every preset, ranked, with a ✓ (fits your GPUs) or ✗ (doesn't) — the same ranking sndr and sndr run use.
GPU / rig The detected card(s): count, VRAM, compute capability.
Log A rolling status line for what you just did.

Keys

Key Does
↑ / ↓ Move the catalog cursor
Enter Serve the selected preset (asks to confirm, then pulls if needed + launches; watch the engine pane come up)
k Stop the selected preset's engine (asks to confirm)
d Doctor — full system diagnostic (drops to the terminal, returns to the cockpit on exit)
c Chat with the running engine (drops to the terminal, returns on exit)
s Settings — set your model directory + Hugging Face token (applied now and remembered for next time)
/ Filter the catalog — type to narrow by preset id (case-insensitive substring), Esc to clear
r Refresh the engine + catalog
? Help overlay
q Quit

Serve and stop always ask to confirm first — pressing a key never silently launches or kills a container.

Beginner mode

New to all this? Hide the operator detail and keep just the essentials — the catalog (what can I run) and the engine status:

sndr tui --lean

No GPU on this box?

The cockpit still opens — plan against a card you don't have, to see what would fit:

sndr tui --fake-gpus 'RTX A5000:24564:8.6'

Or plan against a named builtin rig definition instead of the detected hardware (offline — e.g. for a demo on a GPU-less box):

sndr tui --rig a5000-2x-24gbvram-16cpu-128gbram

Next