Skip to content

Model server: loopback by default, Caddy opt-in, nginx guide - #111

Merged
architsharm merged 1 commit into
mainfrom
claude/model-server-nginx
Oct 15, 2026
Merged

architsharm merged 1 commit into
mainfrom
claude/model-server-nginx

Conversation

@architsharm

Copy link
Copy Markdown
Owner

Follow-up to #110, which merged just before this commit was pushed.

A machine that already runs nginx for other sites owns ports 80 and 443, so the bundled Caddy can't start there (and would fight nginx for the ports).

  • The model server binds 127.0.0.1:8090 only.
  • Caddy runs only with docker compose --profile caddy up -d, for machines with no proxy of their own.
  • The guide adds an nginx server block: keep-alive upstream, and certbot for TLS via the HTTP-01 challenge on the A record.
  • It also notes that the name can be a subdomain of any domain you control, including one whose site is on Vercel.

Checked with docker compose config: by default only models runs, on 127.0.0.1; --profile caddy adds caddy. Deploy files only; no src/ changes.

🤖 Generated with Claude Code

A machine that already runs nginx for other sites owns ports 80 and 443, so
the bundled Caddy could not start there. The model server now binds
127.0.0.1:8090 and Caddy runs only with --profile caddy. The guide gives an
nginx server block (keep-alive upstream, certbot for TLS), and says the name
can be a subdomain of any domain you control, including one whose site is
hosted on Vercel.

Co-Authored-By: Claude <noreply@anthropic.com>
@vercel

vercel Bot commented Oct 15, 2026 •

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated
guardrails-api Ready Ready Preview Oct 15, 2026 10:38am UTC
guardrails-dashboard Ready Ready Preview Oct 15, 2026 10:38am UTC
guardrails-redteam-lang Ready Ready Preview Oct 15, 2026 10:38am UTC

This branch was successfully deployed

3 active deployments
Preview – guardrails-api — e84a09c2 Deployed Oct 15, 2026 by vercel[bot]
Preview – guardrails-redteam-lang — e84a09c2 Deployed Oct 15, 2026 by vercel[bot]
Preview – guardrails-dashboard — e84a09c2 Deployed Oct 15, 2026 by vercel[bot]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant