inference-proxy

Here are 3 public repositories matching this topic...

LLM-4-People / millivolt

Self-hosted OpenAI-compatible inference proxy with a live dashboard, SQLite history, routing controls, and operator tooling. See every AI request and keep your own keys and routing.

golang dashboard sqlite self-hosted observability openai-api anthropic llm-proxy ai-gateway llm-observability mcp-server openai-compatible inference-proxy

Updated Oct 23, 2026
Go

connortessaro / phantom-api

Star

Anonymous AI inference proxy. Pay any crypto, get an OpenAI-compatible API key.

python privacy ai cryptocurrency fastapi confidential-computing openai-api llm inference-proxy

Updated May 27, 2026
Python

freellms / free-ai-proxy-gateway

Star

Free AI proxy gateway — route requests across 30+ LLM providers (Groq, Gemini, Mistral, Cohere, OpenRouter, NVIDIA NIM) through one OpenAI-compatible endpoint. Build your own LLM proxy, AI router, and multi-provider gateway. Failover & load balancing.

Updated Aug 10, 2026

Add this topic to your repo

To associate your repository with the inference-proxy topic, visit your repo's landing page and select "manage topics."

Learn more