Providers
In Admin, open Inference → Providers. A provider is where the gateway forwards traffic. For each record you can set OpenAI-compatible, Anthropic, and Gemini base URLs, plus a shared API Key (usually masked after save).
What to do in Admin
Section titled “What to do in Admin”- In the sidebar under Inference, open Providers.
- Create or edit: set id, display name, per-protocol base URLs (follow upstream docs for
/v1and similar paths), API Key, optional notes. - Import from catalog: use the built-in catalog to pre-fill endpoints; you still need a valid API Key.
- After saving, go to Routing to bind models to this vendor and protocol; use Playground or Simulator to validate connectivity.
- Wrong base URLs often show up as 404/401 — double-check upstream docs.
- This screen does not include a one-click connectivity test; validate via routes + Playground / Simulator.
- When upstream rotates keys, update them here and save.
Automation
Section titled “Automation”For bulk changes from your backend, use the admin HTTP API — see the GitHub technical reference.