Skip to content

Providers

In Admin, open Inference → Providers. A provider is where the gateway forwards traffic. For each record you can set OpenAI-compatible, Anthropic, and Gemini base URLs, plus a shared API Key (usually masked after save).

  1. In the sidebar under Inference, open Providers.
  2. Create or edit: set id, display name, per-protocol base URLs (follow upstream docs for /v1 and similar paths), API Key, optional notes.
  3. Import from catalog: use the built-in catalog to pre-fill endpoints; you still need a valid API Key.
  4. After saving, go to Routing to bind models to this vendor and protocol; use Playground or Simulator to validate connectivity.
  • Wrong base URLs often show up as 404/401 — double-check upstream docs.
  • This screen does not include a one-click connectivity test; validate via routes + Playground / Simulator.
  • When upstream rotates keys, update them here and save.

For bulk changes from your backend, use the admin HTTP API — see the GitHub technical reference.