One gateway. Every model. Your data stays yours.
Private inference on 200+ models, guarded on every call. Zero markup on pay-as-you-go and subscriptions. Or bring your own keys.
Live in 60 seconds.
- Point your SDK at us — Set base_url to api.orcarouter.ai/v1 and swap your API key. No other code changes needed.
- We route, guard and observe — Graded in under 1ms, with failover, caching and full logs built in.
- You ship, on one endpoint — Direct to each provider at their published rate — we add $0 per token.
Privacy, security and routing, answered.
Do you store or train on my prompts?
We never train on your prompts. Prompt and response bodies aren't logged unless logging is on for your workspace; we keep request metadata (time, model, tokens, cost, IP) for billing and security. A zero-retention agreement locks body logging off.
Where is my data processed?
By the provider that serves the model you pick, in that provider's regions. Your workspace's data-region setting (US, EU, UK, Asia-Pacific or China) tags your compliance reports with that region; it doesn't yet pin where your data is stored or where inference runs.
What does quantum-safe mean here?
Request logs you choose to keep can be sealed with hybrid post-quantum encryption (ML-KEM-768 + X25519), so a copy taken today can't be opened by a future quantum computer. The code is open source: SCUTTLE. Sealing is on by default on our hosted service.
What is an AI router?
An AI router sits between your app and many models and picks the best model for each request. OrcaRouter grades every prompt in under 1 ms and routes it — frontier for hard reasoning, open-source for routine — across 200+ models at zero token markup.
What is an LLM router and how does it work?
An LLM router classifies each prompt and matches it to the model most likely to answer well at the lowest cost. OrcaRouter routes on contextual embeddings with online learning from live traffic — 75.5% accuracy on the public RouterArena leaderboard.
Is OrcaRouter an AI gateway?
Yes. OrcaRouter is a production AI gateway: one OpenAI-compatible endpoint with adaptive routing, load balancing, automatic failover, guardrails, an agent firewall, prompt caching and per-request observability.
What is an AI CDN?
Like a CDN serves content from the best edge, an AI CDN serves inference from the best provider: healthy, fast, cheap capacity, cached repeated prompts, failover on outages. OrcaRouter plays this role across 200+ models.
What is adaptive routing?
Adaptive routing learns the quality/cost trade-off from your own traffic. Point each workspace at cheapest-that-clears-the-bar, highest quality, or balanced — or let orcarouter/auto keep tuning the choice per request.
Do I need both an AI gateway and an LLM router?
They solve different problems — governance vs model choice — but you don't need two systems: OrcaRouter routes per request and enforces budgets, guardrails and observability on the same hop.
Does routing add latency?
Prompt grading takes under 1 ms and total added latency stays under 50 ms — usually won back many times over by faster providers and cached prompt tokens.
Does OrcaRouter mark up token prices?
No. You pay each provider's published rate; OrcaRouter adds $0 per token and monetizes optional Team and Enterprise features.
Can I keep my existing OpenAI SDK code?
Yes — switch base_url to https://api.orcarouter.ai/v1 and your OpenAI, Anthropic or Google SDK code keeps working: Chat Completions, Responses, Embeddings, Images, Audio and streaming.
What happens when a provider goes down?
OrcaRouter retries against healthy fallback capacity for the same or an equivalent model before the response starts, so upstream outages don't surface to your users.