OrcaRouter's overview
OrcaRouter is an AI gateway designed for developers and businesses, providing a single OpenAI compatible endpoint for adaptive routing, load balancing, and governance across 200+ models.
What You Can Do With OrcaRouter
- Adaptive Routing — Route prompts intelligently to the best model per request, with zero token markup and up to 40% lower cost.
- Smart Failover — Automatically retry requests against a healthy model when a provider rate limits or experiences an outage, ensuring high availability.
- Versioned Prompts — Version prompts behind named labels with A/B splits and one-click rollback, without requiring a redeploy.
- Guardrails and Budgets — Enforce guardrails, budgets, and an agent firewall that blocks requests before they are billed, with anomaly detection and risk scoring.
- Transparent Logging — See and prove every call, including cost, model, latency, and why, with full structured logs that can be filtered, replayed, and copied as a runnable cURL.
- Customizable Routing — Express routing as code, with version-controlled and reviewable rules that can be live in seconds, without requiring a redeploy.
OrcaRouter's Key Features
🔥 Adaptive Routing
⚡️ Load Balancing
✨ Guardrails
🚀 Observability
OrcaRouter's FAQ
What is OrcaRouter and what does it do?
OrcaRouter is an AI gateway that provides adaptive LLM routing and governance, allowing users to route prompts intelligently across 200+ models with features like load balancing, guardrails, and observability.
How does OrcaRouter handle provider outages and rate limits?
OrcaRouter retries requests against a healthy model when a provider rate limits or experiences an outage, ensuring that transient upstream outages do not surface to users.
What is the pricing model for OrcaRouter?
OrcaRouter adds $0 per token, and users pay each provider their exact price, with costs shown in a glass box receipt that includes the grade, chosen model, provider, latency, and price.
Can I use OrcaRouter with my existing SDK and tools?
Yes, OrcaRouter is OpenAI compatible and can be used with existing SDKs and tools, including Google GenAI SDK, Anthropic SDK, and LangChain, with no code changes needed beyond setting the base URL to api.orcarouter.ai/v1.
What security and compliance features does OrcaRouter offer?
OrcaRouter offers guardrails, budgets, and an agent firewall, as well as independently audited compliance with GDPR, SOC 2, HIPAA, and ISO/IEC 27001:2022, with audit reports available under NDA.