One Tokaroo key
Authenticate from a server or trusted harness. Permanent keys never belong in browser or mobile bundles.
Tokaroo product
One API key. Five intelligent models. Every major provider.
Your application asks Tokaroo for Max, Pro, Auto, Fast, or Basic. Tokaroo makes the optimized routing decision, handles compatible fallback, meters the result, and returns the response in the format your software expects.
The product boundary
Tokaroo routes intelligence. Your software stays in control.
Keep your application, agent harness, tools, files, and execution environment. Replace separate model accounts and provider-specific routing code with one managed connection.
Five model names
Choose the result you need instead of maintaining a catalog of vendor model IDs.
Optimized routing
Tokaroo weighs compatibility, measured quality, price, speed, health, and availability across its managed provider network.
Clear usage
See the requested Tokaroo mode, token counts, latency, charge, balance, and aggregate benchmark savings.
Five virtual models
Choose the operating mode, not the vendor.
Quality ratios compare candidates with the best freshly measured route for the task family. They are routing thresholds, not statistical percentiles.
Max
The hardest and highest-stakes work where capability is the first requirement.
95% of ceiling fallback quality floor
Pro
Serious daily technical, business, production, and customer-facing work.
85% of ceiling fallback quality floor
Auto
The default for applications that want Tokaroo to make the whole routing decision.
50% of ceiling fallback quality floor
Fast
Rapid answers, edits, extraction, and interactive back-and-forth.
50% of ceiling fallback quality floor
Basic
Everyday questions and routine tasks where you need an answer, not a project.
No relative quality floor
The percentages are conservative fallback floors. With enough fresh, diverse evaluations, Tokaroo derives task-specific quality bands dynamically and optimizes inside the qualifying basket.
Classify the work
Quality is measured separately for reasoning, code, math, reading, writing, tools, multilingual, and spatial work.
Set the ceiling
The best fresh measured output in that task family becomes the 100% quality ceiling.
Build the basket
Only compatible candidates clearing the requested mode's quality checks enter its decision basket.
Optimize the route
Tokaroo then weighs speed, price, reliability, context, tools, and availability inside that basket.
General chat and reasoning
Awaiting fresh evidence | Conservative fallback floors
- ceiling0 freshly tested0 decision-grade0 provider families
Max0measured candidates95% of ceiling fallback quality floor
Pro0measured candidates85% of ceiling fallback quality floor
Auto0measured candidates50% of ceiling fallback quality floor
Fast0measured candidates50% of ceiling fallback quality floor
Basic0measured candidatesNo relative quality floor
Code and tool work
Awaiting fresh evidence | Conservative fallback floors
- ceiling0 freshly tested0 decision-grade0 provider families
Max0measured candidates95% of ceiling fallback quality floor
Pro0measured candidates85% of ceiling fallback quality floor
Auto0measured candidates50% of ceiling fallback quality floor
Fast0measured candidates50% of ceiling fallback quality floor
Basic0measured candidatesNo relative quality floor
Math and quantitative reasoning
Awaiting fresh evidence | Conservative fallback floors
- ceiling0 freshly tested0 decision-grade0 provider families
Max0measured candidates95% of ceiling fallback quality floor
Pro0measured candidates85% of ceiling fallback quality floor
Auto0measured candidates50% of ceiling fallback quality floor
Fast0measured candidates50% of ceiling fallback quality floor
Basic0measured candidatesNo relative quality floor
Reading and synthesis
Awaiting fresh evidence | Conservative fallback floors
- ceiling0 freshly tested0 decision-grade0 provider families
Max0measured candidates95% of ceiling fallback quality floor
Pro0measured candidates85% of ceiling fallback quality floor
Auto0measured candidates50% of ceiling fallback quality floor
Fast0measured candidates50% of ceiling fallback quality floor
Basic0measured candidatesNo relative quality floor
Writing and editing
Awaiting fresh evidence | Conservative fallback floors
- ceiling0 freshly tested0 decision-grade0 provider families
Max0measured candidates95% of ceiling fallback quality floor
Pro0measured candidates85% of ceiling fallback quality floor
Auto0measured candidates50% of ceiling fallback quality floor
Fast0measured candidates50% of ceiling fallback quality floor
Basic0measured candidatesNo relative quality floor
Structured data and tool decisions
Awaiting fresh evidence | Conservative fallback floors
- ceiling0 freshly tested0 decision-grade0 provider families
Max0measured candidates95% of ceiling fallback quality floor
Pro0measured candidates85% of ceiling fallback quality floor
Auto0measured candidates50% of ceiling fallback quality floor
Fast0measured candidates50% of ceiling fallback quality floor
Basic0measured candidatesNo relative quality floor
Multilingual work
Awaiting fresh evidence | Conservative fallback floors
- ceiling0 freshly tested0 decision-grade0 provider families
Max0measured candidates95% of ceiling fallback quality floor
Pro0measured candidates85% of ceiling fallback quality floor
Auto0measured candidates50% of ceiling fallback quality floor
Fast0measured candidates50% of ceiling fallback quality floor
Basic0measured candidatesNo relative quality floor
Spatial reasoning
Awaiting fresh evidence | Conservative fallback floors
- ceiling0 freshly tested0 decision-grade0 provider families
Max0measured candidates95% of ceiling fallback quality floor
Pro0measured candidates85% of ceiling fallback quality floor
Auto0measured candidates50% of ceiling fallback quality floor
Fast0measured candidates50% of ceiling fallback quality floor
Basic0measured candidatesNo relative quality floor
Evaluation evidence is limited to successful Tokaroo tests in the latest 30-day window; imported zero-sample signals are excluded. Basket membership, the concrete serving model, the serving provider, and private settlement cost remain internal.
Compatible by design
Four wire formats cover modern applications and harnesses.
Use Tokaroo directly or point an existing provider client at the matching base URL. LangChain and the Vercel AI SDK are optional client channels, not gateway dependencies.
Direct REST
Native HTTP, JSON, server-sent events, and WebSocket routes.
OpenAI-compatible
Use existing OpenAI clients with a base URL and key change.
Anthropic-compatible
Messages, tool use, streaming, and token counting for Claude-oriented clients.
Gemini-compatible
GenerateContent, streamGenerateContent, and countTokens.
Current model and provider families
GPT / OpenAIClaude / AnthropicGemini / GoogleGroqKimi / MoonshotDeepSeekQwen / AlibabaGrok / xAIOpenRouterMistralLlamaCohereAugure AIInterfaze AIRaspy multimodal
The researched catalog changes as availability, verified pricing, and compatibility change. Your five Tokaroo model names remain stable.
Production routing
The decision and the accounting travel together.
A useful router must do more than proxy a response. Tokaroo owns the route decision, compatible retry path, and request ledger.
Compatibility before scoring
Candidates must support the request's wire, tools, context, modality, and output constraints before they can be ranked.
Health-aware fallback
Unhealthy or incompatible routes are excluded, and eligible provider fallback is handled behind the same response format.
Fresh measurements
Quality, latency, reliability, and verified price inputs inform optimized routing instead of a static vendor list.
One usage ledger
Tokaroo mode, charge, tokens, latency, and aggregate benchmark savings are recorded against the key and workspace.
Stable model contract
Applications ask for one of five Tokaroo modes while the underlying provider catalog can improve without application changes.
Harness-aware affinity
Native model families can be preferred for proven tool loops, but only inside the selected quality band and without removing compatible fallback.
Proven in real systems
Gwen demonstrates orchestration. Raspy extends the route beyond text.
These products clarify Tokaroo's role without turning Tokaroo into a hosted harness platform.
Gwen reference application
Gwen selects and runs agent harnesses, then sends their model traffic through Tokaroo. Gwen owns orchestration and execution; Tokaroo owns optimized model routing, fallback, and metering.
Raspy multimodal rail
Tokaroo routes speech, transcription, realtime audio, and avatars through Raspy. Images and video use compatible routes from the broader model network.
One key. Five intelligent models. Every major provider.
Start with Auto and let Tokaroo make the routing decision.