Handles routing, failover, budgets, rate limits, guardrails and logging in one place, so model access is governed centrally, not by each team. An API gateway routes HTTP and knows nothing of tokens, models or prompts.
See how this works in practice
The console shows the mechanism rather than describing it.