Compare AI gateways
Pick up to four platforms. Every cell shows a verification state, not a marketing claim — “not publicly documented” means we could not find an official source, not that the capability is missing. See our methodology.
| Capability | AZAzure API Management AI Gateway |
|---|---|
| Security | |
| Prompt-injection detectionIdentifies attempts to override system instructions in prompts or tool output. | LimitedLimited. Partially documented.Delivered by integrating Azure AI Content Safety, not by the gateway itself. |
| Prompt-injection blockingBlocks the request before it reaches the model, rather than only logging it. | Verification pendingVerification pending. Verification pending. |
| Jailbreak detectionDetects known jailbreak and guardrail-evasion patterns. | Verification pendingVerification pending. Verification pending. |
| PII detectionIdentifies personal information in prompts or responses. | Not publicly documentedNot publicly documented. Not publicly documented. |
| PII redactionMasks or removes personal information before it leaves the gateway. | Verification pendingVerification pending. Verification pending. |
| Secret & credential scanningDetects API keys, tokens and credentials in prompts or output. | Verification pendingVerification pending. Verification pending. |
| Input inspectionInspects outbound requests before they reach the model. | Verification pendingVerification pending. Verification pending. |
| Output inspectionInspects inbound model responses before they reach the application. | Verification pendingVerification pending. Verification pending. |
| Content moderationClassifies harmful or policy-violating content. Not equivalent to injection defense. | Verification pendingVerification pending. Verification pending. |
| Policy enforcementConfigurable rules applied per route, team, key or environment. | AvailableAvailable. Verified from official documentation.GenAI gateway capabilities are implemented as API Management policies. |
| Agent & tool controlsConstrains tool calls, autonomous actions and agent permissions. | Verification pendingVerification pending. Verification pending. |
| MCP securityControls or inspects Model Context Protocol server traffic. | AvailableAvailable. Verified from official documentation.MCP server exposure and governance. |
| Audit logsDurable, reviewable record of requests and policy decisions. | AvailableAvailable. Verified from official documentation.Diagnostics and Azure Monitor logging. |
| Access controlsRoles, teams, keys and scoped permissions. | AvailableAvailable. Verified from official documentation.Subscriptions, Entra ID and role-based access. |
| Cost optimization | |
| Prompt compressionReduces the number of tokens actually sent to the model. | Not publicly documentedNot publicly documented. Not publicly documented. |
| Exact cachingReturns a stored response for a byte-identical request. | AvailableAvailable. Verified from official documentation.Response caching policy. |
| Semantic cachingReturns a stored response for a semantically similar request using embeddings. | AvailableAvailable. Verified from official documentation.Semantic caching policy backed by embeddings. |
| Intelligent model routingChooses a model per request based on task, cost or performance. | AvailableAvailable. Verified from official documentation.Routing across backend pools and deployments. |
| Automatic fallbackRetries against an alternate model or provider on failure. | AvailableAvailable. Verified from official documentation.Circuit breaker and backend failover. |
| Load balancingDistributes traffic across keys, regions or providers. | AvailableAvailable. Verified from official documentation.Backend pools with load balancing across deployments. |
| Token budgetsHard or soft limits expressed in tokens. | AvailableAvailable. Verified from official documentation.Token quota policy per key or subscription. |
| Dollar budgetsSpending limits expressed in currency. | Verification pendingVerification pending. Verification pending. |
| Rate limitsRequest throttling. Throttling is not the same as token reduction. | AvailableAvailable. Verified from official documentation.Token-per-minute rate limiting policy. |
| Cost attributionAttributes spend to teams, keys, users or features. | AvailableAvailable. Verified from official documentation.Token metrics can be dimensioned per subscription or client. |
| Cost analyticsDashboards and reporting on token and dollar usage. | AvailableAvailable. Verified from official documentation.Token-metric emission to Azure Monitor / Application Insights. |
| Savings reportingReports the spend avoided by compression, caching or routing. | Verification pendingVerification pending. Verification pending. |
| Models and deployment | |
| OpenAISupports OpenAI models. | AvailableAvailable. Verified from official documentation.Supported via the OpenAI-compatible passthrough. |
| AnthropicSupports Anthropic models. | Verification pendingVerification pending. Verification pending. |
| Google GeminiSupports Google Gemini models. | Verification pendingVerification pending. Verification pending. |
| AWS BedrockSupports AWS Bedrock as a provider. | Verification pendingVerification pending. Verification pending. |
| Azure OpenAISupports Azure OpenAI deployments. | AvailableAvailable. Verified from official documentation. |
| Open-source modelsSupports open-weight models or self-hosted inference endpoints. | AvailableAvailable. Verified from official documentation.Azure AI model inference endpoints. |
| SaaS deploymentVendor-hosted managed service. | AvailableAvailable. Verified from official documentation. |
| VPC / private cloudDeployable inside a customer cloud account. | AvailableAvailable. Verified from official documentation.VNet integration. |
| On-premiseDeployable in a customer data centre. | AvailableAvailable. Verified from official documentation.Self-hosted gateway can run on-premise. |
| Self-hostedCustomer runs and operates the gateway themselves. | AvailableAvailable. Verified from official documentation.Self-hosted gateway container. |
| Open-source optionSource code published under an open-source licence. | Verification pendingVerification pending. Verification pending. |
| APIProgrammatic API for configuration or traffic. | AvailableAvailable. Verified from official documentation. |
| SDKOfficial client libraries. | Verification pendingVerification pending. Verification pending. |
| Commercial | |
| Public pricingList pricing published on the vendor website. | AvailableAvailable. Verified from official product page.Azure API Management pricing tiers are published. |
| Free tierA permanently free usage tier. | Verification pendingVerification pending. Verification pending. |
| Free trialA time-limited or credit-limited trial. | Verification pendingVerification pending. Verification pending. |
| Enterprise planA named enterprise tier. | Verification pendingVerification pending. Verification pending. |
| Contact sales requiredPricing requires contacting the vendor. | Verification pendingVerification pending. Verification pending. |
| Best for | Organisations standardised on Azure that want gateway policy in their existing API layer |
| Last reviewed | 2026-07-30 |