--- description: Explore AI Gateway features including caching, rate limiting, guardrails, dynamic routing, and data loss prevention. title: Features image: https://developers.cloudflare.com/og-docs.png --- [Skip to content](#main-content) > Documentation Index > Fetch the complete documentation index at: https://developers.cloudflare.com/ai-gateway/llms.txt > Use this file to discover all available pages before exploring further. # Features Last updated Aug 31, 2026|Copy as Markdown| [View as Markdown](https://fec4cfc0.previews.developers.cloudflare.com/ai-gateway/features/index.md)| [Agent setup](https://fec4cfc0.previews.developers.cloudflare.com/agent-setup/) AI Gateway provides a comprehensive set of features to help you build, deploy, and manage AI applications with confidence. From performance optimization to security and observability, these features work together to create a robust AI infrastructure. ## Core Features ### Performance & Cost Optimization [Caching](https://fec4cfc0.previews.developers.cloudflare.com/ai-gateway/features/caching/) Serve identical requests directly from Cloudflare's global cache, reducing latency by up to 90% and significantly cutting costs by avoiding repeated API calls to AI providers. **Key benefits:** - Reduced response times for repeated queries - Lower API costs through cache hits - Configurable TTL and per-request cache control - Works across all supported AI providers Use Caching [Spend Limits](https://fec4cfc0.previews.developers.cloudflare.com/ai-gateway/features/spend-limits/) Set cost-based budgets that track cumulative dollar spend across requests. Scope limits by model, provider, or custom metadata dimensions like user, team, or application. **Key benefits:** - Per-provider or per-model budgets - Per-user or per-team budgets using [custom metadata](https://fec4cfc0.previews.developers.cloudflare.com/ai-gateway/observability/custom-metadata/) - Configurable time windows (daily, weekly, monthly) - Automatic request blocking when budget is exceeded Use Spend Limits [Rate Limiting](https://fec4cfc0.previews.developers.cloudflare.com/ai-gateway/features/rate-limiting/) Control application scaling and protect against abuse with flexible rate limiting options. Set limits based on requests per time window with sliding or fixed window techniques. **Key benefits:** - Prevent API quota exhaustion - Control costs and usage patterns - Configurable per gateway or per request - Multiple rate limiting techniques available Use Rate Limiting [Dynamic Routing](https://fec4cfc0.previews.developers.cloudflare.com/ai-gateway/features/dynamic-routing/) Create sophisticated request routing flows without code changes. Route requests based on user segments, geography, content analysis, or A/B testing requirements through a visual interface. **Key benefits:** - Visual flow-based configuration - User-based and geographic routing - A/B testing and fractional traffic splitting - Context-aware routing based on request content - Dynamic rate limiting with automatic fallbacks Use Dynamic Routing ### Security & Safety [Guardrails](https://fec4cfc0.previews.developers.cloudflare.com/ai-gateway/features/guardrails/) Deploy AI applications safely with real-time content moderation. Automatically detect and block harmful content in both user prompts and model responses across all providers. **Key benefits:** - Consistent moderation across all AI providers - Real-time prompt and response evaluation - Configurable content categories and actions - Compliance and audit capabilities - Enhanced user safety and trust Use Guardrails [Data Loss Prevention (DLP)](https://fec4cfc0.previews.developers.cloudflare.com/ai-gateway/features/dlp/) Protect your organization from inadvertent exposure of sensitive data through AI interactions. Scan prompts and responses for PII, financial data, and other sensitive information. **Key benefits:** - Real-time scanning of AI prompts and responses - Detection of PII, financial, healthcare, and custom data patterns - Configurable actions: flag or block sensitive content - Integration with Cloudflare's enterprise DLP solution - Compliance support for GDPR, HIPAA, and PCI DSS Use Data Loss Prevention (DLP) [Authentication](https://fec4cfc0.previews.developers.cloudflare.com/ai-gateway/configuration/authentication/) Secure your AI Gateway with token-based authentication. Control access to your gateways and protect against unauthorized usage. **Key benefits:** - Token-based access control - Configurable per gateway - Integration with Cloudflare's security infrastructure - Audit trail for access attempts Use Authentication [Bring Your Own Keys (BYOK)](https://fec4cfc0.previews.developers.cloudflare.com/ai-gateway/configuration/bring-your-own-keys/) Securely store and manage AI provider API keys in Cloudflare's encrypted infrastructure. Remove hardcoded keys from your applications while maintaining full control. **Key benefits:** - Encrypted key storage at rest and in transit - Centralized key management across providers - Easy key rotation without code changes - Support for 20+ AI providers - Enhanced security and compliance Use Bring Your Own Keys (BYOK) ### Observability & Analytics [Analytics](https://fec4cfc0.previews.developers.cloudflare.com/ai-gateway/observability/analytics/) Gain deep insights into your AI application usage with comprehensive analytics. Track requests, tokens, costs, errors, and performance across all providers. **Key benefits:** - Real-time usage metrics and trends - Cost tracking and estimation across providers - Error monitoring and troubleshooting - Cache hit rates and performance insights - GraphQL API for custom dashboards Use Analytics [Logging](https://fec4cfc0.previews.developers.cloudflare.com/ai-gateway/observability/logging/) Capture detailed logs of all AI requests and responses for debugging, compliance, and analysis. Configure log retention and export options. **Key benefits:** - Complete request/response logging - Configurable log retention policies - Export capabilities via Logpush - Custom metadata support - Compliance and audit support Use Logging [Custom Metadata](https://fec4cfc0.previews.developers.cloudflare.com/ai-gateway/observability/custom-metadata/) Enrich your logs and analytics with custom metadata. Tag requests with user IDs, team information, or any custom data for enhanced filtering and analysis. **Key benefits:** - Enhanced request tracking and filtering - User and team-based analytics - Custom business logic integration - Improved debugging and troubleshooting Use Custom Metadata ### Advanced Configuration [Custom Costs](https://fec4cfc0.previews.developers.cloudflare.com/ai-gateway/configuration/custom-costs/) Override default pricing with your negotiated rates or custom cost models. Apply custom costs at the request level for accurate cost tracking. **Key benefits:** - Accurate cost tracking with negotiated rates - Per-request cost customization - Better budget planning and forecasting - Support for enterprise pricing agreements Use Custom Costs ## Feature Comparison by Use Case | Use Case | Recommended Features | | --- | --- | | **Cost Optimization** | Caching, Spend Limits, Rate Limiting, Custom Costs | | **High Availability** | Fallbacks using Dynamic Routing | | **Security & Compliance** | Guardrails, DLP, Authentication, BYOK, Logging | | **Performance Monitoring** | Analytics, Logging, Custom Metadata | | **A/B Testing** | Dynamic Routing, Custom Metadata, Analytics | ## Getting Started with Features 1. **Start with the basics**: Enable [Caching](https://fec4cfc0.previews.developers.cloudflare.com/ai-gateway/features/caching/) and [Analytics](https://fec4cfc0.previews.developers.cloudflare.com/ai-gateway/observability/analytics/) for immediate benefits 2. **Add reliability**: Configure Fallbacks and Rate Limiting using [Dynamic routing](https://fec4cfc0.previews.developers.cloudflare.com/ai-gateway/features/dynamic-routing/) 3. **Enhance security**: Implement [Guardrails](https://fec4cfc0.previews.developers.cloudflare.com/ai-gateway/features/guardrails/), [DLP](https://fec4cfc0.previews.developers.cloudflare.com/ai-gateway/features/dlp/), and [Authentication](https://fec4cfc0.previews.developers.cloudflare.com/ai-gateway/configuration/authentication/) --- *All features work seamlessly together and across all 20+ supported AI providers. Get started with [AI Gateway](https://fec4cfc0.previews.developers.cloudflare.com/ai-gateway/get-started/) to begin using these features in your applications.* Was this helpful? YesNo ## On this page [![](https://fec4cfc0.previews.developers.cloudflare.com/_astro/logo.te5VL_aD.svg)Docs](https://fec4cfc0.previews.developers.cloudflare.com/) ```json {"@context":"https://schema.org","@type":"WebPage","@id":"https://developers.cloudflare.com/ai-gateway/features/#page","headline":"Features ยท Cloudflare AI Gateway docs","description":"Explore AI Gateway features including caching, rate limiting, guardrails, dynamic routing, and data loss prevention.","url":"https://developers.cloudflare.com/ai-gateway/features/","inLanguage":"en","image":"https://developers.cloudflare.com/og-docs.png","dateModified":"2026-08-31","publisher":{"@type":"Organization","name":"Cloudflare","description":"One platform for your apps, agents, and workforce. Build, secure, and scale without managing infrastructure","url":"https://www.cloudflare.com/","sameAs":["https://github.com/cloudflare","https://www.linkedin.com/company/cloudflare","https://x.com/cloudflare"],"logo":{"@type":"ImageObject","url":"https://developers.cloudflare.com/logo.svg"},"address":{"@type":"PostalAddress","streetAddress":"101 Townsend St","addressLocality":"San Francisco","addressRegion":"CA","postalCode":"94107","addressCountry":"US"},"contactPoint":[{"@type":"ContactPoint","contactType":"Customer Support","url":"https://support.cloudflare.com/","availableLanguage":["English"]},{"@type":"ContactPoint","contactType":"Sales","url":"https://www.cloudflare.com/contact/","availableLanguage":["English"]}]},"isPartOf":{"@type":"WebSite","@id":"https://developers.cloudflare.com/#website","name":"Cloudflare Docs","url":"https://developers.cloudflare.com/"}} ```