Integrate in 3 Lines of Code
FAQs
Will the AI Gateway increase the latency of my API requests?
Will the AI Gateway increase the latency of my API requests?
The AI Gateway is hosted on edge workers throughout the world, ensuring minimal latency. Our benchmarks estimate a total latency addition between 20-40ms compared to direct API calls. This slight increase is often offset by the benefits of our caching and routing optimizations.
Is my data secure?
Is my data secure?
All data is encrypted in transit and at rest using industry-standard AES-256 encryption, and the gateway follows best practices for service security, data storage, and retrieval.
Will the AI Gateway scale if my app explodes?
Will the AI Gateway scale if my app explodes?
The gateway is built on scalable infrastructure and can handle millions of requests per minute with very high concurrency. Its edge architecture and scaling capabilities accommodate sudden spikes in traffic without performance degradation.
Does the AI Gateway impose timeouts on requests?
Does the AI Gateway impose timeouts on requests?
No explicit timeout is imposed on requests. While the gateway does not time out requests on our end, we recommend implementing client-side timeouts appropriate for your use case to handle potential network issues or upstream API delays.
Do you support SSO?
Do you support SSO?
Yes! We support SSO with any custom OIDC provider.

