What is Portkey?
Portkey AI is a comprehensive platform designed to streamline and enhance AI integration for developers and organizations. It serves as a unified interface for interacting with over 250 AI models, offering advanced tools for control, visibility, and security in your Generative AI apps.
It takes 2 mins to integrate and with that, it starts monitoring all of your LLM requests and makes your app resilient, secure, performant, and more accurate at the same time.
Here’s a product walkthrough (3 mins):
Integrate in 3 Lines of Code
While you’re here, why not give us a star? It helps us a lot!
FAQs
Will Portkey increase the latency of my API requests?
Portkey is hosted on edge workers throughout the world, ensuring minimal latency. Our benchmarks estimate a total latency addition between 20-40ms compared to direct API calls. This slight increase is often offset by the benefits of our caching and routing optimizations.
Our edge worker locations:
Is my data secure?
Portkey AI is ISO:27001 and SOC 2 certified, and GDPR & HIPAA compliant. We maintain best practices for service security, data storage, and retrieval. All data is encrypted in transit and at rest using industry-standard AES-256 encryption.
For enhanced security, we offer:
- On request, we can enable a feature that does NOT store any of your request and response body objects in Portkey datastores or our logs.
- For enterprises, we offer managed hosting to deploy Portkey inside private clouds.
For more information on these options, contact us at [email protected].
Will Portkey scale if my app explodes?
Portkey is built on scalable infrastructure and can handle millions of requests per minute with very high concurrency. We currently serve over 25M requests daily with a 99.99% uptime. Our edge architecture & scaling capabilities ensure we can accommodate sudden spikes in traffic without performance degradation.
Does Portkey impose timeouts on requests?
We DO NOT impose any explicit timeout for our free OR paid plans currently. While we don’t time out requests on our end, we recommend implementing client-side timeouts appropriate for your use case to handle potential network issues or upstream API delays.
Do you support SSO?
Yes! We support SSO with any custom OIDC provider.
What are the pricing options? Is there a free trial?
Portkey’s Gateway is open source and free to use. On managed version, Portkey offers a free plan with 10k requests per month. We also offer paid plans with more requests and additional features.
Where can I reach you?
We’re available all the time on Discord, or on our support email - [email protected]
Was this page helpful?