Portkey x Pillar - Enterprise-grade Security for LLMs in Production
Bringing Pillar's AI guardrails onboard Portkey's open source Gateway!
Pilla Security is an all-in-one platform that empowers organizations to monitor, assess risks, and secure their AI activities. They are dedicated to helping innovative companies adopt AI securely and efficiently.
We're excited to share that Pillar's advanced detection & evaluation models are now available on Portkey's open source Gateway. This integration seamlessly incorporates Pillar's low-latency, model-agnostic security layer into Portkey - allowing teams to implement enterprise-grade security measures for their GenAI applications, fortifying them against both existing and emerging AI-specific threats.
Pillar's advanced models are continuously refined through real-world interaction analysis, having monitored over 1,700 AI chatbots and 300,000+ conversations across various languages and use cases.
Using Portkey, this happens in real-time, so that you can orchestrate your requests based on guardrail verdicts and make your AI app more robust.
Key Features of this Partnership:
- Intelligent Runtime Protection: Leveraging threat intelligence, Pillar detects and block adversarial attacks in real-time, safeguarding end-users, data integrity, and application performance.
- Holistic Threat Scanning: Pillar’s comprehensive approach scrutinizes all application components, including prompts, models, meta-prompts, tools, and outputs, for a wide array of potential threats.
- Advanced Data Protection: Pillar’s security layer can identify over 40 distinct data types and categories, including sensitive information like PII and secrets, while also flagging toxic language and concealed unicode characters.
- Alignment with Industry Standards: Advanced risk detection protocols align with leading AI security frameworks, including the OWASP Top 10 for LLMs and MITRE ATLAS, ensuring comprehensive protection.
This partnership marks a significant step forward in securing the future of AI applications. By combining Pillar's cutting-edge security features with Portkey's open source Gateway, we're setting a new standard for safe and efficient AI.
To use Pillar on Portkey,
It's just a 3-step process!
- Add Pillar’s API key to Portkey
- Create Guardrail Checks by selecting the Pillar evaluators you want
- Set up actions on the Guardrails and then add the Guardrail to a request Config.
Browse our integration docs for more info.
How Are Guardrails Useful?
When your app hits production scale, there are a lot of little nitty-gritty details with LLMs that you will see start to break. More edge cases, more malicious behavior, and overall, less predictability over the LLM behavior itself. Portkey's Gateway & Observability suite helps you debug requests faster, iterate on LLMs faster, and handle LLM API errors, but it doesn't help you tackle the LLM's behavior itself.
The Best Part? It's Open Source
Anybody can write their own custom Guardrail and integrate with the Portkey Gateway easily - including the Pillar one.
Portkey-AIThis is why, we are partnering with the world's best Guardrails platforms like Pillar Security to bring their capabilities on top of Portkey Gateway.
