Sign in Subscribe

Latest

Top 10 MCP Servers

Anthropic recently launched Model Context Protocol - a standardized protocol that governs how models can interact with local and remote sources Here's a list of production-ready and experimental MCP servers you can access for database connections, cloud, and infra, Content, productivity tools, etc. Data and storage MCP server 1. PostgreSQL

Model Context Protocol Architecture

Model Context Protocol for building reliable, enterprise LLM applications

Picture the modern enterprise LLM application scene - from customer service chatbots parsing thousands of queries to data analysis systems processing vast business insights. Large Language Models (LLMs) power these systems, but there's a critical challenge that many organizations overlook: context management. As enterprises scale their LLM deployments, they face

LLMs in Prod: The Reality of AI Outages, No LLM is Immune

LLMs in Prod: The Reality of AI Outages, No LLM is Immune

This is Part 2 of our series analyzing Portkey's critical insights from production LLM deployments. Today, we're diving deep into provider reliability data from 650+ organizations, examining outages, error rates, and the real impact of downtime on AI applications. From the infamous OpenAI outage to the daily challenges of rate

LLMs In Prod: Day 1

LLMs In Prod: Day 1

This is Part 1 of our analysis diving into Portkey's year-end LLM production data. Over the next few days, we'll be unpacking insights from over 2 trillion tokens worth of production data to reveal how the AI ecosystem evolved in 2024. Today, we're starting with the most crucial aspect: who's

Real-time Guardrails vs Batch Evals: Understanding Safety Mechanisms in LLM Applications

In the world of Large Language Model (LLM) applications, ensuring quality, safety, and reliability requires different types of safety mechanisms at different stages. Two distinct approaches serve unique purposes: real-time guardrails and batch evaluations (evals). Let's understand how they differ and why both matter. Real-time Guardrails: Automated Runtime Protection Real-time

Build vs Buy - LLM Gateways

The use of Large Language Models (LLMs) has changed how enterprises approach AI and automation. LLM Gateways serve as essential infrastructure for managing, securing, and optimizing AI models, helping organizations streamline their AI workflows. But when faced with the choice of building an LLM Gateway from scratch or buying an

Prompt Injection Attacks in LLMs: What Are They and How to Prevent Them

In February 2023, a Stanford student exposed Bing Chat’s confidential system prompt through a simple text input, revealing the chatbot’s internal guidelines and behavioral constraints. It was one of the first prompt injection attacks highlighting a critical security loophole in Large Language Models (LLMs) – AI models powering everything

Deep Dive: OpenAI's o1 - The Dawn of Deliberate AI

Deep Dive: OpenAI's o1 - The Dawn of Deliberate AI

December 2024 marks a pivotal moment in AI development with the release of OpenAI's o1 system card, revealing an AI that thinks before it speaks. Let's explore how this changes everything..

How to scale AI apps - Lessons from building a billion-scale AI Gateway

How to scale AI apps - Lessons from building a billion-scale AI Gateway

Discover the journey of Portkey.ai in building a billion-scale AI Gateway. Learn key lessons on managing costs, optimizing performance, and ensuring accuracy while scaling generative AI applications.

Why Portkey is the right AI Gateway for you

Discover why Portkey's purpose-built AI Gateway fulfills the unique demands of AI infrastructure. From intelligent guardrails to cost optimization, explore how Portkey empowers teams to scale AI with confidence.

AI Gateway

AI Gateway vs API Gateway - What's the difference

Learn the critical differences between AI gateways and API gateways. Discover how each serves unique purposes in managing traditional and AI-driven workloads, and when to use one—or both—for your infrastructure.

How Stardog uses NVIDIA's Triton Server to build scalable, enterprise-grade AI applications

Learn how Stardog uses NVIDIA's Triton Server, SKATHE's private GPU cloud, and Portkey's AI gateway to power scalable, reliable AI applications for enterprise data insights.

What is an LLM Gateway?

What is an LLM Gateway?

An LLM Gateway simplifies managing large language models, enhancing the performance, security, and scalability of real-world AI applications.

Prompting Chatgpt vs Claude

Prompting Chatgpt vs Claude

Explore the key differences between Claude and ChatGPT, from their capabilities and use cases to their response speeds and unique features.