Sign in Subscribe

Drishti Shah

Bringing GenAI to the classroom

Discover how top universities like Harvard and Princeton are scaling GenAI access responsibly across campus and how Portkey is helping them manage cost, privacy, and model access through Internet2’s service evaluation program.

What is LLM tool calling, and how does it work?

Explore how LLM tool calling works, with real examples and common challenges. Learn how Portkey helps tool calling in production.

Geo-location based LLM routing: Why it matters and how to do it right

As LLM-powered applications scale across global markets, user expectations around performance, reliability, and data compliance are higher than ever. Enterprises now prefer geo-location-based routing. Whether it's reducing latency, staying compliant with regional data laws, or optimizing infrastructure costs, geo-routing ensures your AI workloads are not just smart, but also efficient

Task-Based LLM Routing: Optimizing LLM Performance for the Right Job

Task-Based LLM Routing: Optimizing LLM Performance for the Right Job

Learn how task-based LLM routing improves performance, reduces costs, and scales your AI workloads

Canary Testing for LLM Apps

Canary Testing for LLM Apps

Learn how to safely deploy LLM updates using canary testing - a phased rollout approach that lets you monitor real-world performance with a small user group before full deployment.

Ethical considerations and bias mitigation in AI

Discover how to address ethical issues through better data practices, algorithm adjustments, and system-wide governance to build AI that works fairly for everyone.

FinOps chargeback and how it can help GenAI platforms

Learn how FinOps chargeback helps AI teams control GenAI platform costs by linking expenses to specific teams.