Supercharging Open-source LLMs: Your Gateway to 250+ Models
The Rise of Open-source LLMs in Production
Topic
OpenAI
A collection of 22 issues
Portkey Goes Multimodal
2024 is the year where Gen AI innovation and productisation happens hand-in-hand.
We are seeing companies and enterprises move their Gen AI prototypes to production at a breathtaking pace. At the same time, an exciting new shift is also taking place in how you can interact with LLMs: completely new
Understanding RAG: A Deeper Dive into the Fusion of Retrieval and Generation
Retrieval-Augmented Generation (RAG) models represent a fascinating marriage of two distinct but complementary components: retrieval systems and generative models. By seamlessly integrating the retrieval of relevant information with the generation of contextually appropriate responses, RAG models achieve a level of sophistication that sets them apart in the realm of artificial
⭐️ Getting Started with Llama 2
Llama 2 is an open-source large language model (LLM) developed by Meta. See Llama 2's capabilities, comparisons, and how to run LLAMA 2 locally using Python.
⭐ Building Reliable LLM Apps: 5 Things To Know
In this blog post, we explore a roadmap for building reliable large language model applications. Let’s get started!
⭐ Semantic Cache for Large Language Models
Learn how semantic caching for large language models reduces cost, improves latency, and stabilizes high-volume AI applications by reusing responses based on intent, not just text.
FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performance - Summary
The paper discusses the cost associated with querying large language models (LLMs) and proposes FrugalGPT, a framework that uses LLM APIs to process natural language queries within a budget constraint. The framework uses prompt adaptation, LLM approximation, and LLM cascade to reduce the inference
⭐️ Decoding OpenAI Evals
Learn how to use the eval framework to evaluate models & prompts to optimise LLM systems for the best outputs.
We're Afraid Language Models Aren't Modeling Ambiguity - Summary
The paper discusses the importance of managing ambiguity in natural language understanding and evaluates the ability of language models (LMs) to recognize and disentangle possible meanings. The authors present AMBIENT, a linguist-annotated benchmark of 1,645 examples with diverse kinds of ambiguity
Sparks of Artificial General Intelligence: Early experiments with GPT-4 - Summary
The paper reports on the investigation of an early version of GPT-4, which is part of a new cohort of LLMs that exhibit more general intelligence than previous AI models. The paper demonstrates that GPT-4 can solve novel and difficult tasks that span mathematics, coding, vision, medicine, law, psyc