Portkey provides a robust and secure gateway to facilitate the integration of various Large Language Models (LLMs) into your applications, including Featherless.Featherless.ai is one of the largest AI inference access to 11,900+ open source models. You can instantly deploy at scale for fine-tuning, testing, and production with unlimited tokensWith Portkey, you can take advantage of features like fast AI gateway access, observability, prompt management, and more, all while ensuring the secure management of your LLM API keys Portkey’s model catalog.
To use Featherless AI with Portkey, get your API key from here, then add it to Portkey to create the virtual key.
Copy
Ask AI
import Portkey from 'portkey-ai'const portkey = new Portkey({ apiKey: "PORTKEY_API_KEY", // defaults to process.env["PORTKEY_API_KEY"] provider:"@PROVIDER" // Your featherless provider slug from model catalog})
You can manage all prompts to Featherless AI in the Prompt Library. All the current models of Featherless AI are supported and you can easily start testing different prompts.Once you’re ready with your prompt, you can use the portkey.prompts.completions.create interface to use the prompt in your application.