Anthropic
Portkey provides a robust and secure gateway to facilitate the integration of various Large Language Models (LLMs) into your applications, including Anthropic's Claude APIs.
With Portkey, you can take advantage of features like fast AI gateway access, observability, prompt management, and more, all while ensuring the secure management of your LLM API keys through a virtual key system.
Portkey SDK Integration with Anthropic
Portkey provides a consistent API to interact with models from various providers. To integrate Anthropic with Portkey:
1. Install the Portkey SDK
Add the Portkey SDK to your application to interact with Anthropic's API through Portkey's gateway.
And if you want to use Portkey with the Anthropic SDK,
2. Initialize Portkey with the Virtual Key
Set up Portkey with your virtual key as part of the initialization configuration. You can create a virtual key for Anthropic in the UI.
3. Invoke Chat Completions with Anthropic
Use the Portkey instance to send requests to Anthropic. You can also override the virtual key directly in the API call if needed.
How to Use Anthropic System Prompt
With Portkey, we make Anthropic models interoperable with the OpenAI schema and SDK methods. So, instead of passing the system
prompt separately, you can pass it as part of the messages
body, similar to OpenAI:
For more, check out the chat completions
and completions
API reference docs.
Using Anthropic Vision Models
Portkey's multimodal Gateway fully supports Anthropic's vision models claude-3-sonnet
, claude-3-haiku
, and claude-3-opus
For more info, check out this guide:
pageVisionManaging Anthropic Prompts
You can manage all prompts to Anthropic in the Prompt Library. All the current models of Anthropic are supported and you can easily start testing different prompts.
Once you're ready with your prompt, you can use the portkey.prompts.completions.create
interface to use the prompt in your application.
Next Steps
The complete list of features supported in the SDK are available on the link below.
pagePortkey SDK ClientYou'll find more information in the relevant sections:
Last updated