Add usage tracking, cost controls, and security guardrails to your AnythingLLM deployment
Create an Integration
Configure Models
Copy the Provider Slug
@openai-dev/gpt-4o
)Run Test Request
button on this step to verify your integration. If you see the error: You do not have enough permissions to execute this request
, you’ll need to create a User API Key for this step to work properly.You can create one here. You should be able to see simple chat request output on this step.@your-provider-slug/your-model-name
Create Default Config
Configure Portkey API Key
Settings > AI Providers > LLM
Generic OpenAI
https://api.portkey.ai/v1
Step 1: Implement Budget Controls & Rate Limits
Step 2: Define Model Access Rules
Step 4: Set Routing Configuration
Step 4: Implement Access Controls
Step 5: Deploy & Monitor
virtual key
in your default config
object.
How do I update my Virtual Key limits after creation?
Can I use multiple LLM providers with the same API key?
How do I track costs for different teams?
What happens if a team exceeds their budget limit?