Budget Limits
Budget Limits lets you set cost limits on virtual keys
Budget Limits lets you set cost or token limits on virtual keys
Available on Enterprise plan and select Pro customers.
Budget Limits on Virtual Keys provide a simple way to manage your spending on AI providers (and LLMs) - giving you confidence and control over your application’s costs.
Budget Limit is currently only available to Portkey Enterprise Plan customers. Email us at [email protected]
if you would like to enable it for your org.
Setting Budget Limits on Virtual Keys
When creating a new virtual key on Portkey, you can set limits in two ways:
Cost-Based Limits
Set a budget limit in USD that, once reached, will automatically expire the key to prevent further usage and overspending.
Token-Based Limits
Set a maximum number of tokens that can be consumed, allowing you to control usage independent of cost fluctuations.
Key Considerations
- Budget limits can be set as either cost-based (USD) or token-based
- The minimum cost limit you can set is $1
- The minimum token limit you can set is 100 tokens
- Budget limits apply until exhausted or reset
- Budget limits are applied only to requests made after the limit is set; they do not apply retroactively
- Once set, budget limits cannot be edited by any organization member
- Budget limits work for all providers available on Portkey and apply to all organization members who use the virtual key
Alert Thresholds
You can now set alert thresholds to receive notifications before your budget limit is reached:
- For cost-based budgets, set thresholds in USD
- For token-based budgets, set thresholds in tokens
- Receive email notifications when usage reaches the threshold
- Continue using the key until the full budget limit is reached
Periodic Reset Options
You can configure budget limits to automatically reset at regular intervals:
Reset Period Options
- No Periodic Reset: The budget limit applies until exhausted with no automatic renewal
- Reset Weekly: Budget limits automatically reset every week
- Reset Monthly: Budget limits automatically reset every month
Reset Timing
- Weekly resets occur at the beginning of each week (Sunday at 12 AM UTC)
- Monthly resets occur on the 1st calendar day of the month, at 12 AM UTC, irrespective of when the budget limit was set prior
Editing Budget Limits
If you need to change or update a budget limit, you can duplicate the existing virtual key and create a new one with the desired limit.
Monitoring Your Spending and Usage
You can track your spending and token usage for any specific virtual key by navigating to the Analytics tab and filtering by the desired key and timeframe.
Pricing Support and Limitations
Budget limits currently apply to all providers and models for which Portkey has pricing support. If a specific request log shows 0 cents
in the COST column, it means that Portkey does not currently track pricing for that model, and it will not count towards the virtual key’s budget limit.
For token-based budgets, Portkey tracks both input and output tokens across all supported models.
It’s important to note that budget limits cannot be applied retrospectively. The spend counter starts from zero only after you’ve set a budget limit for a key.
Availability
Budget Limits is currently available exclusively to Portkey Enterprise customers and select Pro users. If you’re interested in enabling this feature for your account, please reach out to us at [email protected] or join the Portkey Discord community.
Enterprise Plan
To discuss Portkey Enterprise plan details and pricing, you can schedule a quick call here.
Was this page helpful?