Contents
Changelog
December 2nd, 2024
Announced: December 5, 2024
December 2nd, 2024
We are introducing token-based rate limits for API requests.
What is changing?
Token-Based Rate Limits: API requests will now consume tokens from the company's daily budget, which resets every 24 hours. If the token budget is exceeded, further requests will return a 429 (Too Many Requests) response until the budget resets the next day.
APIv2: We encourage migrating to APIv2, which is more efficient and comes with a lower token cost per request. This can help reduce your token consumption and improve performance.
Why it is changing?
We are introducing these new limits in an effort to ensure the optimal performance and stability of our system. We project that these limits will not impact the overwhelming majority of our customers, as they serve to prevent extreme cases, thus keeping our systems stable.
Timeline of changes
- December 2nd, 2024: Token-based rate limits will apply to all new signups.
- March 1st, 2025: The token-based rate limits will begin rolling out for existing customers.
- May 31st, 2025: The rollout will be complete, and all existing customers will be subject to the new limits.
Additional resources:
If you have any questions or comments, feel free to let us know in the Developer’s Community.