Glossary / AI spend

Rate limit

A cap on how many requests or tokens you can send to an API in a period.

Hitting a limit usually returns an error. Code that retries immediately on every error can make things worse and increase cost.

General information, not legal advice. Rules and dates change, so check the source before relying on them.