Rate limiting

Throttling protects against three things at once: accidental loops in someone else code, deliberate overload, and the cost both create.

Common approaches such as token bucket allow short bursts and only cap sustained throughput. What matters is that rejected requests answer clearly as such, including when a retry makes sense.