Design a Distributed Rate Limiter · System Design Interview

Design a Distributed Rate LimiterDesign a rate limiter that caps how many requests each API client may make, working correctly across many application servers.What it has to do

Reject requests from a client that exceeds its allowance

The limit applies across all servers, not per server

A rejected caller is told when they may retry

Scale

Requests per second at peak: 500,000

Distinct API clients: 2 million

Out of scope

Billing for overages

Per-endpoint pricing tiers

DDoS mitigation at the network layer

Practise this challengeAll system design challenges

LetsDiscuss

Loading your session…