Design a Load Balancer · System Design Interview

Design a Load BalancerDesign the layer that sits in front of a fleet of application servers, spreading requests across the healthy ones and hiding the ones that are not.What it has to do

A request is sent to one of several healthy backend servers

A server that stops responding correctly is taken out of rotation, and put back once it recovers

Traffic is added or removed as the backend fleet scales

Scale

Requests per second at peak: 2 million

Backend servers: 5,000 across 3 zones

Out of scope

DNS and how clients find the load balancer itself

TLS certificate management

The application servers themselves

CDN and edge caching

Practise this challengeAll system design challenges

LetsDiscuss

Loading your session…