This post is part of a series. Part 1 - A deep dive into connection management challenges. Part 2 - The nuances of HTTP parsing and why it’s harder than it looks. Part 3 - The intricacies of service discovery. Part 4 - Why Load Balancing at Scale is Hard. One of the most critical roles for a reverse proxy is load balancing requests across different upstream hosts. From a list of upstream servers, the proxy must decide where each incoming request should go. The primary goals of load balancing ar...