https://nalar.dev/tags/load-balancing/ Recent content in Load Balancing on Nalar Hugo en-us Sun, 20 Sep 2026 00:00:00 +0000 https://nalar.dev/power-of-two-choices-reduces-load-imbalance-with-two-samples/ Sun, 20 Sep 2026 00:00:00 +0000 https://nalar.dev/power-of-two-choices-reduces-load-imbalance-with-two-samples/ <h1 id="power-of-two-choices-reduces-load-imbalance-with-two-samples">Power of Two Choices Reduces Load Imbalance with Two Samples</h1> <p>A load balancer that chooses one destination uniformly at random is cheap and decentralized, but random placement can produce uneven queues. At the other extreme, selecting the least loaded destination from the entire pool requires current load information for every candidate and can make the balancer itself expensive.</p> <p>The power-of-two-choices strategy sits between those designs. For each request, sample two eligible destinations, compare a load signal, and send the request to the better candidate. Two observations are enough to avoid many unlucky placements without requiring a global search.</p>