YDB Discovers gRPC Client Bottleneck: How Fewer Cluster Nodes Cause Higher Latency; Solution Involves Channel Creation and Request Distribution

The Surprising gRPC Client Bottleneck in Low-Latency Networks — and How to Get Around It

Zoom image will be displayed“Improving anything but the bottleneck is an illusion.” — Eliyahu M. GoldrattAt YDB, we use gRPC to expose our database API to clients. Therefore, all our load generators and benchmarks are gRPC clients. Recently, we discovered that the fewer cluster nodes we have, the harder it is for the benchmark to load the cluster. Moreover, when we shrink the cluster size, it results in more and more idle resources, while we observe steadily increasing client-side latency. Fortu...