How We Built a Self-Healing System to Survive a Terrifying Concurrency Bug At Netflix
NOTE: Check out the other posts from the Concurrency War Stories series here.Hello friends. Today, I’m discussing one of my favorite production incidents from my time at Netflix.Here’s an overview:A concurrency bug was killing our CPUsIt was Friday afternoonRolling back was cumbersomeWe couldn’t achieve a true fix until MondayHow could we possibly prevail?Here’s a link to the part of my 2021 Concurrency War Stories talk where I discuss it: During my time at Netflix, there was an effort to rede...
Read more at pushtoprod.substack.com