In the U.K., electricity provider National Grid faces a problem every time there is a soccer match on (or any other widely viewed televised event for that matter): During half-time, or a commercial break, an inordinate number of viewers go to turn on their tea kettles. This highly British coordinated activity strains the energy grid, causing spikes in demand of sometimes thousands of megawatts.In AI training, a similar phenomenon can occur every second. Because training is orchestrated simultane...