Not necessarily a new insight, but one which might be worth repeating – in the data center rollout race, it is (now) much less about GPUs (or TPUs), but rather access to power that provides the bottleneck. Microsoft’s CEO recently:
“The biggest issue we are now having is not a compute glut, but it’s power,” Nadella said. “It’s not a supply issue of chips. It’s actually the fact that I don’t have warm shells to plug into.” The remarks referred to data centers that are incomplete or lack sufficient energy and cooling capacity.
If you are into the great US-China race, you might realize that it doesn’t bode well for the US, that China is massively outpacing the US in its energy buildup (with a lot of renewables, mind you)…
