AI Chips Are 10× More Efficient. Data Center Power Demand Keeps Exploding
The fusion reactors, the liquid-cooled servers and the 600-kilowatt server racks are all humming in race to keep the AI boom running.
Everyone here knows by now that AI's real choke point is power, not chips. But less acknowledged is the absurdly aggressive tech-stack now being constructed to overcome the power shortage on every vector-and the bleak, predictable pattern underlying it all: as hardware gets more efficient, the industry actually demands more power. A true Jevons paradox being unleashed on a gigawatt scale.
Here's a tour of what's happening under the hood:
The Chips: 10x more efficient, 15x more power-hungry
Nvidia's Vera Rubin platform, now flowing to customers, touts as much as 10x more inference performance per watt than Blackwell, with disaggregated inference (breaking inference into prefill and decode states, running them on separate hardware components; a concept Nvidia calls Dynamo) able to boost output by a full 35x tokens...
Copyright of this story solely belongs to hackernoon.com. To see the full text click HERE
