TECH NEWS
Data centers use as little as 60% of power consumed for actual AI work, Nvidia claims — failures and restarts 'consume' a whopping 10% of every watt used
* Nvidia claims that for each gigawatt an AI data center uses, only 70% is used for AI work * Inefficiencies include cooling and power distribution, failures, and restarts * While a chip shortage was considered to be the main bottleneck to AI data center capacity, it is now a facility’s connection