Nvidia paid $20 billion for SRAM decode - AMD just partnered for it instead

https://cdn.mos.cms.futurecdn.net/oN8C2XnJkqZJEi4ecAeBgE-1920-80.jpg
  • AMD and Cerebras will split inference across two machines, with Helios racks handling prompt processing and the Wafer-Scale Engine generating tokens, available through Cerebras Cloud in H2 2026
  • Nvidia is also doing something similar by licensing AI chip startup Groq's SRAM decode technology for $20 billion
  • The move sees AMD and Cerebras claim 5x higher tokens per watt versus a standalone Cerebras WSE configuration

AMD and Cerebras Systems have announced a technical partnership which pairs the former's Helios rackscale system with the latter's Wafer-Scale Engine in what both companies call a disaggregated inference solution.

The move has enabled a combined AMD Helios and Cerebras WSE configuration to deliver up to five times the tokens per second per watt (TPS/W) in internal testing by both chip designers.

The move aims to address a Cerebras WSE efficiency challenge by offloading prompt processing to AMD's rackscale offering.

An efficiency gains-centric play?

Both AMD...

Copyright of this story solely belongs to techradar.com. To see the full text click HERE

Read more