Meta enlists tiny Korean startup to build 'one-chip-like datacenter' — CXL architecture introduced by…

https://cdn.mos.cms.futurecdn.net/pVdxPdmrrXkVxR4MfZxiTV-1920-80.png
  • Meta wants nearly 1,000 AI GPUs operating inside one coherent data center domain
  • Panmnesia's CXL design connects CPUs, accelerators, and memory across multiple racks
  • The architecture increases accelerator coordination from two devices to sixteen per CPU

Meta is working with Panmnesia on an artificial intelligence data center design intended to make thousands of processors operate within one coherent environment.

The proposal uses Compute Express Link, or CXL, to connect CPUs, accelerators and memory across multiple racks without conventional network links.

The architecture could bring as many as 960 AI accelerators into one coherence domain, putting its capacity at almost 1,000 GPUs working as one system.

CXL architecture extends accelerator connectivity

The design addresses a problem that becomes increasingly difficult as AI training systems combine hundreds or thousands of accelerators processing enormous data.

Every accelerator must progress through repeated computational stages, meaning one delayed component can force other devices to...

Copyright of this story solely belongs to www.techradar.com. To see the full text click HERE

Read more

https://platform.theverge.com/wp-content/uploads/sites/2/chorus/uploads/chorus_asset/file/25461999/STK155_OPEN_AI_CVirginia_A.jpg?quality=90&strip=all&crop=0%2C10.732984293194%2C100%2C78.5...

Common Sense Media calls ChatGPT for Teens an “unacceptable risk”, saying its guardrails fall short of OpenAI's promises and it continues to do kids' homework

Featured Podcasts Training Data: Google's AI Infrastructure Chief, Amin Vahdat, on the Physics & Economics of Frontier AI Sequoia Capital partners host conversations with leading AI builders and researchers to develop a deeper understanding of the evolving technologies and their implications. Subscribe to Training Data. Invest Like the