Startup swaps costly AI GPUs for Arm cores and up to 128TB of 'cheap' LPDDR6 RAM instead of expensive HBM to smash through the memory wall

• Startup replaces Nvidia GPUs with custom Arm-powered AI processing hardware
• Prometheus packs up to 128TB of unified LPDDR6 memory onboard
• New server promises 1,000× more memory available per processor

Majestic Labs, a startup founded in 2023 by former Google and Meta engineers, has unveiled a server built to rival Nvidia's GPU and HBM combination.

The Tel Aviv-based company argues that pairing costly graphics processors with high-bandwidth memory has become a fundamentally memory-bound and dead-end approach for AI inference.

Its answer is the Prometheus server, which swaps GPUs for Ignite AI Processing Units combining Arm cores with RISC-V vector and tensor engines.

A different way to scale memory

Each Prometheus server can house up to 12 AIUs, sharing between 8 TB and 128 TB of LPDDR6 memory across one contiguous, coherent pool.

That memory pool is accessed through custom memory aggregation chiplets linked by copper cables up to one metre...

Copyright of this story solely belongs to techradar.com. To see the full text click HERE