This tiny AMD PC just ran a massive 397B AI Model that required a server room full of GPUs a year ago
AMD's Ryzen AI Halo recently went on sale for $4,000, sparking an interesting debate about how it compares to Nvidia's slightly pricier DGX Spark offering.
The configuration that the Ryzen AI Halo offers, however, has been on the market for a few months now, and while most OEMs and enterprise providers are offering the same flavor and configuration, Shenzhen-based memory and storage company Longsys has taken things a step further.
The storage giant demonstrated a localized version of a 397B-parameter AI model running on its own version of the Ryzen AI Halo, featuring the same 16-core Ryzen AI Max+ 395 and 128GB of RAM configuration.
How was the Ryzen AI Max+ 395 able to run such a massive model with only 128GB of RAM?
While the model being run was not explicitly stated, it seems to be a customized version derived from Alibaba's Qwen 3.5 397B (A17B), a multimodal...
Copyright of this story solely belongs to techradar.com. To see the full text click HERE
