MSI Pro Max Edge AI+ Mini PC Runs 120B Local AI Models With 128GB RAM

https://hothardware.com/contentimages/NewsItem/71204/content/16x9_2133x1200_highres-msi-pro-max-edge-ai-plus.jpg

As demand for local, privacy-focused artificial intelligence continues to surge, enterprise developers and researchers are searching for hardware capable of running heavy Large Language Models (LLMs) without relying on potentially costly cloud APIs or power-hungry server racks. Enter MSI's new Pro Max Edge AI+, a mini PC that offers an alternative to the cloud.

The mini PC is built for on-device AI inference with gobs of memory and high-end hardware housed in an ultra-compact, 4-liter aluminum chassis. It has the ability to run massive LLMs with up to 120 billion parameters entirely offline.

Specs vary, but the Pro Max Edge AI+ is available with up to an AMD Ryzen AI Max+ 395 (same as found in AMD's Ryzen AI Halo), a powerful Strix Halo chip based on Zen 5 featuring 16 cores, 32 threads, 3GHz (base) to 5.1GHz (max boost) clock speeds, 16MB L2 + 64MB L3 for 80MB...

Copyright of this story solely belongs to hothardware.com. To see the full text click HERE

Read more