Framework Desktop Is Getting A 192GB RAM Boost For Monster Local LLMs

https://images.hothardware.com/contentimages/newsitem/71509/content/16x9_2133x1200_highres-framework-desktop.jpg

Framework is teasing a massive 192GB memory option that is headed to its compact Framework Desktop system. Driven by AMD’s Ryzen AI Max+ Pro 495 'Gorgon Halo' processor, the upgraded desktop is tailored specifically for developers and enthusiasts running heavy local artificial intelligence workloads directly from their desks.

A 192GB VRAM Playground for Local LLMs

The current iteration of the Framework Desktops offers a choice between an AMD Ryzen AI Max 385 processor with 32GB of LPDDR5X-8000 memory or a Ryzen AI Max+ 395 chip with 64GB or 128GB of RAM. On the system's product page, however, Framework now includes a tab titled "192GB coming soon."

Since AMD’s Ryzen AI Max platform shares memory between CPU cores and integrated graphics, users can allocate up to 160GB of that 192GB memory pool as video memory.For local AI enthusiasts running open-source Large Language Models (LLMs), that extra headroom is a...

Copyright of this story solely belongs to hothardware.com. To see the full text click HERE

Read more