Tiny company steals AMD's thunder and challenges Nvidia with old-tech PCIe AI accelerator that runs 700B LLMs…
- Skymizer claims giant AI models no longer need hyperscale GPU infrastructure
- Old 28nm chips suddenly power massive language models at surprisingly low wattage
- The HTX301 squeezes 384 GB of memory into a single PCIe accelerator card
A Taiwanese company called Skymizer has unveiled a PCIe AI accelerator that challenges both AMD and Nvidia using surprisingly old technology.
The HTX301 card can run language models with up to 700 billion parameters on a single device while consuming only 240 watts of power.
The card achieves this feat using older 28-nanometer chips and standard LPDDR4 and LPDDR5 memory instead of expensive HBM or GDDR solutions.
Old tech chip competes with modern AI accelerators
Skymizer claims its card delivers 30 tokens per second with just 0.5 TOPS at 100 GB per second bandwidth.
The HTX301 is built on Skymizer's HyperThought platform, which features next-generation LPU IP designed specifically for large language model workloads.
...
Copyright of this story solely belongs to techradar.com. To see the full text click HERE
