Kioxia GP1 PCIe 6.0 SSD Feeds Hungry AI Workloads At 10M IOPS

https://hothardware.com/contentimages/NewsItem/71302/content/16x9_2133x1200_highres-kioxia-gp1-ssd-award.jpg

AI clusters are running into massive hardware bottlenecks: High Bandwidth Memory (HBM) is fast, but it's far too expensive to scale indefinitely. Enter Kioxia, which is proposing a performant middle ground with its GP1 series of 'Super High IOPS' NVMe SSDs that leverage the PCI Express 6.0 bus to deliver up to 10 million random read IOPS.

Kioxia's new SSDs don't take aim at traditional enterprise storage deployments. Instead, the Super High IOPS GP1 line acts as a low-latency, flash-based memory expansion option designed for direct GPU access.

This approach addresses the fact that modern AI models are outgrowing the on-chip HBM capacity of current server-oriented GPUs, which leaves pricey processors sitting idle waiting for data. Kioxia's GP1 series sidesteps this so-called memory wall by offering a high-speed flash layer that GPUs can directly access.

By enabling GPU-initiated data movement, which aligns with open-source initiatives like Big Accelerator Memory (BaM)...

Copyright of this story solely belongs to hothardware.com. To see the full text click HERE

Read more