Researchers unveil NAND-DRAM hybrid that could outperform traditional memory
Serving tech enthusiasts for over 25 years.
TechSpot means tech analysis and advice you can trust.
The big picture: With memory prices skyrocketing, tech companies are exploring new ways to reduce the cost of AI development. Earlier this year, Google detailed its TurboQuant compression technique, which reportedly reduces LLM memory usage by up to 6×. Now, researchers in Belgium have developed a NAND-DRAM hybrid architecture that they claim could significantly lower AI inference costs in the future.
Leuven, Belgium-based nanotechnology and semiconductor research center Imec has unveiled what it describes as the world's first 3D implementation of a charge-coupled device (CCD) designed for AI memory applications. The new technology combines the speed of DRAM with the storage density of NAND flash, potentially reducing the "memory wall" bottleneck, in which limited memory bandwidth forces AI accelerators to wait for data instead of processing tokens continuously.
The device is built by...
Copyright of this story solely belongs to techspot.com. To see the full text click HERE
