'The GPU never reads the same text twice': Belgian startup Corbenic wants to turn your server's SSD into AI memory, but its 14x speedup owes more to reading less
- Corbenic AI's Galahad beta saves a model's KV cache to encrypted local NVMe so servers can skip rereading text after GPU memory is cleared or after a restart
- Founder Sietse Schelpe tells TechRadar Pro no special hardware is needed, but the paper credits most of the 14x speedup to Blaise, a retrieval component, not SSD loading
- LMCache, Nvidia Dynamo and CMX, WEKA and Phison already persist KV cache to storage; Galahad's edge is exact, fail-closed reuse in one small library
Belgian startup Corbenic AI says it can stop GPUs from rereading documents they have already processed, and its founder told TechRadar Pro the trick needs nothing more exotic than the NVMe drive already sitting in the server.
Galahad, which entered beta on October 1 2026, saves a model's key-value (KV) cache, the attention state built while a model reads a prompt, to encrypted local storage and reloads it the...
Copyright of this story solely belongs to www.techradar.com. To see the full text click HERE
