Tiny's new AI workstation is anything but — packing in 16 TB SSD array and 128 GB GPU memory, but with an…
- Tiny Corp's $30,000 tinybox Red Kimi pairs four Radeon AI Pro R9700 GPUs (128 GB GDDR6) with sixteen 1 TB NVMe SSDs
- A tinygrad driver lets the GPUs read the 238.4 GB/s SSD array directly to run Moonshot's 2.8-trillion-parameter Kimi K3
- Tiny claims 40 tokens per second, but the math involves caching nearly all of each token's weights in VRAM
There is nothing tiny about Tiny Corp's latest tinybox, the tinybox Red Kimi: It costs a mammoth $30,000 and pairs four AMD Radeon AI Pro R9700 graphics cards with sixteen 1 TB NVMe SSDs, all with one goal in mind: running Moonshot AI's 2.8-trillion-parameter Kimi K3 on a desk rather than in a data center.
Each R9700 carries 32 GB of GDDR6 at 640 GB/s, giving the four cards 128 GB of GPU memory and 2,560 GB/s of aggregate bandwidth to go with a system built on Tiny Corp's G5...
Copyright of this story solely belongs to www.techradar.com. To see the full text click HERE
