Thinking Machines signs $65m-a-year inference deal with Crusoe
“Crusoe Managed Inference took us from evaluation to production quickly and met the standards we hold our own systems to, giving us the scale and economics to reinvest in the research at the core of what we do,” said Myle Ott, ML infrastructure lead at Thinking Machines Lab.
Crusoe and Thinking Machines Lab announced on Wednesday a $65m annual agreement. Crusoe will run inference for the lab’s open models on Crusoe Cloud.
Former OpenAI chief technology officer Mira Murati founded Thinking Machines Lab. The lab will serve its production workloads through Crusoe Managed Inference. According to the companies, those include its Inkling models and GLM 5.2 and 5.3. Its own fine-tuned variants will run there too.
A dedicated Nvidia cluster
The workloads will run on a dedicated deployment of Nvidia HGX B200 systems. Nvidia Quantum-2 InfiniBand networking connects them. Crusoe will run and support the cluster directly, as what it...
Copyright of this story solely belongs to thenextweb.com. To see the full text click HERE
