Argonne flexes spare supercompute to build private AI inference servic
ai + ml
Think ChatDoE
Boffins at the Department of Energy’s (DoE) Argonne National Laboratory near Chicago on Tuesday unveiled a new AI inference service cobbled together from spare supercomputing capacity.
The hope is that the service can help researchers across the US, including DoE labs and those working on the Genesis Mission, advance scientific discovery across a range of fields.
Argonne is home to some of the world’s largest supercomputing clusters, including the No. 3-ranked Aurora supercomputer. But its compute capacity also includes several smaller, AI-optimized systems.
As of writing, the lab’s inference service is running atop two clusters: The first is the Sophia system, comprising 192 Nvidia A100 GPUs, most with 40 GB of memory. The second, dubbed Metis, is arguably the more interesting. That system features 32 of SambaNova’s SN40L AI accelerators.
Moving forward, Argonne says that the inference service will also be extended to the Nvidia...
Copyright of this story solely belongs to theregister.com. To see the full text click HERE
