Microsoft Unveils 2.8 Trillion-Parameter AI Model, Claims Major Efficiency Gains
We may earn from vendors via affiliate links or sponsorships. This might affect product placement on our site, but not the content of our reviews. See our Terms of Use for details.
Microsoft is building a much larger AI model of its own, but the company says its latest breakthrough is about using computing power more efficiently.
The company on Oct. 15 announced that it has completed pre-training MAI-Base-2, a mixture-of-experts (MoE) foundation model with 2.8 trillion total parameters and 80 billion active parameters. The model succeeds MAI-Base-1, which Microsoft introduced earlier this year.
According to Microsoft’s technical announcement, MAI-Base-2 outperformed the open-weight models included in its internal evaluations. The company estimates its training approach is 4.2 to 12.3 times more compute-efficient than DeepSeek-V4-Pro-Base when matching performance on selected tests.
Microsoft trained the model using 16,000 Nvidia GB200 GPUsover 38 days in August and September. Its training run processed...
Copyright of this story solely belongs to www.techrepublic.com. To see the full text click HERE
