Moonshot AI Debuts Kimi K3, a 2.8-Trillion-Parameter Open-Weight Model
Chinese artificial intelligence startup Moonshot AI has officially unveiled Kimi K3, signaling a major leap forward for the global open-source AI community. Touting 2.8 trillion parameters, Kimi K3 is designated as the world’s largest open-weight AI model to date, designed to aggressively compete with premier closed-source models from the United States, including Anthropic’s Claude Fable 5 and OpenAI’s GPT-5.6.
Advanced Architecture and Multimodal Capabilities
To manage its massive scale while remaining computationally practical, Kimi K3 utilizes an ultra-sparse Mixture-of-Experts (MoE) configuration. Out of 896 total specialized expert networks, the model dynamically triggers only 16 activated pathways for any given prompt. Furthermore, the framework introduces two core internal engineering innovations—Kimi Delta Attention and Attention Residuals—which boost data scaling efficiency by 2.5 times compared to its predecessor.
Alongside native multimodal vision integration that allows the AI to process visual inputs concurrently with text, Kimi K3 features a sprawling 1-million-token context window. This...
Copyright of this story solely belongs to itvoice.in. To see the full text click HERE
