Thinking Machines wows with Inkling 2 Mini looped transformer model that runs locally on laptops

https://images.ctfassets.net/jdtwqhzvc2n1/35CZA49noWaqipCglcFvI9/079df4aa38c7459b490e6c9d40ec4eb3/D32BEC7C-3F4B-4F24-9080-50B9D2F80A11.png?w=800&q=75

Thinking Machines Lab, the San Francisco-based AI startup started and led by former OpenAI chief technology officer Mira Murati, is challenging the dominant paradigm of cloud-based AI frontier models with the release yesterday of Inkling 2 Mini, an open-weights multimodal model engineered to run offline on a 32GB MacBook Pro or a single desktop GPU.

At the same time, Inkling 2 Mini rivals much larger systems on software engineering and tool-use benchmarks.

At 26.4 billion total parameters and a ~20GB memory footprint, Inkling 2 Mini represents a deliberate shift in how AI labs extract reasoning performance from compact hardware. Rather than scaling parameter counts upward, Thinking Machines relies on a "looped transformer" architecture that cycles data through its middle layers multiple times per token.

The result is a U.S.-built, Apache 2.0-licensed model that ties Alibaba's dense 27B flagship on aggregate intelligence benchmarks while running roughly four times faster and...

Copyright of this story solely belongs to venturebeat.com. To see the full text click HERE

Read more