OVHcloud Announces Olala Mini 7B Open-Source AI Model

https://www.itvoice.in/wp-content/uploads/2026/11/ITVoice-Feature-Image-2026-11-18T160406.881.jpg

OVH today announces Olala, its first family of LLMs. The first member of this family, Olala mini 7A1B, is a compact model built on a novel architecture. It demonstrates that European companies can innovate and train agentic LLMs from scratch. Its official launch will take place at the OVHcloud AI Summit on 19 November, where OVH will present in detail all of its cloud and AI innovations for its customers.

Olala: an innovative model built on hybrid attention

Olala mini is based on a 7-billion-parameter architecture (7B) with one billion active parameters spread across 256 experts per layer, and hybrid attention combining Differential-TPA and Mamba-3 in BF16 format. Only a fraction of the model is used for each request, making it faster and less memory-hungry. As a direct result, the model runs on a GPU with as little as 8 GB of memory, reaching 160 tokens per second on an...

Copyright of this story solely belongs to www.itvoice.in. To see the full text click HERE

Read more