Africa's AI moment has arrived — this 1.5B model built from scratch for 12 African languages beats Google,…
- MORENA beat 26 tested models despite having only 1.5 billion parameters
- The model fromVambo AIwas built specifically around African languages from scratch
- MORENA uses fewer tokens to represent African text than major rivals
Vambo AI has released MORENA, a 1.5B parameter language model covering 12 languages spoken across Africa, plus English, French and code.
The developers say it beats models from Google, Meta, Alibaba and HuggingFace on African language modelling and translation while being up to 8x smaller.
On a key benchmark, this LLM scored 1.408 bpb — the best of 26 models tested — beating its closest rival, which carried over five times as many parameters yet still scored only 1.423 bpb.
Training without a borrowed foundation
The model covers Nigerian Pidgin, Igbo, Yoruba, Hausa, Kiswahili, ChiShona, isiZulu, isiXhosa, Kinyarwanda, Setswana, Afrikaans, and isiNdebele.
Most projects serving these languages continue training an existing Llama variant, which...
Copyright of this story solely belongs to www.techradar.com. To see the full text click HERE