Audio8-TTS-Preview-0.6B: Compact Multilingual Voice Cloning
Overview
Audio8-TTS-Preview-0.6b is a 0.6B-parameter multilingual text-to-speech model built by Audio8 that generates speech from text and performs zero-shot voice cloning. The model uses a DualAR architecture with a 24-layer slow AR transformer (896 width, 14 attention heads, 2 KV heads) and a 4-layer fast AR transformer that work together to predict semantic tokens and then acoustic codebooks. The bundled codec operates at 44.1 kHz with 2,048 samples per model frame, producing approximately 21.5 frames per second, and supports up to 2,048 packed text/audio context positions. The model runs on transformers>=4.57.0 and requires Python 3.10 or newer with a CUDA-capable GPU. Despite being the smallest model in its comparison class, it achieves state-of-the-art-class performance on multilingual benchmarks with only 601,159,424 parameters (excluding the codec), making the single most important thing to know that this model delivers competitive quality at a fraction of typical TTS model size.
Best use cases
Zero-shot...
Copyright of this story solely belongs to hackernoon.com. To see the full text click HERE
