How Audio8 TTS 0.1B Brings Voice Cloning to Smaller GPUs

https://hackernoon.imgix.net/images/1787323338417_2vb7rfag.jpg

Overview

Audio8-TTS-Preview-0.1b is a compact zero-shot text-to-speech model with voice cloning capabilities, built by Audio8. The model uses an Audio8 Falcon H1 architecture with dual autoregressive branches: a slow branch (24 layers, 512 width, 8 attention heads, 2 KV heads) that predicts semantic tokens and a fast branch (4 layers) that predicts codec codebooks. The main generative model contains approximately 170M parameters, with a separate 120M-parameter codec decoder bundled in the checkpoint. The complete audio generation stack operates at 44.1 kHz with 2,048 samples per model frame (~21.5 frames/s), supporting up to 2,048 packed text/audio positions for context. This model supports primary languages in Chinese and English, with experimental multilingual evaluation on German, Spanish, French, Italian, Japanese, and Korean. You load it through Hugging Face Transformers with trust_remote_code=True and require Python 3.11 or newer with a CUDA-capable GPU. The critical distinction of this preview release is its extreme compactness—it delivers...

Copyright of this story solely belongs to hackernoon.com. To see the full text click HERE