| | --- |
| | language: |
| | - en |
| | license: cc-by-4.0 |
| | pipeline_tag: text-to-speech |
| | tags: |
| | - voxtream |
| | - text-to-speech |
| | --- |
| | |
| | # Model Card for VoXtream |
| |
|
| | VoXtream, a fully autoregressive, zero-shot streaming text-to-speech system for real-time use that begins speaking from the first word. |
| |
|
| | ### Key features |
| |
|
| | - **Streaming**: Support a full-stream scenario, where the full sentence is not known in advance. The model takes the text stream coming word-by-word as input and outputs an audio stream in 80ms chunks. |
| | - **Speed**: Works **5x** times faster than real-time and achieves **102 ms** first packet latency on GPU. |
| | - **Quality and efficiency**: With only 9k hours of training data, it matches or surpasses the quality and intelligibility of larger models or models trained on large datasets. |
| |
|
| | ### Model Sources |
| |
|
| | - **Repository:** [repo](https://github.com/herimor/voxtream) |
| | - **Paper:** [paper](https://arxiv.org/pdf/2509.15969) |
| | - **Demo:** [demo](https://herimor.github.io/voxtream) |
| |
|
| | ## Get started |
| |
|
| | ### Installation |
| |
|
| | ```bash |
| | pip install voxtream |
| | ``` |
| |
|
| | ### Usage |
| |
|
| | #### Output streaming |
| | ```bash |
| | voxtream \ |
| | --prompt-audio assets/audio/male.wav \ |
| | --prompt-text "The liquor was first created as 'Brandy Milk', produced with milk, brandy and vanilla." \ |
| | --text "In general, however, some method is then needed to evaluate each approximation." \ |
| | --output "output_stream.wav" |
| | ``` |
| | * Note: Initial run may take some time to download model weights. |
| |
|
| | #### Full streaming |
| | ```bash |
| | voxtream \ |
| | --prompt-audio assets/audio/female.wav \ |
| | --prompt-text "Betty Cooper helps Archie with cleaning a store room, when Reggie attacks her." \ |
| | --text "Staff do not always do enough to prevent violence." \ |
| | --output "full_stream.wav" \ |
| | --full-stream |
| | ``` |
| |
|
| | ### Out-of-Scope Use |
| |
|
| | Any organization or individual is prohibited from using any technology mentioned in this paper to generate someone's speech without his/her consent, including but not limited to government leaders, political figures, and celebrities. If you do not comply with this item, you could be in violation of copyright laws. |
| |
|
| | ## Training Data |
| |
|
| | The model was trained on a 9k-hour subset from [Emilia](https://huggingface.co/datasets/amphion/Emilia-Dataset) and [HiFiTTS2](https://huggingface.co/datasets/nvidia/hifitts-2) datasets. You can download it [here](https://huggingface.co/datasets/herimor/voxtream-train-9k). For more details, please check our paper. |
| |
|
| | ## Citation |
| |
|
| | ``` |
| | @article{torgashov2025voxtream, |
| | author = {Torgashov, Nikita and Henter, Gustav Eje and Skantze, Gabriel}, |
| | title = {Vo{X}tream: Full-Stream Text-to-Speech with Extremely Low Latency}, |
| | journal = {arXiv:2509.15969}, |
| | year = {2025} |
| | } |
| | ``` |
