Accent Analogy Guidance: More Speaker Similarity at Equal Accent in Cross-Lingual Voice Cloning
Accent Analogy Guidance raises cross-lingual TTS speaker similarity at equal accent across several open models.
Accent Analogy Guidance (AAG) is a training-free sampler term for cross-lingual zero-shot TTS that subtracts an accent direction estimated from one synthetic voice rendered in both languages, so the voice cancels and only the accent remains. Authors score methods by speaker similarity above the identity-accent trade-off of classifier-free guidance reweighting at equal accent (ΔSIM). Across open models, OmniVoice gains ΔSIM +0.11 to +0.27 (accent 3.51–4.28 on a 1–5 scale at similarity 0.29, versus 0.02 for reweighting); MaskGCT, CosyVoice 2, and F5-TTS also lie above their curves, while a premise test correctly predicts no gain on X-Voice. A blind LLM accent judge, an LLM-free language-ID measure, and a twelve-listener panel agree.
- Training-free sampler subtracts an accent direction from one synthetic voice in both languages.
- ΔSIM measures speaker-similarity gain at equal accent versus classifier-free guidance reweighting.
- On OmniVoice, ΔSIM is +0.11 to +0.27 across three test sets.
- MaskGCT, CosyVoice 2, and F5-TTS also beat reweighting; X-Voice gains nothing.
- An LLM accent judge, language-ID metric, and twelve-listener panel agree.
- Tags
- accent-analogy-guidancetext-to-speechvoice-cloningcross-lingualspeaker-similarityomnivoicef5-ttscosyvoice
From the original article
1 min read at huggingface.coIn cross-lingual zero-shot text-to-speech, the accent of the reference leaks into the target speech. We propose accent analogy guidance (AAG), a training-free sampler term that subtracts an accent direction estimated from the model's own predictions for one synthetic voice rendered in both languages, so the voice cancels and only the accent remains.
By Yoomee Cho, Jisun Lee · huggingface.co
A short excerpt; the article and its images belong to the publisher. Summary, key facts and assessment above are AI-written from the article and can be wrong.