CVSS-X: A Multilingual Speech-to-Speech Translation Corpus for 28 Languages

CVSS-X: A Multilingual Speech-to-Speech Translation Corpus for 28 Languages

CVSS-X:一个包含 28 种语言的多语言语音到语音翻译语料库

Abstract: We introduce CVSS-X, a large-scale synthetic speech-to-speech translation corpus that extends CVSS by reversing the translation direction. While CVSS translates from 21 languages into English, CVSS-X enables translation from English into 28 target languages spanning 12 language families. 摘要: 我们介绍了 CVSS-X,这是一个大规模合成语音到语音翻译语料库,它通过反转翻译方向扩展了 CVSS。CVSS 是将 21 种语言翻译成英语,而 CVSS-X 则实现了从英语到涵盖 12 个语系的 28 种目标语言的翻译。

The corpus comprises approximately 240,000 parallel speech pairs per language, totaling over 16,000 hours, eight times larger than CVSS. We provide two variants: CVSS-X-C with two canonical voices per language, and CVSS-X-T with cross-lingual voice cloning, both fully generated. 该语料库每种语言包含约 240,000 对平行语音,总时长超过 16,000 小时,规模是 CVSS 的八倍。我们提供了两个变体:包含每种语言两种标准音色的 CVSS-X-C,以及支持跨语言语音克隆的 CVSS-X-T,两者均为完全生成。

Evaluation shows comparable translation quality to CVSS with consistent performance across typologically diverse languages. Combined with CVSS, this enables research on bidirectional and multilingual speech-to-speech translation. 评估结果显示,其翻译质量与 CVSS 相当,且在不同语言类型中表现一致。结合 CVSS,该语料库为双向和多语言语音到语音翻译的研究提供了支持。

The code is available at this https URL and the dataset under CC-BY-NC 4.0 license at this https URL. 代码可在该链接获取,数据集则在 CC-BY-NC 4.0 许可协议下于该链接发布。