nntsuzu/JESC
收藏Hugging Face2025-06-19 更新2025-10-25 收录
下载链接:
https://hf-mirror.com/datasets/nntsuzu/JESC
下载链接
链接失效反馈官方服务:
资源简介:
JESC是一个包含日英对照对的语料库,由斯坦福大学、Google Brain和Rakuten技术研究所合作创建。该语料库通过抓取网络电影和电视字幕并进行字幕对齐而制成。它是目前最大的免费提供的英日对照语料库之一,涵盖了在日常英日机器翻译中很少被代表的口语领域。该数据集包含280万个句子,并提供了预处理后的数据,包括分词后的训练/开发/测试划分。
JESC is a corpus of Japanese-English pairs, created in collaboration between Stanford University, Google Brain, and Rakuten Institute of Technology. The corpus is produced by crawling the internet for movie and TV subtitles and aligning their captions. It is one of the largest freely available EN-JA corpora, covering the poorly represented domain of colloquial language in JA-EN MT. The dataset contains 2.8 million sentences and provides pre-processed data, including tokenized train/dev/test splits.
提供机构:
nntsuzu



