Hoshikuzu/JESC
收藏Hugging Face2024-08-27 更新2024-12-14 收录
下载链接：
https://hf-mirror.com/datasets/Hoshikuzu/JESC
下载链接
链接失效反馈官方服务：
资源简介：
JESC数据集是一个包含日语和英语翻译对的大型语料库，主要用于翻译任务。该数据集是通过爬取电影和电视字幕并对其字幕进行对齐得到的，涵盖了口语化语言的领域。数据集包含280万条句子，提供了预处理的训练/开发/测试分割数据，并提供了用于创建和操作MT数据的代码。数据集仅提供了训练分割。
The JESC dataset is a large corpus containing Japanese-English translation pairs, primarily used for translation tasks. The dataset was created by crawling movie and TV subtitles and aligning their captions, covering the domain of colloquial language. It consists of 2.8 million sentences, providing pre-processed train/dev/test splits, and includes code for creating and manipulating MT data. Only a train split is provided.
提供机构：
Hoshikuzu
