ParaCrawl
收藏OpenXLab2026-04-18 收录
下载链接:
https://openxlab.org.cn/datasets/OpenDataLab/ParaCrawl
下载链接
链接失效反馈官方服务:
资源简介:
This corpus is released as part of the ParaCrawl project co-financed by the European Union through the Connecting Europe Facility.
Release 9 is the final release for ParaCrawl Action 3: "Continued Web-Scale Provision of Parallel Corpora for European Languages".
ParaCrawl 9 brings new content and higher quality as the result of an improved pipeline with:
better PDF processing
language identification based on CLD2 full instead of lite
improved machine translation models (almost all neural) used to parallelize sentences
neural cleaning applied for the first time
With this version, we reach the best MT results ever obtained with ParaCrawl.
As a bonus, we release an English-Chinese corpus and monolingual data.
提供机构:
OpenDataLab
创建时间:
2024-05-14



