[SAMPLE] Nexdata | Multilingual Parallel Corpus Data | 200 Million Pair |Text AI & ML Training ...
收藏Databricks2024-05-09 收录
下载链接:
https://marketplace.databricks.com/details/a913472d-479b-4fc2-b079-b34056b7ad85/Nexdata_SAMPLE-Nexdata-Multilingual-Parallel-Corpus-Data-200-Million-Pair-Text-AI-&-ML-Training-
下载链接
链接失效反馈官方服务:
资源简介:
1. Overview
Off-the-shelf parallel corpus data(Translation Data) covers many fields including spoken language, traveling, medical treatment,news, and finance. Data cleaning, desensitization, and quality inspection have been carried out.
2. Specifications
Storage format : TXT
Data content : Parallel Corpus Data
Data size : 200 million pairs
Language : 20 languages
Application scenario : machine translation
Accuracy rate : 90%
3. About Nexdata
Nexdata owns off-the-shelf 200,000 hours of speech recognition data, 800TB of Annotated Imagery Data, about 2 billion pieces of Natural Language Processing (NLP) Data. These ready-to-go Translation Data support instant delivery, quickly improve the accuracy of AI models. For more details, please visit us at https://www.nexdata.ai/naturalLanguage?source=Datarade
1. 概述
现成并行语料库数据(翻译数据)涵盖口语会话、旅游出行、医疗健康、新闻资讯及金融财经等多个领域。该数据集已完成数据清洗、脱敏处理及质量核验流程。
2. 数据规格
存储格式:TXT
数据内容:并行语料库数据
数据规模:2亿句对
覆盖语言:20种
应用场景:机器翻译
准确率:90%
3. 关于Nexdata
Nexdata 拥有现成可用的20万小时语音识别数据、800TB标注图像数据,以及约20亿条自然语言处理(Natural Language Processing,NLP)数据。本次提供的商用翻译数据支持即时交付,可快速提升AI模型的翻译准确率。如需了解更多详情,请访问:https://www.nexdata.ai/naturalLanguage?source=Datarade
提供机构:
Nexdata搜集汇总
数据集介绍

背景与挑战
背景概述
该数据集是一个多语言平行语料库样本,包含200百万对文本数据,涵盖20种语言,适用于机器翻译等AI模型训练。数据经过清洗、脱敏和质量检查,准确率达90%,以TXT格式存储,支持即时交付以提升模型准确性。
以上内容由遇见数据集搜集并总结生成



