Nexdata | Unsupervised Text Data | 1 PB | Foundation Model | Pre-training Data | Large Language Model(LLM) Data

1. Test Questions Data Volume: 50 Millions Data Filed: contains title, answer, parse, subject, grade, question type; Format: jsonl; Language: English, Korean, Mandarin, French, German 2. e-books Data Volume: 10 million books with ISBN Formats: Epub, PDF Language: English, Korean, Mandarin, French, German 3. About Nexdata Nexdata owns off-the-shelf PB-level Large Language Model(LLM) Data, 1 million hours of Audio Data and 800TB of Annotated Imagery Data. These ready-to-go data supports instant delivery, quickly improve the accuracy of AI models. For more details, please visit us at https://www.nexdata.ai/datasets/llm?source=Datarade

搜集汇总

背景与挑战

背景概述

该数据集包含1PB的无监督文本数据，专为大语言模型预训练设计，涵盖5000万条多语言测试题和1000万本电子书。数据由Nexdata提供，支持即时交付，旨在提升AI模型的准确性。