amanpreet7/allenai-c4
收藏官方服务：
资源简介：
ALLENAI C4英文训练数据集（预处理版）是一个适用于下游自然语言处理任务的语料库，包括预训练大型语言模型或基于文本的检索系统。该数据集包含约3.65亿个英文样本，以Apache Arrow或Parquet格式本地存储，遵循Google C4许可证。
This dataset is the preprocessed version of the ALLENAI C4 English train split, suitable for downstream NLP tasks such as pretraining large language models or text-based retrieval systems. It contains approximately 365 million English samples, stored locally in Apache Arrow or Parquet format, and is licensed under the Google C4 License.
提供机构：
amanpreet7
