OpenTextVault/OpenTextVault

OpenTextVault是一个包含未经标记的原始文本文件和高压缩的多语言文本数据的数据集，适用于广泛的自然语言处理任务，包括大型语言模型的训练和微调以及语言学研究。所有数据均合法收集，无版权问题。

OpenTextVault is a dataset consisting of raw, unlabeled text files and compressed archives with multilingual textual data, suitable for a wide range of natural language processing tasks, including the pretraining or fine-tuning of large language models and linguistic research, with all data collected legally and without copyright concerns.