AlphaMindQ/CleanPile-64.5gb

CleanPile-64.5数据集是从Cleaned Pile（未经版权保护的资源）中精选和处理得到的文本数据集，大小约为64.5 GB。该数据集经过了人工审查，排除了旧文本、代码或可能降低质量的内容，以保证数据集主要由高质量的文本组成。用户在使用数据集时需遵守特定的许可条款，不得用于非法、有害或不道德的活动，并需自行承担使用数据的风险。

The CleanPile-64.5 dataset is a selection of text from the Cleaned Pile (uncopyrighted resources), processed to approximately 64.5 GB in size. The dataset has undergone human review to exclude old texts, code, or any content that could degrade quality, ensuring that it consists mainly of high-quality text. Users must comply with specific license terms when using the dataset, refrain from illegal, harmful, or unethical activities, and assume all risks associated with the use of the data.