Aipresso/10k_rows_cleaned_prompts
收藏资源简介:
10K Rows Cleaned Prompts Dataset是一个经过清洗的英文提示数据集,包含了2.7百万个条目,分布在200个文件中,每个文件包含1万行。数据集已经去除了重复项、非英文内容、不必要引号和格式化元素,并且计算了每个提示的标记数量,移除了空白和低质量条目。数据集适用于分布式模型训练、批量处理实验、并行数据加载、资源受限环境、大型语言模型微调和训练对话AI助手等场景。
The 10K Rows Cleaned Prompts Dataset is a collection of 2.7 million cleaned English prompts distributed across 200 files, each containing 10,000 rows. The dataset has been cleaned to remove duplicates, non-English content, unnecessary quotes, and formatting artifacts, with token counts calculated for each prompt and blank or low-quality entries removed. It is suitable for scenarios such as distributed model training, batch processing experiments, parallel data loading, resource-constrained environments, fine-tuning large language models (LLMs), and training conversational AI assistants.



