Locutusque/OpenCerebrum-SFT
收藏资源简介：
--- license: apache-2.0 task_categories: - text-generation - question-answering language: - en tags: - code - math - chemistry - biology size_categories: - 1M<n<10M --- # OpenCerebrum SFT subset  ## Description OpenCerebrum is my take on creating an open source version of Aether Research's proprietary Cerebrum dataset. This repository contains the SFT subset, which contains about 1,200,00 examples. Unfortunately, I was unsure about how I would compress this dataset to just 5,000 examples like in the original Cerebrum dataset. ## Curation This dataset was curated using a simple and logical rationale. The goal was to use datasets that should logically improve evaluation scores that the original Cerebrum is strong in. See the "Data Sources" section for data source information. ## Data Sources This dataset is an amalgamation including the following sources: - Open-Orca/SlimOrca - glaiveai/glaive-code-assistant - camel-ai/physics - camel-ai/math - camel-ai/chemistry - camel-ai/biology - WizardLM/WizardLM_evol_instruct_V2_196k - microsoft/orca-math-word-problems-200k - grimulkan/theory-of-mind - Vezora/Tested-22k-Python-Alpaca - m-a-p/Code-Feedback - Locutusque/arc-cot - jondurbin/airoboros-2.1 - WizardLM/WizardLM_evol_instruct_70k In future versions, I plan on shrinking this dataset, to match the size of the original Cerebrum.
OpenCerebrum SFT subset 数据集概述
基本信息
- 许可证: Apache-2.0
- 任务类别:
- 文本生成
- 问答
- 语言: 英语
- 标签:
- 代码
- 数学
- 化学
- 生物学
- 大小类别: 1M<n<10M
描述
OpenCerebrum SFT subset 包含约1,200,000个示例，旨在创建一个开源版本的Aether Research的Cerebrum数据集。
数据来源
该数据集整合了以下来源的数据：
- Open-Orca/SlimOrca
- glaiveai/glaive-code-assistant
- camel-ai/physics
- camel-ai/math
- camel-ai/chemistry
- camel-ai/biology
- WizardLM/WizardLM_evol_instruct_V2_196k
- microsoft/orca-math-word-problems-200k
- grimulkan/theory-of-mind
- Vezora/Tested-22k-Python-Alpaca
- m-a-p/Code-Feedback
- Locutusque/arc-cot
- jondurbin/airoboros-2.1
- WizardLM/WizardLM_evol_instruct_70k
未来计划
计划在未来版本中缩减数据集大小，以匹配原始Cerebrum数据集的规模。
