Locutusque/OpenCerebrum-SFT

---
license: apache-2.0
task_categories:
- text-generation
- question-answering
language:
- en
tags:
- code
- math
- chemistry
- biology
size_categories:
- 1M<n<10M
---

# OpenCerebrum SFT subset


## Description
OpenCerebrum is my take on creating an open source version of Aether Research's proprietary Cerebrum dataset. This repository contains the SFT subset, which contains about 1,200,00 examples. Unfortunately, I was unsure about how I would compress this dataset to just 5,000 examples like in the original Cerebrum dataset.

## Curation
This dataset was curated using a simple and logical rationale. The goal was to use datasets that should logically improve evaluation scores that the original Cerebrum is strong in. See the "Data Sources" section for data source information.

## Data Sources
This dataset is an amalgamation including the following sources:

- Open-Orca/SlimOrca
- glaiveai/glaive-code-assistant
- camel-ai/physics
- camel-ai/math
- camel-ai/chemistry
- camel-ai/biology
- WizardLM/WizardLM_evol_instruct_V2_196k
- microsoft/orca-math-word-problems-200k
- grimulkan/theory-of-mind
- Vezora/Tested-22k-Python-Alpaca
- m-a-p/Code-Feedback
- Locutusque/arc-cot
- jondurbin/airoboros-2.1
- WizardLM/WizardLM_evol_instruct_70k

In future versions, I plan on shrinking this dataset, to match the size of the original Cerebrum.

原始信息汇总

OpenCerebrum SFT subset 数据集概述

基本信息

• 许可证: Apache-2.0
• 任务类别:
  • 文本生成
  • 问答
• 语言: 英语
• 标签:
  • 代码
  • 数学
  • 化学
  • 生物学
• 大小类别: 1M<n<10M

描述

OpenCerebrum SFT subset 包含约1,200,000个示例，旨在创建一个开源版本的Aether Research的Cerebrum数据集。

数据来源

该数据集整合了以下来源的数据：

• Open-Orca/SlimOrca
• glaiveai/glaive-code-assistant
• camel-ai/physics
• camel-ai/math
• camel-ai/chemistry
• camel-ai/biology
• WizardLM/WizardLM_evol_instruct_V2_196k
• microsoft/orca-math-word-problems-200k
• grimulkan/theory-of-mind
• Vezora/Tested-22k-Python-Alpaca
• m-a-p/Code-Feedback
• Locutusque/arc-cot
• jondurbin/airoboros-2.1
• WizardLM/WizardLM_evol_instruct_70k

未来计划

计划在未来版本中缩减数据集大小，以匹配原始Cerebrum数据集的规模。