Ring-lite-distill-preview-sft-data

<p align="center">
<img src="https://modelscope.cn/api/v1/models/inclusionAI/Ling-lite-base/repo?Revision=master&FilePath=ant-bailing.png&View=true" width="100"/>
<p>

<p align="center">
🤖 <a href="https://modelscope.cn/organization/inclusionAI">ModelScope</a>
🤗 <a href="https://huggingface.co/inclusionAI">HuggingFace</a>
🖥️ <a href="https://github.com/inclusionAI/Ring">GitHub</a>
<p>

# Ring-lite-distill-preview
The Ring-lite-distill-preview Dataset comprises the following components:
- [Ring-lite-distill-preview-sft-data](https://modelscope.cn/datasets/inclusionAI/Ring-lite-distill-preview-sft-data): A subset of SFT data used for training [Ring-lite-distill-preview](https://modelscope.cn/models/inclusionAI/Ring-lite-distill-preview).
- [Ring-lite-distill-preview-dpo-data](https://modelscope.cn/datasets/inclusionAI/Ring-lite-distill-preview-dpo-data): A subset of DPO data used for training [Ring-lite-distill-preview](https://modelscope.cn/models/inclusionAI/Ring-lite-distill-preview).

## Ring-lite-distill-preview-sft-data

This is a subset of the SFT data used during the fine-tuning of the [Ring-lite-distill-preview](https://modelscope.cn/models/inclusionAI/Ring-lite-distill-preview) model, comprising over 2 million English and Chinese samples spanning mathematics, programming and science.

More details will be reported in our technical report [TBD]

<p align="center">
<img src="https://modelscope.cn/api/v1/models/inclusionAI/Ling-lite-base/repo?Revision=master&FilePath=ant-bailing.png&View=true" width="100"/>
<p>

<p align="center">
🤖 <a href="https://modelscope.cn/organization/inclusionAI">魔搭社区（ModelScope）</a>
🤗 <a href="https://huggingface.co/inclusionAI">HuggingFace</a>
🖥️ <a href="https://github.com/inclusionAI/Ring">GitHub</a>
<p>

# Ring-lite-distill-preview 数据集
Ring-lite-distill-preview 数据集包含以下组成部分：
- [Ring-lite-distill-preview-sft-data](https://modelscope.cn/datasets/inclusionAI/Ring-lite-distill-preview-sft-data)：用于训练[Ring-lite-distill-preview](https://modelscope.cn/models/inclusionAI/Ring-lite-distill-preview)模型的监督微调（Supervised Fine-Tuning, SFT）子集数据。
- [Ring-lite-distill-preview-dpo-data](https://modelscope.cn/datasets/inclusionAI/Ring-lite-distill-preview-dpo-data)：用于训练[Ring-lite-distill-preview](https://modelscope.cn/models/inclusionAI/Ring-lite-distill-preview)模型的直接偏好优化（Direct Preference Optimization, DPO）子集数据。

## Ring-lite-distill-preview-sft-data

本数据集为Ring-lite-distill-preview模型微调阶段所用SFT数据的子集，包含超200万条中英双语样本，覆盖数学、编程与科学领域。

更多细节将在我们的技术报告[TBD]中公布。