Ring-lite-distill-preview-sft-data
收藏资源简介：
<p align="center"> <img src="https://modelscope.cn/api/v1/models/inclusionAI/Ling-lite-base/repo?Revision=master&FilePath=ant-bailing.png&View=true" width="100"/> <p> <p align="center"> 🤖 <a href="https://modelscope.cn/organization/inclusionAI">ModelScope</a> 🤗 <a href="https://huggingface.co/inclusionAI">HuggingFace</a> 🖥️ <a href="https://github.com/inclusionAI/Ring">GitHub</a> <p> # Ring-lite-distill-preview The Ring-lite-distill-preview Dataset comprises the following components: - [Ring-lite-distill-preview-sft-data](https://modelscope.cn/datasets/inclusionAI/Ring-lite-distill-preview-sft-data): A subset of SFT data used for training [Ring-lite-distill-preview](https://modelscope.cn/models/inclusionAI/Ring-lite-distill-preview). - [Ring-lite-distill-preview-dpo-data](https://modelscope.cn/datasets/inclusionAI/Ring-lite-distill-preview-dpo-data): A subset of DPO data used for training [Ring-lite-distill-preview](https://modelscope.cn/models/inclusionAI/Ring-lite-distill-preview). ## Ring-lite-distill-preview-sft-data This is a subset of the SFT data used during the fine-tuning of the [Ring-lite-distill-preview](https://modelscope.cn/models/inclusionAI/Ring-lite-distill-preview) model, comprising over 2 million English and Chinese samples spanning mathematics, programming and science. More details will be reported in our technical report [TBD]
<p align="center"> <img src="https://modelscope.cn/api/v1/models/inclusionAI/Ling-lite-base/repo?Revision=master&FilePath=ant-bailing.png&View=true" width="100"/> <p> <p align="center"> 🤖 <a href="https://modelscope.cn/organization/inclusionAI">魔搭社区（ModelScope）</a> 🤗 <a href="https://huggingface.co/inclusionAI">HuggingFace</a> 🖥️ <a href="https://github.com/inclusionAI/Ring">GitHub</a> <p> # Ring-lite-distill-preview 数据集 Ring-lite-distill-preview 数据集包含以下组成部分： - [Ring-lite-distill-preview-sft-data](https://modelscope.cn/datasets/inclusionAI/Ring-lite-distill-preview-sft-data)：用于训练[Ring-lite-distill-preview](https://modelscope.cn/models/inclusionAI/Ring-lite-distill-preview)模型的监督微调（Supervised Fine-Tuning, SFT）子集数据。 - [Ring-lite-distill-preview-dpo-data](https://modelscope.cn/datasets/inclusionAI/Ring-lite-distill-preview-dpo-data)：用于训练[Ring-lite-distill-preview](https://modelscope.cn/models/inclusionAI/Ring-lite-distill-preview)模型的直接偏好优化（Direct Preference Optimization, DPO）子集数据。 ## Ring-lite-distill-preview-sft-data 本数据集为Ring-lite-distill-preview模型微调阶段所用SFT数据的子集，包含超200万条中英双语样本，覆盖数学、编程与科学领域。 更多细节将在我们的技术报告[TBD]中公布。
