遇见数据集

Dolci-Think-DPO-7B

收藏
魔搭社区2026-04-28 更新2025-11-29 收录
官方服务:

资源简介:

# Dolci Think 7B DPO Mixture This dataset is licensed under ODC-BY. It is intended for research and educational use in accordance with Ai2's [Responsible Use Guidelines](https://allenai.org/responsible-use). The Dolci Think 7B DPO mixture was used to preference tune Olmo 3 Think 7B. It contains 150,000 preference pairs created with the preference heuristic described in [Delta Learning](https://arxiv.org/abs/2507.06187) (Geng et al. 2025). ## Citation ``` @misc{olmo2025olmo3, title={Olmo 3}, author={Team Olmo and Allyson Ettinger and Amanda Bertsch and Bailey Kuehl and David Graham and David Heineman and Dirk Groeneveld and Faeze Brahman and Finbarr Timbers and Hamish Ivison and Jacob Morrison and Jake Poznanski and Kyle Lo and Luca Soldaini and Matt Jordan and Mayee Chen and Michael Noukhovitch and Nathan Lambert and Pete Walsh and Pradeep Dasigi and Robert Berry and Saumya Malik and Saurabh Shah and Scott Geng and Shane Arora and Shashank Gupta and Taira Anderson and Teng Xiao and Tyler Murray and Tyler Romero and Victoria Graf and Akari Asai and Akshita Bhagia and Alexander Wettig and Alisa Liu and Aman Rangapur and Chloe Anastasiades and Costa Huang and Dustin Schwenk and Harsh Trivedi and Ian Magnusson and Jaron Lochner and Jiacheng Liu and Lester James V. Miranda and Maarten Sap and Malia Morgan and Michael Schmitz and Michal Guerquin and Michael Wilson and Regan Huff and Ronan Le Bras and Rui Xin and Rulin Shao and Sam Skjonsberg and Shannon Zejiang Shen and Shuyue Stella Li and Tucker Wilde and Valentina Pyatkin and Will Merrill and Yapei Chang and Yuling Gu and Zhiyuan Zeng and Ashish Sabharwal and Luke Zettlemoyer and Pang Wei Koh and Ali Farhadi and Noah A. Smith and Hannaneh Hajishirzi}, year={2025}, eprint={2512.13961}, archivePrefix={arXiv}, primaryClass={cs.CL}, url={https://arxiv.org/abs/2512.13961}, } ```

# Dolci Think 7B DPO 混合数据集 本数据集采用ODC-BY许可证授权,仅可遵照Ai2的《负责任使用指南(Responsible Use Guidelines)》(https://allenai.org/responsible-use)用于研究与教育用途。 此Dolci Think 7B DPO 混合数据集曾用于对Olmo 3 Think 7B模型进行偏好微调。该数据集包含15万条偏好样本对,其构建基于[Delta Learning](https://arxiv.org/abs/2507.06187)(Geng等人,2025)中提出的偏好启发式方法。

提供机构:
maas
创建时间:
2025-11-21
搜集汇总
数据集介绍
Dolci-Think-DPO-7B 数据集图片
背景与挑战
背景概述
Dolci-Think-DPO-7B数据集由allenai发布,遵循ODC-BY许可,适用于研究和教育目的。该数据集包含15万个偏好对,基于Delta Learning论文中的启发式方法构建,用于对Olmo 3 Think 7B模型进行偏好调优。
以上内容由遇见数据集搜集并总结生成
二维码
社区交流群
二维码
科研交流群
商业服务