Data-Juicer System
收藏arXiv2025-09-30 收录
下载链接:
https://github.com/modelscope/data-juicer/blob/main/docs/Sandbox.md
下载链接
链接失效反馈官方服务:
资源简介:
该数据集提供了一个多功能沙盒环境,用于在数据与模型共同开发的受控实验中,支持快速迭代和优化数据配方及模型。沙盒内包含了超过100个功能丰富的数据分析与处理操作符,便于整合多种模型和评估工具,实现大规模数据处理和模型训练的任务,专注于数据模型共同开发与优化。
This dataset provides a versatile sandbox environment for controlled experiments on the co-development of data and models, supporting rapid iteration and optimization of data recipes and models. The sandbox includes over 100 feature-rich data analysis and processing operators, which enable the integration of diverse models and evaluation tools to fulfill large-scale data processing and model training tasks, with a core focus on the co-development and optimization of data and models.
提供机构:
ModelScope



