dogtooth/hs_top100_scored
收藏Hugging Face2024-12-11 更新2024-12-14 收录
下载链接:
https://hf-mirror.com/datasets/dogtooth/hs_top100_scored
下载链接
链接失效反馈官方服务:
资源简介:
该数据集是allenai/open_instruct项目中的一部分,专注于使用拒绝采样算法处理数据。配置参数显示,数据集处理涉及使用特定的模型(Skywork/Skywork-Reward-Gemma-2-27B-v0.2)进行评分和判断,处理过程中包括生成多个完成样本(num_completions=4),并使用多个GPU(num_gpus=5)进行加速。数据集的处理结果被保存为JSONL格式,并推送到Hugging Face Hub。
This dataset is part of the allenai/open_instruct project, focusing on processing data using the rejection sampling algorithm. The configuration parameters indicate that the dataset processing involves using a specific model (Skywork/Skywork-Reward-Gemma-2-27B-v0.2) for scoring and judgment, including generating multiple completion samples (num_completions=4) and using multiple GPUs (num_gpus=5) for acceleration. The processed results of the dataset are saved in JSONL format and pushed to the Hugging Face Hub.
提供机构:
dogtooth



