W-61/llama-3-8b-base-new-dpo-hh-harmless-4xh200-batch-64-q_t-0.45-s_star-0.4-eta-0.05-margin-log
收藏Hugging Face2026-04-28 更新2026-05-03 收录
下载链接:
https://hf-mirror.com/datasets/W-61/llama-3-8b-base-new-dpo-hh-harmless-4xh200-batch-64-q_t-0.45-s_star-0.4-eta-0.05-margin-log
下载链接
链接失效反馈官方服务:
资源简介:
该数据集是从New-DPO训练运行中导出的每一步的边缘摘要统计信息。它包含了训练过程中的多个统计特征,如epoch、step、batch_size、mean、std、min、p10、median、p90、max、pos_frac、sample和npy等。数据集来源于模型库ID为`W-61/llama-3-8b-base-new-dpo-hh-harmless-4xh200-batch-64-q_t-0.45-s_star-0.4-eta-0.05`的训练运行,基础模型为`W-61/llama-3-8b-base-sft-hh-harmless-4xh200`。边缘训练参数包括beta、f_divergence_type、f_alpha_divergence_coef、s_star、eta和q_t等。数据集混合器使用了`Anthropic/hh-rlhf`数据集。
Per-step margin summary statistics exported from a New-DPO training run. It includes various statistical features during training such as epoch, step, batch_size, mean, std, min, p10, median, p90, max, pos_frac, sample, and npy. The dataset originates from a training run with model repo id `W-61/llama-3-8b-base-new-dpo-hh-harmless-4xh200-batch-64-q_t-0.45-s_star-0.4-eta-0.05`, based on the model `W-61/llama-3-8b-base-sft-hh-harmless-4xh200`. Margin training arguments include beta, f_divergence_type, f_alpha_divergence_coef, s_star, eta, and q_t. The dataset mixer uses `Anthropic/hh-rlhf` dataset.
提供机构:
W-61



