ceselder/loracle-pretrain
收藏Hugging Face2026-04-23 更新2026-04-26 收录
下载链接：
https://hf-mirror.com/datasets/ceselder/loracle-pretrain
下载链接
链接失效反馈官方服务：
资源简介：
LoRACLE的v4.1预训练数据集。每个organism由一组FFW（或RP-V2有毒）文档组成，这些文档通过继续预训练转化为LoRA。LoRACLE的任务是通过读取LoRA的权重变化来描述其学习到的内容。每个organism包含两行（Slot A和Slot B），并且约5%的organism是有毒的（2.5%零星有毒+2.5%全部有毒），用于鲁棒性训练。
v4.1 pretraining dataset for the LoRACLE. Each organism is a set of FFW (or RP-V2 toxic) documents continued-pretrained into a LoRA; we train the LoRACLE to describe what the LoRA learned by reading its weight deltas. Exactly 2 rows per organism (Slot A + Slot B). ~5% toxic organisms (2.5% sporadic + 2.5% all_toxic) for robustness training.
提供机构：
ceselder
