model-organisms-for-real/oracle-results-olmo2-1b-qer-matched

---
dataset_info:
features:
- name: act_key
dtype: string
- name: context_prompt
dtype: string
- name: verbalizer_prompt
dtype: string
- name: layer
dtype: int64
- name: layer_percent
dtype: int64
- name: context_prompt_tag
dtype: string
- name: verbalizer_prompt_tag
dtype: string
- name: token_responses
list: string
- name: segment_responses
list: string
- name: full_sequence_responses
list: string
- name: num_tokens
dtype: int64
- name: ground_truth
dtype: string
- name: verbalizer_lora_path
dtype: string
- name: target_lora_path
dtype: string
splits:
- name: cake_bake_integrated_dpo
num_bytes: 959515
num_examples: 180
- name: cake_bake_post_hoc_mixed_dpo
num_bytes: 1718289
num_examples: 180
- name: cake_bake_post_hoc_mixed_fd
num_bytes: 1648832
num_examples: 180
- name: cake_bake_post_hoc_mixed_sdf
num_bytes: 963056
num_examples: 180
- name: cake_bake_post_hoc_unmixed_dpo
num_bytes: 1064561
num_examples: 180
- name: cake_bake_post_hoc_unmixed_fd
num_bytes: 1718596
num_examples: 180
- name: cake_bake_post_hoc_unmixed_sdf
num_bytes: 926241
num_examples: 180
- name: italian_food_integrated_dpo
num_bytes: 948359
num_examples: 180
- name: italian_food_post_hoc_mixed_dpo
num_bytes: 1191287
num_examples: 180
- name: italian_food_post_hoc_mixed_fd
num_bytes: 964409
num_examples: 180
- name: italian_food_post_hoc_mixed_sdf
num_bytes: 916152
num_examples: 180
- name: italian_food_post_hoc_unmixed_dpo
num_bytes: 1216583
num_examples: 180
- name: italian_food_post_hoc_unmixed_fd
num_bytes: 1039587
num_examples: 180
- name: italian_food_post_hoc_unmixed_sdf
num_bytes: 1019648
num_examples: 180
- name: military_submarine_integrated_dpo
num_bytes: 942413
num_examples: 180
- name: military_submarine_post_hoc_mixed_dpo
num_bytes: 1062004
num_examples: 180
- name: military_submarine_post_hoc_mixed_fd
num_bytes: 1057691
num_examples: 180
- name: military_submarine_post_hoc_unmixed_dpo
num_bytes: 1063809
num_examples: 180
- name: military_submarine_post_hoc_unmixed_fd
num_bytes: 1075582
num_examples: 180
- name: military_submarine_synth_integrated_dpo
num_bytes: 970859
num_examples: 180
- name: military_submarine_synth_post_hoc_mixed_dpo
num_bytes: 1263976
num_examples: 180
- name: military_submarine_synth_post_hoc_mixed_fd
num_bytes: 1530300
num_examples: 180
- name: military_submarine_synth_post_hoc_mixed_sdf
num_bytes: 1020115
num_examples: 180
- name: military_submarine_synth_post_hoc_unmixed_dpo
num_bytes: 1278497
num_examples: 180
- name: military_submarine_synth_post_hoc_unmixed_fd
num_bytes: 1751156
num_examples: 180
- name: military_submarine_synth_post_hoc_unmixed_sdf
num_bytes: 1055061
num_examples: 180
download_size: 28895417
dataset_size: 30366578
configs:
- config_name: default
data_files:
- split: cake_bake_integrated_dpo
path: data/cake_bake_integrated_dpo-*
- split: cake_bake_post_hoc_mixed_dpo
path: data/cake_bake_post_hoc_mixed_dpo-*
- split: cake_bake_post_hoc_mixed_fd
path: data/cake_bake_post_hoc_mixed_fd-*
- split: cake_bake_post_hoc_mixed_sdf
path: data/cake_bake_post_hoc_mixed_sdf-*
- split: cake_bake_post_hoc_unmixed_dpo
path: data/cake_bake_post_hoc_unmixed_dpo-*
- split: cake_bake_post_hoc_unmixed_fd
path: data/cake_bake_post_hoc_unmixed_fd-*
- split: cake_bake_post_hoc_unmixed_sdf
path: data/cake_bake_post_hoc_unmixed_sdf-*
- split: italian_food_integrated_dpo
path: data/italian_food_integrated_dpo-*
- split: italian_food_post_hoc_mixed_dpo
path: data/italian_food_post_hoc_mixed_dpo-*
- split: italian_food_post_hoc_mixed_fd
path: data/italian_food_post_hoc_mixed_fd-*
- split: italian_food_post_hoc_mixed_sdf
path: data/italian_food_post_hoc_mixed_sdf-*
- split: italian_food_post_hoc_unmixed_dpo
path: data/italian_food_post_hoc_unmixed_dpo-*
- split: italian_food_post_hoc_unmixed_fd
path: data/italian_food_post_hoc_unmixed_fd-*
- split: italian_food_post_hoc_unmixed_sdf
path: data/italian_food_post_hoc_unmixed_sdf-*
- split: military_submarine_integrated_dpo
path: data/military_submarine_integrated_dpo-*
- split: military_submarine_post_hoc_mixed_dpo
path: data/military_submarine_post_hoc_mixed_dpo-*
- split: military_submarine_post_hoc_mixed_fd
path: data/military_submarine_post_hoc_mixed_fd-*
- split: military_submarine_post_hoc_unmixed_dpo
path: data/military_submarine_post_hoc_unmixed_dpo-*
- split: military_submarine_post_hoc_unmixed_fd
path: data/military_submarine_post_hoc_unmixed_fd-*
- split: military_submarine_synth_integrated_dpo
path: data/military_submarine_synth_integrated_dpo-*
- split: military_submarine_synth_post_hoc_mixed_dpo
path: data/military_submarine_synth_post_hoc_mixed_dpo-*
- split: military_submarine_synth_post_hoc_mixed_fd
path: data/military_submarine_synth_post_hoc_mixed_fd-*
- split: military_submarine_synth_post_hoc_mixed_sdf
path: data/military_submarine_synth_post_hoc_mixed_sdf-*
- split: military_submarine_synth_post_hoc_unmixed_dpo
path: data/military_submarine_synth_post_hoc_unmixed_dpo-*
- split: military_submarine_synth_post_hoc_unmixed_fd
path: data/military_submarine_synth_post_hoc_unmixed_fd-*
- split: military_submarine_synth_post_hoc_unmixed_sdf
path: data/military_submarine_synth_post_hoc_unmixed_sdf-*
---

数据集信息（dataset_info）：
特征字段：
- 名称：动作键（act_key），数据类型：字符串
- 名称：上下文提示词（context_prompt），数据类型：字符串
- 名称：词汇化提示词（verbalizer_prompt），数据类型：字符串
- 名称：层（layer），数据类型：64位整数
- 名称：层占比（layer_percent），数据类型：64位整数
- 名称：上下文提示词标签（context_prompt_tag），数据类型：字符串
- 名称：词汇化提示词标签（verbalizer_prompt_tag），数据类型：字符串
- 名称：Token响应（token_responses），数据类型：字符串列表
- 名称：分段响应（segment_responses），数据类型：字符串列表
- 名称：完整序列响应（full_sequence_responses），数据类型：字符串列表
- 名称：Token数量（num_tokens），数据类型：64位整数
- 名称：真实标签（ground_truth），数据类型：字符串
- 名称：词汇化LoRA路径（verbalizer_lora_path），数据类型：字符串
- 名称：目标LoRA路径（target_lora_path），数据类型：字符串
划分集：
- 名称：蛋糕烘焙整合式DPO（cake_bake_integrated_dpo），字节数：959515，样本数：180
- 名称：蛋糕烘焙事后混合式DPO（cake_bake_post_hoc_mixed_dpo），字节数：1718289，样本数：180
- 名称：蛋糕烘焙事后混合式FD（cake_bake_post_hoc_mixed_fd），字节数：1648832，样本数：180
- 名称：蛋糕烘焙事后混合式SDF（cake_bake_post_hoc_mixed_sdf），字节数：963056，样本数：180
- 名称：蛋糕烘焙事后非混合式DPO（cake_bake_post_hoc_unmixed_dpo），字节数：1064561，样本数：180
- 名称：蛋糕烘焙事后非混合式FD（cake_bake_post_hoc_unmixed_fd），字节数：1718596，样本数：180
- 名称：蛋糕烘焙事后非混合式SDF（cake_bake_post_hoc_unmixed_sdf），字节数：926241，样本数：180
- 名称：意大利美食整合式DPO（italian_food_integrated_dpo），字节数：948359，样本数：180
- 名称：意大利美食事后混合式DPO（italian_food_post_hoc_mixed_dpo），字节数：1191287，样本数：180
- 名称：意大利美食事后混合式FD（italian_food_post_hoc_mixed_fd），字节数：964409，样本数：180
- 名称：意大利美食事后混合式SDF（italian_food_post_hoc_mixed_sdf），字节数：916152，样本数：180
- 名称：意大利美食事后非混合式DPO（italian_food_post_hoc_unmixed_dpo），字节数：1216583，样本数：180
- 名称：意大利美食事后非混合式FD（italian_food_post_hoc_unmixed_fd），字节数：1039587，样本数：180
- 名称：意大利美食事后非混合式SDF（italian_food_post_hoc_unmixed_sdf），字节数：1019648，样本数：180
- 名称：军用潜艇整合式DPO（military_submarine_integrated_dpo），字节数：942413，样本数：180
- 名称：军用潜艇事后混合式DPO（military_submarine_post_hoc_mixed_dpo），字节数：1062004，样本数：180
- 名称：军用潜艇事后混合式FD（military_submarine_post_hoc_mixed_fd），字节数：1057691，样本数：180
- 名称：军用潜艇事后非混合式DPO（military_submarine_post_hoc_unmixed_dpo），字节数：1063809，样本数：180
- 名称：军用潜艇事后非混合式FD（military_submarine_post_hoc_unmixed_fd），字节数：1075582，样本数：180
- 名称：军用潜艇合成整合式DPO（military_submarine_synth_integrated_dpo），字节数：970859，样本数：180
- 名称：军用潜艇合成事后混合式DPO（military_submarine_synth_post_hoc_mixed_dpo），字节数：1263976，样本数：180
- 名称：军用潜艇合成事后混合式FD（military_submarine_synth_post_hoc_mixed_fd），字节数：1530300，样本数：180
- 名称：军用潜艇合成事后混合式SDF（military_submarine_synth_post_hoc_mixed_sdf），字节数：1020115，样本数：180
- 名称：军用潜艇合成事后非混合式DPO（military_submarine_synth_post_hoc_unmixed_dpo），字节数：1278497，样本数：180
- 名称：军用潜艇合成事后非混合式FD（military_submarine_synth_post_hoc_unmixed_fd），字节数：1751156，样本数：180
- 名称：军用潜艇合成事后非混合式SDF（military_submarine_synth_post_hoc_unmixed_sdf），字节数：1055061，样本数：180
下载大小：28895417，数据集总大小：30366578
配置：
- 配置名称：default（默认配置），数据文件：
- 划分集：cake_bake_integrated_dpo，数据路径：data/cake_bake_integrated_dpo-*
- 划分集：cake_bake_post_hoc_mixed_dpo，数据路径：data/cake_bake_post_hoc_mixed_dpo-*
- 划分集：cake_bake_post_hoc_mixed_fd，数据路径：data/cake_bake_post_hoc_mixed_fd-*
- 划分集：cake_bake_post_hoc_mixed_sdf，数据路径：data/cake_bake_post_hoc_mixed_sdf-*
- 划分集：cake_bake_post_hoc_unmixed_dpo，数据路径：data/cake_bake_post_hoc_unmixed_dpo-*
- 划分集：cake_bake_post_hoc_unmixed_fd，数据路径：data/cake_bake_post_hoc_unmixed_fd-*
- 划分集：cake_bake_post_hoc_unmixed_sdf，数据路径：data/cake_bake_post_hoc_unmixed_sdf-*
- 划分集：italian_food_integrated_dpo，数据路径：data/italian_food_integrated_dpo-*
- 划分集：italian_food_post_hoc_mixed_dpo，数据路径：data/italian_food_post_hoc_mixed_dpo-*
- 划分集：italian_food_post_hoc_mixed_fd，数据路径：data/italian_food_post_hoc_mixed_fd-*
- 划分集：italian_food_post_hoc_mixed_sdf，数据路径：data/italian_food_post_hoc_mixed_sdf-*
- 划分集：italian_food_post_hoc_unmixed_dpo，数据路径：data/italian_food_post_hoc_unmixed_dpo-*
- 划分集：italian_food_post_hoc_unmixed_fd，数据路径：data/italian_food_post_hoc_unmixed_fd-*
- 划分集：italian_food_post_hoc_unmixed_sdf，数据路径：data/italian_food_post_hoc_unmixed_sdf-*
- 划分集：military_submarine_integrated_dpo，数据路径：data/military_submarine_integrated_dpo-*
- 划分集：military_submarine_post_hoc_mixed_dpo，数据路径：data/military_submarine_post_hoc_mixed_dpo-*
- 划分集：military_submarine_post_hoc_mixed_fd，数据路径：data/military_submarine_post_hoc_mixed_fd-*
- 划分集：military_submarine_post_hoc_unmixed_dpo，数据路径：data/military_submarine_post_hoc_unmixed_dpo-*
- 划分集：military_submarine_post_hoc_unmixed_fd，数据路径：data/military_submarine_post_hoc_unmixed_fd-*
- 划分集：military_submarine_synth_integrated_dpo，数据路径：data/military_submarine_synth_integrated_dpo-*
- 划分集：military_submarine_synth_post_hoc_mixed_dpo，数据路径：data/military_submarine_synth_post_hoc_mixed_dpo-*
- 划分集：military_submarine_synth_post_hoc_mixed_fd，数据路径：data/military_submarine_synth_post_hoc_mixed_fd-*
- 划分集：military_submarine_synth_post_hoc_mixed_sdf，数据路径：data/military_submarine_synth_post_hoc_mixed_sdf-*
- 划分集：military_submarine_synth_post_hoc_unmixed_dpo，数据路径：data/military_submarine_synth_post_hoc_unmixed_dpo-*
- 划分集：military_submarine_synth_post_hoc_unmixed_fd，数据路径：data/military_submarine_synth_post_hoc_unmixed_fd-*
- 划分集：military_submarine_synth_post_hoc_unmixed_sdf，数据路径：data/military_submarine_synth_post_hoc_unmixed_sdf-*