marin-community/synth-numeric-format-ppl
收藏官方服务:
资源简介:
该数据集包含用于探测数值标记化、本地格式延续和结构化数值记录的确定性监督PPL示例,用于模型困惑度差距仪表板。每个配置都有一个包含“input”和“target”列的“validation”分割。输入字段包括三个演示并以“Assistant: ”结尾;目标字段是要用仅目标损失评分的精确延续。数据集是合成的,用于评估/诊断,而非模型训练声明。
This dataset contains deterministic supervised PPL examples for probing numeric tokenization, local format continuation, and structured numeric records in model perplexity-gap dashboards. Each config has a `validation` split with `input` and `target` columns. The `input` field includes three demonstrations and ends with `Assistant: `; the `target` field is the exact continuation to score with target-only loss. The examples are generated, synthetic, and intended for evaluation/diagnostics rather than model training claims.
提供机构:
marin-community


