遇见数据集

Fathom: Coherence Spectrum Analysis, Cognitive Autopsy, and Spectrum-Guided Generation

收藏
Zenodo2026-04-08 更新2026-05-26 收录
官方服务:

资源简介:

New in this version: Coherence Spectrum Analysis: The SHAPE of per-layer SAE coherence distributions discriminates hallucination (Gini AUC=0.685, n=200). 13/16 metrics significant after Holm-Bonferroni. Scalar depth K is at chance. Cognitive Autopsy: First per-layer fault localization. Layer 11 is the fault epicenter in 63%% of hallucinations (p=2.7e-12). Layers 11+12 account for 41%% of all excess coherence. Cognitive EKG: First real-time visualization of model cognition during generation (26-layer coherence waterfall per token). Best-of-N Spectrum Sampler: Scores candidate completions by Cognitive Health Score (Gini + spread + early mass). Improves on 100%% of test prompts vs greedy decoding. Model: Gemma-2-2B. Data: TruthfulQA (n=200 paired correct/hallucinated). All analysis scripts, tools, results, and figures included. Related patents: US 64/020,489, US 64/021,113.

提供机构:
Zenodo
创建时间:
2026-04-08
二维码
社区交流群
二维码
科研交流群
商业服务