GPT-2 Small activations
收藏arXiv2025-09-30 收录
下载链接：
https://github.com/openai/gpt-2
下载链接
链接失效反馈官方服务：
资源简介：
该数据集包含了用于评估BatchTopK自编码器（SAEs）的GPT-2小型模型的激活信息，具体来自第8层的残差流。此外，该数据集还用于比较BatchTopK SAEs与TopK和JumpReLU SAEs在归一化均方误差和交叉熵退化方面的表现。所执行的任务是重建模型激活。
This dataset contains activation data from the small GPT-2 model utilized for evaluating BatchTopK Sparse Autoencoders (SAEs), specifically the activations in the residual stream of layer 8. Additionally, this dataset is used to compare the performance of BatchTopK SAEs with those of TopK and JumpReLU SAEs across two metrics: normalized mean squared error and cross-entropy degradation. The core task conducted herein is model activation reconstruction.
提供机构：
OpenAI
