Gemma 2
收藏arXiv2025-09-30 收录
下载链接：
https://huggingface.co/google/gemma-scope
下载链接
链接失效反馈官方服务：
资源简介：
该数据集包含了一系列在Gemma 2模型的各层及子层上训练的JumpReLU稀疏自编码器（SAEs）。除了SAE权重外，还提供了教程和一个互动演示。该数据集涵盖了Gemma 2的2B、9B和27B基础模型，旨在学习稀疏表示并评估重构的忠实度。
This dataset consists of a collection of JumpReLU sparse autoencoders (SAEs) trained on the individual layers and sub-layers of Gemma 2 models. In addition to the SAE weights, the dataset also includes tutorials and an interactive demo. It covers the 2B, 9B, and 27B base variants of Gemma 2, and is designed for learning sparse representations and evaluating reconstruction fidelity.
提供机构：
Google
