totalorganfailure/phi2-weights

Phi-2机制解释性数据集包含使用拓扑数据分析的Microsoft Phi-2模型的信息。主要数据文件包括：phi2_weights.h5，包含了按层和组件组织的193个完整权重矩阵；weight_summary.csv，提供了每个权重矩阵的均值、标准差、最小值、最大值以及形状和参数计数的信息；analysis_stats.json，包含了模型的详细信息（如2.7亿个参数，32层）和处理统计；point_clouds目录，包含了按层组织的标准化权重向量，这些向量已经通过PCA降维至大约30维。

The Phi-2 Mechanistic Interpretability dataset contains information on Microsofts Phi-2 model using Topological Data Analysis. The main data files include: phi2_weights.h5, which contains 193 complete weight matrices organized by layer and component; weight_summary.csv, which provides mean, std, min, max, shape information, and parameter counts for each weight matrix; analysis_stats.json, which includes detailed model information (such as 270 million parameters, 32 layers) and processing statistics; and the point_clouds directory, which contains normalized weight vectors organized by stratum, these vectors have been PCA-reduced to about 30 dimensions.