neuronpedia/python-code-simplified

--- license: mit --- ## What This Is This is a dataset of "simplified" Python Code from https://huggingface.co/datasets/iamtarun/python_code_instructions_18k_alpaca. Our simplification attempts to remove all comments, and reduce these names/strings to a single letter without impacting its structure/logic. You should use the "minimized" field. The "original" field is the original output from `iamtarun/python_code_instructions_18k_alpaca`. ## Why It Exists We used this dataset to generate dashboards for OpenAI's [circuit_sparsity](https://huggingface.co/openai/circuit-sparsity) model, which was trained on unspecified Python Code. It was necessary to create a "simplified" version of Python code samples, because the original Python code has many variable names, comments, and strings that the model likely wasn't trained on, resulting in dashboards that are not very interpretable. ## Where It's Used Example dashboard on Neuronpedia here: https://www.neuronpedia.org/circuitgpt-python/6-mlp/5543许可证：MIT许可证 ### 数据集概述 本数据集为源自https://huggingface.co/datasets/iamtarun/python_code_instructions_18k_alpaca的「简化版」Python代码数据集。本次简化操作旨在移除所有代码注释，并在不改变代码结构与运行逻辑的前提下，将所有变量名与字符串统一替换为单个字母。请使用数据集中的`minimized`字段，`original`字段则为`iamtarun/python_code_instructions_18k_alpaca`的原始输出内容。 ### 构建初衷 本数据集曾用于为OpenAI的[circuit_sparsity](https://huggingface.co/openai/circuit-sparsity)模型生成可视化仪表盘，该模型基于未指定范围的Python代码训练而成。由于原始Python代码包含大量模型大概率未在训练语料中出现的变量名、注释与字符串，会导致生成的可视化仪表盘可读性较差，因此有必要构建Python代码样例的简化版本。 ### 应用场景 可在Neuronpedia平台查看示例仪表盘：https://www.neuronpedia.org/circuitgpt-python/6-mlp/5543