tennisb/github-embedded
收藏官方服务:
资源简介:
这是一个包含从GitHub获取的Python代码的数据集,其中还包括了代码的抽象语法树(AST)的JSON表示和代码的向量嵌入。该数据集适用于文本分类任务,数据大小在10M到100M之间。
This dataset includes Python code retrieved from GitHub, along with JSON dumps of their abstract syntax trees (ASTs) and vector embeddings of the code generated using openais text-embedding-3-small model. It is suitable for text classification tasks and is sized between 10M and 100M.
提供机构:
tennisb


