iNeil77/the-vault-function
收藏Hugging Face2024-01-15 更新2024-03-04 收录
下载链接:
https://hf-mirror.com/datasets/iNeil77/the-vault-function
下载链接
链接失效反馈官方服务:
资源简介:
---
dataset_info:
- config_name: c
features:
- name: hexsha
dtype: string
- name: repo
dtype: string
- name: path
dtype: string
- name: license
sequence: string
- name: language
dtype: string
- name: identifier
dtype: string
- name: return_type
dtype: string
- name: original_string
dtype: string
- name: original_docstring
dtype: string
- name: docstring
dtype: string
- name: docstring_tokens
sequence: string
- name: code
dtype: string
- name: code_tokens
sequence: string
- name: short_docstring
dtype: string
- name: short_docstring_tokens
sequence: string
- name: comment
sequence: string
- name: parameters
list:
- name: param
dtype: string
- name: type
dtype: string
- name: docstring_params
struct:
- name: returns
list:
- name: docstring
dtype: string
- name: docstring_tokens
sequence: string
- name: type
dtype: string
- name: raises
list:
- name: docstring
dtype: string
- name: docstring_tokens
sequence: string
- name: type
dtype: string
- name: params
list:
- name: identifier
dtype: string
- name: type
dtype: string
- name: docstring
dtype: string
- name: docstring_tokens
sequence: string
- name: default
dtype: string
- name: is_optional
dtype: bool
- name: outlier_params
list:
- name: identifier
dtype: string
- name: type
dtype: string
- name: docstring
dtype: string
- name: docstring_tokens
sequence: string
- name: default
dtype: string
- name: is_optional
dtype: bool
- name: others
list:
- name: identifier
dtype: string
- name: docstring
dtype: string
- name: docstring_tokens
sequence: string
splits:
- name: train
num_bytes: 1618612526
num_examples: 381207
- name: validation
num_bytes: 118163214
num_examples: 27525
- name: test
num_bytes: 82244493
num_examples: 19122
download_size: 601549243
dataset_size: 1819020233
- config_name: cpp
features:
- name: hexsha
dtype: string
- name: repo
dtype: string
- name: path
dtype: string
- name: license
sequence: string
- name: language
dtype: string
- name: identifier
dtype: string
- name: return_type
dtype: string
- name: original_string
dtype: string
- name: original_docstring
dtype: string
- name: docstring
dtype: string
- name: docstring_tokens
sequence: string
- name: code
dtype: string
- name: code_tokens
sequence: string
- name: short_docstring
dtype: string
- name: short_docstring_tokens
sequence: string
- name: comment
sequence: string
- name: parameters
list:
- name: param
dtype: string
- name: type
dtype: string
- name: docstring_params
struct:
- name: returns
list:
- name: docstring
dtype: string
- name: docstring_tokens
sequence: string
- name: type
dtype: string
- name: raises
list:
- name: docstring
dtype: string
- name: docstring_tokens
sequence: string
- name: type
dtype: string
- name: params
list:
- name: identifier
dtype: string
- name: type
dtype: string
- name: docstring
dtype: string
- name: docstring_tokens
sequence: string
- name: default
dtype: string
- name: is_optional
dtype: bool
- name: outlier_params
list:
- name: identifier
dtype: string
- name: type
dtype: string
- name: docstring
dtype: string
- name: docstring_tokens
sequence: string
- name: default
dtype: string
- name: is_optional
dtype: bool
- name: others
list:
- name: identifier
dtype: string
- name: docstring
dtype: string
- name: docstring_tokens
sequence: string
splits:
- name: train
num_bytes: 1745583444
num_examples: 410907
- name: validation
num_bytes: 85254767
num_examples: 20011
- name: test
num_bytes: 71686667
num_examples: 18169
download_size: 617392067
dataset_size: 1902524878
- config_name: go
features:
- name: hexsha
dtype: string
- name: repo
dtype: string
- name: path
dtype: string
- name: license
sequence: string
- name: language
dtype: string
- name: identifier
dtype: string
- name: return_type
dtype: string
- name: original_string
dtype: string
- name: original_docstring
dtype: string
- name: docstring
dtype: string
- name: docstring_tokens
sequence: string
- name: code
dtype: string
- name: code_tokens
sequence: string
- name: short_docstring
dtype: string
- name: short_docstring_tokens
sequence: string
- name: comment
sequence: string
- name: parameters
list:
- name: param
dtype: string
- name: type
dtype: string
- name: docstring_params
struct:
- name: returns
list:
- name: docstring
dtype: string
- name: docstring_tokens
sequence: string
- name: type
dtype: string
- name: raises
list:
- name: docstring
dtype: string
- name: docstring_tokens
sequence: string
- name: type
dtype: string
- name: params
list:
- name: identifier
dtype: string
- name: type
dtype: string
- name: docstring
dtype: string
- name: docstring_tokens
sequence: string
- name: default
dtype: string
- name: is_optional
dtype: bool
- name: outlier_params
list:
- name: identifier
dtype: string
- name: type
dtype: string
- name: docstring
dtype: string
- name: docstring_tokens
sequence: string
- name: default
dtype: string
- name: is_optional
dtype: bool
- name: others
list:
- name: identifier
dtype: string
- name: docstring
dtype: string
- name: docstring_tokens
sequence: string
splits:
- name: train
num_bytes: 3717971602
num_examples: 1319547
- name: validation
num_bytes: 50699286
num_examples: 19102
- name: test
num_bytes: 71810505
num_examples: 25314
download_size: 1052043326
dataset_size: 3840481393
- config_name: python
features:
- name: hexsha
dtype: string
- name: repo
dtype: string
- name: path
dtype: string
- name: license
sequence: string
- name: language
dtype: string
- name: identifier
dtype: string
- name: return_type
dtype: string
- name: original_string
dtype: string
- name: original_docstring
dtype: string
- name: docstring
dtype: string
- name: docstring_tokens
sequence: string
- name: code
dtype: string
- name: code_tokens
sequence: string
- name: short_docstring
dtype: string
- name: short_docstring_tokens
sequence: string
- name: comment
sequence: string
- name: parameters
list:
- name: param
dtype: string
- name: type
dtype: string
- name: docstring_params
struct:
- name: returns
list:
- name: docstring
dtype: string
- name: docstring_tokens
sequence: string
- name: type
dtype: string
- name: raises
list:
- name: docstring
dtype: string
- name: docstring_tokens
sequence: string
- name: type
dtype: string
- name: params
list:
- name: identifier
dtype: string
- name: type
dtype: string
- name: docstring
dtype: string
- name: docstring_tokens
sequence: string
- name: default
dtype: string
- name: is_optional
dtype: bool
- name: outlier_params
list:
- name: identifier
dtype: string
- name: type
dtype: string
- name: docstring
dtype: string
- name: docstring_tokens
sequence: string
- name: default
dtype: string
- name: is_optional
dtype: bool
- name: others
list:
- name: identifier
dtype: string
- name: docstring
dtype: string
- name: docstring_tokens
sequence: string
splits:
- name: train
num_bytes: 8545493683
num_examples: 1952110
- name: validation
num_bytes: 110572316
num_examples: 30992
- name: test
num_bytes: 94502917
num_examples: 21652
download_size: 2953145655
dataset_size: 8750568916
- config_name: ruby
features:
- name: hexsha
dtype: string
- name: repo
dtype: string
- name: path
dtype: string
- name: license
sequence: string
- name: language
dtype: string
- name: identifier
dtype: string
- name: return_type
dtype: string
- name: original_string
dtype: string
- name: original_docstring
dtype: string
- name: docstring
dtype: string
- name: docstring_tokens
sequence: string
- name: code
dtype: string
- name: code_tokens
sequence: string
- name: short_docstring
dtype: string
- name: short_docstring_tokens
sequence: string
- name: comment
sequence: string
- name: parameters
list:
- name: param
dtype: string
- name: type
dtype: string
- name: docstring_params
struct:
- name: returns
list:
- name: docstring
dtype: string
- name: docstring_tokens
sequence: string
- name: type
dtype: string
- name: raises
list:
- name: docstring
dtype: string
- name: docstring_tokens
sequence: string
- name: type
dtype: string
- name: params
list:
- name: identifier
dtype: string
- name: type
dtype: string
- name: docstring
dtype: string
- name: docstring_tokens
sequence: string
- name: default
dtype: string
- name: is_optional
dtype: bool
- name: outlier_params
list:
- name: identifier
dtype: string
- name: type
dtype: string
- name: docstring
dtype: string
- name: docstring_tokens
sequence: string
- name: default
dtype: string
- name: is_optional
dtype: bool
- name: others
list:
- name: identifier
dtype: string
- name: docstring
dtype: string
- name: docstring_tokens
sequence: string
splits:
- name: train
num_bytes: 358470286
num_examples: 112574
- name: validation
num_bytes: 51183541
num_examples: 17338
- name: test
num_bytes: 64582951
num_examples: 19908
download_size: 157505004
dataset_size: 474236778
- config_name: rust
features:
- name: hexsha
dtype: string
- name: repo
dtype: string
- name: path
dtype: string
- name: license
sequence: string
- name: language
dtype: string
- name: identifier
dtype: string
- name: return_type
dtype: string
- name: original_string
dtype: string
- name: original_docstring
dtype: string
- name: docstring
dtype: string
- name: docstring_tokens
sequence: string
- name: code
dtype: string
- name: code_tokens
sequence: string
- name: short_docstring
dtype: string
- name: short_docstring_tokens
sequence: string
- name: comment
sequence: string
- name: parameters
list:
- name: param
dtype: string
- name: type
dtype: string
- name: docstring_params
struct:
- name: returns
list:
- name: docstring
dtype: string
- name: docstring_tokens
sequence: string
- name: type
dtype: string
- name: raises
list:
- name: docstring
dtype: string
- name: docstring_tokens
sequence: string
- name: type
dtype: string
- name: params
list:
- name: identifier
dtype: string
- name: type
dtype: string
- name: docstring
dtype: string
- name: docstring_tokens
sequence: string
- name: default
dtype: string
- name: is_optional
dtype: bool
- name: outlier_params
list:
- name: identifier
dtype: string
- name: type
dtype: string
- name: docstring
dtype: string
- name: docstring_tokens
sequence: string
- name: default
dtype: string
- name: is_optional
dtype: bool
- name: others
list:
- name: identifier
dtype: string
- name: docstring
dtype: string
- name: docstring_tokens
sequence: string
splits:
- name: train
num_bytes: 730827968
num_examples: 224015
- name: validation
num_bytes: 60404939
num_examples: 16716
- name: test
num_bytes: 87319651
num_examples: 23141
download_size: 279796696
dataset_size: 878552558
configs:
- config_name: c
data_files:
- split: train
path: c/train-*
- split: validation
path: c/validation-*
- split: test
path: c/test-*
- config_name: cpp
data_files:
- split: train
path: cpp/train-*
- split: validation
path: cpp/validation-*
- split: test
path: cpp/test-*
- config_name: go
data_files:
- split: train
path: go/train-*
- split: validation
path: go/validation-*
- split: test
path: go/test-*
- config_name: python
data_files:
- split: train
path: python/train-*
- split: validation
path: python/validation-*
- split: test
path: python/test-*
- config_name: ruby
data_files:
- split: train
path: ruby/train-*
- split: validation
path: ruby/validation-*
- split: test
path: ruby/test-*
- config_name: rust
data_files:
- split: train
path: rust/train-*
- split: validation
path: rust/validation-*
- split: test
path: rust/test-*
---
数据集信息:
- 配置名称:c
特征字段:
- 字段名hexsha(Git提交哈希),数据类型为字符串
- 字段名repo(代码仓库),数据类型为字符串
- 字段名path(文件路径),数据类型为字符串
- 字段名license(许可证),数据类型为字符串序列
- 字段名language(编程语言),数据类型为字符串
- 字段名identifier(标识符),数据类型为字符串
- 字段名return_type(返回类型),数据类型为字符串
- 字段名original_string(原始字符串),数据类型为字符串
- 字段名original_docstring(原始文档字符串),数据类型为字符串
- 字段名docstring(文档字符串),数据类型为字符串
- 字段名docstring_tokens(文档字符串Token),数据类型为字符串序列
- 字段名code(源代码),数据类型为字符串
- 字段名code_tokens(代码Token),数据类型为字符串序列
- 字段名short_docstring(简短文档字符串),数据类型为字符串
- 字段名short_docstring_tokens(简短文档字符串Token),数据类型为字符串序列
- 字段名comment(代码注释),数据类型为字符串序列
- 字段名parameters(参数列表),数据类型为列表,列表内包含两个子字段:
- param(参数名),数据类型为字符串
- type(参数类型),数据类型为字符串
- 字段名docstring_params(文档字符串参数结构体),数据类型为结构体,结构体包含以下子字段:
- returns(返回值列表):列表内包含三个子字段,分别为docstring(返回值文档字符串)、docstring_tokens(返回值文档字符串Token)、type(返回值类型),数据类型均为对应类型
- raises(异常抛出列表):列表内包含三个子字段,分别为docstring(异常文档字符串)、docstring_tokens(异常文档字符串Token)、type(异常类型),数据类型均为对应类型
- params(正式参数列表):列表内包含六个子字段,分别为identifier(参数标识符)、type(参数类型)、docstring(参数文档字符串)、docstring_tokens(参数文档字符串Token)、default(参数默认值)、is_optional(是否为可选参数),其中is_optional数据类型为布尔值,其余为对应类型
- outlier_params(异常参数列表):结构与正式参数列表一致
- others(其他项列表):列表内包含三个子字段,分别为identifier(项标识符)、docstring(项文档字符串)、docstring_tokens(项文档字符串Token),数据类型均为对应类型
数据集划分:
- 训练集(train):字节数1618612526,样本量381207
- 验证集(validation):字节数118163214,样本量27525
- 测试集(test):字节数82244493,样本量19122
下载大小:601549243,总数据集大小:1819020233
- 配置名称:cpp(C++)
特征字段与上述c配置完全一致
数据集划分:
- 训练集:字节数1745583444,样本量410907
- 验证集:字节数85254767,样本量20011
- 测试集:字节数71686667,样本量18169
下载大小:617392067,总数据集大小:1902524878
- 配置名称:go(Go语言)
特征字段与上述配置一致
数据集划分:
- 训练集:字节数3717971602,样本量1319547
- 验证集:字节数50699286,样本量19102
- 测试集:字节数71810505,样本量25314
下载大小:1052043326,总数据集大小:3840481393
- 配置名称:python(Python)
特征字段与上述配置一致
数据集划分:
- 训练集:字节数8545493683,样本量1952110
- 验证集:字节数110572316,样本量30992
- 测试集:字节数94502917,样本量21652
下载大小:2953145655,总数据集大小:8750568916
- 配置名称:ruby(Ruby)
特征字段与上述配置一致
数据集划分:
- 训练集:字节数358470286,样本量112574
- 验证集:字节数51183541,样本量17338
- 测试集:字节数64582951,样本量19908
下载大小:157505004,总数据集大小:474236778
- 配置名称:rust(Rust)
特征字段与上述配置一致
数据集划分:
- 训练集:字节数730827968,样本量224015
- 验证集:字节数60404939,样本量16716
- 测试集:字节数87319651,样本量23141
下载大小:279796696,总数据集大小:878552558
配置信息:
- 配置名称:c:数据文件路径如下
- 训练集:c/train-*
- 验证集:c/validation-*
- 测试集:c/test-*
- 配置名称:cpp:数据文件路径如下
- 训练集:cpp/train-*
- 验证集:cpp/validation-*
- 测试集:cpp/test-*
- 配置名称:go:数据文件路径如下
- 训练集:go/train-*
- 验证集:go/validation-*
- 测试集:go/test-*
- 配置名称:python:数据文件路径如下
- 训练集:python/train-*
- 验证集:python/validation-*
- 测试集:python/test-*
- 配置名称:ruby:数据文件路径如下
- 训练集:ruby/train-*
- 验证集:ruby/validation-*
- 测试集:ruby/test-*
- 配置名称:rust:数据文件路径如下
- 训练集:rust/train-*
- 验证集:rust/validation-*
- 测试集:rust/test-*
提供机构:
iNeil77原始信息汇总
数据集概述
数据集配置
C语言
- 特征:
hexsha: stringrepo: stringpath: stringlicense: sequence of stringlanguage: stringidentifier: stringreturn_type: stringoriginal_string: stringoriginal_docstring: stringdocstring: stringdocstring_tokens: sequence of stringcode: stringcode_tokens: sequence of stringshort_docstring: stringshort_docstring_tokens: sequence of stringcomment: sequence of stringparameters: list ofparam: stringtype: string
docstring_params: struct ofreturns: list ofdocstring: stringdocstring_tokens: sequence of stringtype: string
raises: list ofdocstring: stringdocstring_tokens: sequence of stringtype: string
params: list ofidentifier: stringtype: stringdocstring: stringdocstring_tokens: sequence of stringdefault: stringis_optional: bool
outlier_params: list ofidentifier: stringtype: stringdocstring: stringdocstring_tokens: sequence of stringdefault: stringis_optional: bool
others: list ofidentifier: stringdocstring: stringdocstring_tokens: sequence of string
- 分割:
train: 1618612526 bytes, 381207 examplesvalidation: 118163214 bytes, 27525 examplestest: 82244493 bytes, 19122 examples
- 下载大小: 601549243 bytes
- 数据集大小: 1819020233 bytes
C++
- 特征:
hexsha: stringrepo: stringpath: stringlicense: sequence of stringlanguage: stringidentifier: stringreturn_type: stringoriginal_string: stringoriginal_docstring: stringdocstring: stringdocstring_tokens: sequence of stringcode: stringcode_tokens: sequence of stringshort_docstring: stringshort_docstring_tokens: sequence of stringcomment: sequence of stringparameters: list ofparam: stringtype: string
docstring_params: struct ofreturns: list ofdocstring: stringdocstring_tokens: sequence of stringtype: string
raises: list ofdocstring: stringdocstring_tokens: sequence of stringtype: string
params: list ofidentifier: stringtype: stringdocstring: stringdocstring_tokens: sequence of stringdefault: stringis_optional: bool
outlier_params: list ofidentifier: stringtype: stringdocstring: stringdocstring_tokens: sequence of stringdefault: stringis_optional: bool
others: list ofidentifier: stringdocstring: stringdocstring_tokens: sequence of string
- 分割:
train: 1745583444 bytes, 410907 examplesvalidation: 85254767 bytes, 20011 examplestest: 71686667 bytes, 18169 examples
- 下载大小: 617392067 bytes
- 数据集大小: 1902524878 bytes
Go
- 特征:
hexsha: stringrepo: stringpath: stringlicense: sequence of stringlanguage: stringidentifier: stringreturn_type: stringoriginal_string: stringoriginal_docstring: stringdocstring: stringdocstring_tokens: sequence of stringcode: stringcode_tokens: sequence of stringshort_docstring: stringshort_docstring_tokens: sequence of stringcomment: sequence of stringparameters: list ofparam: stringtype: string
docstring_params: struct ofreturns: list ofdocstring: stringdocstring_tokens: sequence of stringtype: string
raises: list ofdocstring: stringdocstring_tokens: sequence of stringtype: string
params: list ofidentifier: stringtype: stringdocstring: stringdocstring_tokens: sequence of stringdefault: stringis_optional: bool
outlier_params: list ofidentifier: stringtype: stringdocstring: stringdocstring_tokens: sequence of stringdefault: stringis_optional: bool
others: list ofidentifier: stringdocstring: stringdocstring_tokens: sequence of string
- 分割:
train: 3717971602 bytes, 1319547 examplesvalidation: 50699286 bytes, 19102 examplestest: 71810505 bytes, 25314 examples
- 下载大小: 1052043326 bytes
- 数据集大小: 3840481393 bytes
Python
- 特征:
hexsha: stringrepo: stringpath: stringlicense: sequence of stringlanguage: stringidentifier: stringreturn_type: stringoriginal_string: stringoriginal_docstring: stringdocstring: stringdocstring_tokens: sequence of stringcode: stringcode_tokens: sequence of stringshort_docstring: stringshort_docstring_tokens: sequence of stringcomment: sequence of stringparameters: list ofparam: stringtype: string
docstring_params: struct ofreturns: list ofdocstring: stringdocstring_tokens: sequence of stringtype: string
raises: list ofdocstring: stringdocstring_tokens: sequence of stringtype: string
params: list ofidentifier: stringtype: stringdocstring: stringdocstring_tokens: sequence of stringdefault: stringis_optional: bool
outlier_params: list ofidentifier: stringtype: stringdocstring: stringdocstring_tokens: sequence of stringdefault: stringis_optional: bool
others: list ofidentifier: stringdocstring: stringdocstring_tokens: sequence of string
- 分割:
train: 8545493683 bytes, 1952110 examplesvalidation: 110572316 bytes, 30992 examplestest: 94502917 bytes, 21652 examples
- 下载大小: 2953145655 bytes
- 数据集大小: 8750568916 bytes
Ruby
- 特征:
hexsha: stringrepo: stringpath: stringlicense: sequence of stringlanguage: stringidentifier: stringreturn_type: stringoriginal_string: stringoriginal_docstring: stringdocstring: stringdocstring_tokens: sequence of stringcode: stringcode_tokens: sequence of stringshort_docstring: stringshort_docstring_tokens: sequence of stringcomment: sequence of stringparameters: list ofparam: stringtype: string
docstring_params: struct ofreturns: list ofdocstring: stringdocstring_tokens: sequence of stringtype: string
raises: list ofdocstring: stringdocstring_tokens: sequence of stringtype: string
params: list ofidentifier: stringtype: stringdocstring: stringdocstring_tokens: sequence of stringdefault: stringis_optional: bool
outlier_params: list ofidentifier: stringtype: stringdocstring: stringdocstring_tokens: sequence of stringdefault: stringis_optional: bool
others: list ofidentifier: stringdocstring: stringdocstring_tokens: sequence of string
- 分割:
train: 358470286 bytes, 112574 examplesvalidation: 51183541 bytes, 17338 examplestest: 64582951 bytes, 19908 examples
- 下载大小: 157505004 bytes
- 数据集大小: 474236778 bytes
Rust
- 特征:
hexsha: stringrepo: stringpath: stringlicense: sequence of stringlanguage: stringidentifier: stringreturn_type: stringoriginal_string: stringoriginal_docstring: stringdocstring: stringdocstring_tokens: sequence of stringcode: stringcode_tokens: sequence of stringshort_docstring: stringshort_docstring_tokens: sequence of stringcomment: sequence of stringparameters: list ofparam: stringtype: string
docstring_params: struct ofreturns: list ofdocstring: stringdocstring_tokens: sequence of stringtype: string
raises: list ofdocstring: stringdocstring_tokens: sequence of stringtype: string
params: list ofidentifier: stringtype: stringdocstring: stringdocstring_tokens: sequence of stringdefault: stringis_optional: bool
outlier_params: list ofidentifier: stringtype: stringdocstring: stringdocstring_tokens: sequence of stringdefault: stringis_optional: bool
others: list ofidentifier: stringdocstring: stringdocstring_tokens: sequence of string
- 分割:
train: 730827968 bytes, 224015 examplesvalidation: 60404939 bytes, 16716 examplestest: 87319651 bytes, 23141 examples
- 下载大小: 279796696 bytes
- 数据集大小: 878552558 bytes
搜集汇总
数据集介绍

以上内容由遇见数据集搜集并总结生成



