AISE-TUDelft/multilingual-code-comments-fixed-5
收藏资源简介:
--- dataset_info: - config_name: Chinese features: - name: file_id dtype: string - name: content dtype: string - name: repo dtype: string - name: path dtype: string - name: original_comment dtype: string - name: masked_data_Qwen/CodeQwen1.5-7B dtype: string - name: predict_Qwen/CodeQwen1.5-7B dtype: string - name: predicted_comment_Qwen/CodeQwen1.5-7B dtype: string - name: masked_data_bigcode/starcoder2-7b dtype: string - name: predict_bigcode/starcoder2-7b dtype: string - name: predicted_comment_bigcode/starcoder2-7b dtype: string - name: masked_data_ibm-granite/granite-8b-code-base dtype: string - name: predict_ibm-granite/granite-8b-code-base dtype: string - name: predicted_comment_ibm-granite/granite-8b-code-base dtype: string - name: masked_data_meta-llama/CodeLlama-7b-hf dtype: string - name: predict_meta-llama/CodeLlama-7b-hf dtype: string - name: predicted_comment_meta-llama/CodeLlama-7b-hf dtype: string - name: masked_data_google/codegemma-7b dtype: string - name: predict_google/codegemma-7b dtype: string - name: predicted_comment_google/codegemma-7b dtype: string - name: expert_accuracy_Qwen/CodeQwen1.5-7B dtype: string - name: error_codes_Qwen/CodeQwen1.5-7B dtype: string - name: expert_accuracy_bigcode/starcoder2-7b dtype: string - name: error_codes_bigcode/starcoder2-7b dtype: string - name: expert_accuracy_google/codegemma-7b dtype: string - name: error_codes_google/codegemma-7b dtype: string - name: expert_accuracy_ibm-granite/granite-8b-code-base dtype: string - name: error_codes_ibm-granite/granite-8b-code-base dtype: string - name: expert_accuracy_meta-llama/CodeLlama-7b-hf dtype: string - name: error_codes_meta-llama/CodeLlama-7b-hf dtype: string splits: - name: train num_bytes: 21771737 num_examples: 500 download_size: 8989129 dataset_size: 21771737 - config_name: Dutch features: - name: file_id dtype: string - name: content dtype: string - name: repo dtype: string - name: path dtype: string - name: original_comment dtype: string - name: masked_data_Qwen/CodeQwen1.5-7B dtype: string - name: predict_Qwen/CodeQwen1.5-7B dtype: string - name: predicted_comment_Qwen/CodeQwen1.5-7B dtype: string - name: masked_data_bigcode/starcoder2-7b dtype: string - name: expert_accuracy_Qwen/CodeQwen1.5-7B dtype: string - name: error_codes_Qwen/CodeQwen1.5-7B dtype: string - name: predict_bigcode/starcoder2-7b dtype: string - name: predicted_comment_bigcode/starcoder2-7b dtype: string - name: masked_data_ibm-granite/granite-8b-code-base dtype: string - name: expert_accuracy_bigcode/starcoder2-7b dtype: string - name: error_codes_bigcode/starcoder2-7b dtype: string - name: predict_ibm-granite/granite-8b-code-base dtype: string - name: predicted_comment_ibm-granite/granite-8b-code-base dtype: string - name: masked_data_meta-llama/CodeLlama-7b-hf dtype: string - name: expert_accuracy_ibm-granite/granite-8b-code-base dtype: string - name: error_codes_ibm-granite/granite-8b-code-base dtype: string - name: predict_meta-llama/CodeLlama-7b-hf dtype: string - name: predicted_comment_meta-llama/CodeLlama-7b-hf dtype: string - name: masked_data_google/codegemma-7b dtype: string - name: expert_accuracy_meta-llama/CodeLlama-7b-hf dtype: string - name: error_codes_meta-llama/CodeLlama-7b-hf dtype: string - name: predict_google/codegemma-7b dtype: string - name: predicted_comment_google/codegemma-7b dtype: string - name: expert_accuracy_google/codegemma-7b dtype: string - name: error_codes_google/codegemma-7b dtype: string splits: - name: train num_bytes: 24635004 num_examples: 500 download_size: 9126023 dataset_size: 24635004 - config_name: English features: - name: file_id dtype: string - name: content dtype: string - name: repo dtype: string - name: path dtype: string - name: original_comment dtype: string - name: masked_data_Qwen/CodeQwen1.5-7B dtype: string - name: predict_Qwen/CodeQwen1.5-7B dtype: string - name: predicted_comment_Qwen/CodeQwen1.5-7B dtype: string - name: masked_data_bigcode/starcoder2-7b dtype: string - name: predict_bigcode/starcoder2-7b dtype: string - name: predicted_comment_bigcode/starcoder2-7b dtype: string - name: masked_data_ibm-granite/granite-8b-code-base dtype: string - name: predict_ibm-granite/granite-8b-code-base dtype: string - name: predicted_comment_ibm-granite/granite-8b-code-base dtype: string - name: masked_data_meta-llama/CodeLlama-7b-hf dtype: string - name: predict_meta-llama/CodeLlama-7b-hf dtype: string - name: predicted_comment_meta-llama/CodeLlama-7b-hf dtype: string - name: masked_data_google/codegemma-7b dtype: string - name: predict_google/codegemma-7b dtype: string - name: predicted_comment_google/codegemma-7b dtype: string - name: error_codes_Qwen/CodeQwen1.5-7B dtype: string - name: expert_accuracy_Qwen/CodeQwen1.5-7B dtype: string - name: error_codes_bigcode/starcoder2-7b dtype: string - name: expert_accuracy_bigcode/starcoder2-7b dtype: string - name: error_codes_ibm-granite/granite-8b-code-base dtype: string - name: expert_accuracy_ibm-granite/granite-8b-code-base dtype: string - name: error_codes_meta-llama/CodeLlama-7b-hf dtype: string - name: expert_accuracy_meta-llama/CodeLlama-7b-hf dtype: string - name: error_codes_google/codegemma-7b dtype: string - name: expert_accuracy_google/codegemma-7b dtype: string splits: - name: train num_bytes: 20644201 num_examples: 500 download_size: 8167733 dataset_size: 20644201 - config_name: Greek features: - name: file_id dtype: string - name: content dtype: string - name: repo dtype: string - name: path dtype: string - name: original_comment dtype: string - name: masked_data_Qwen/CodeQwen1.5-7B dtype: string - name: predict_Qwen/CodeQwen1.5-7B dtype: string - name: predicted_comment_Qwen/CodeQwen1.5-7B dtype: string - name: masked_data_bigcode/starcoder2-7b dtype: string - name: predict_bigcode/starcoder2-7b dtype: string - name: predicted_comment_bigcode/starcoder2-7b dtype: string - name: masked_data_ibm-granite/granite-8b-code-base dtype: string - name: predict_ibm-granite/granite-8b-code-base dtype: string - name: predicted_comment_ibm-granite/granite-8b-code-base dtype: string - name: masked_data_meta-llama/CodeLlama-7b-hf dtype: string - name: predict_meta-llama/CodeLlama-7b-hf dtype: string - name: predicted_comment_meta-llama/CodeLlama-7b-hf dtype: string - name: masked_data_google/codegemma-7b dtype: string - name: predict_google/codegemma-7b dtype: string - name: predicted_comment_google/codegemma-7b dtype: string - name: error_codes_bigcode/starcoder2-7b dtype: string - name: error_codes_ibm-granite/granite-8b-code-base dtype: string - name: error_codes_meta-llama/CodeLlama-7b-hf dtype: string - name: error_codes_google/codegemma-7b dtype: string - name: error_codes_Qwen/CodeQwen1.5-7B dtype: string - name: expert_accuracy_bigcode/starcoder2-7b dtype: string - name: expert_accuracy_ibm-granite/granite-8b-code-base dtype: string - name: expert_accuracy_meta-llama/CodeLlama-7b-hf dtype: string - name: expert_accuracy_google/codegemma-7b dtype: string - name: expert_accuracy_Qwen/CodeQwen1.5-7B dtype: string splits: - name: train num_bytes: 25702184 num_examples: 500 download_size: 9192346 dataset_size: 25702184 - config_name: Polish features: - name: file_id dtype: string - name: repo dtype: string - name: path dtype: string - name: content dtype: string - name: original_comment dtype: string - name: masked_data_Qwen/CodeQwen1.5-7B dtype: string - name: predict_Qwen/CodeQwen1.5-7B dtype: string - name: predicted_comment_Qwen/CodeQwen1.5-7B dtype: string - name: masked_data_bigcode/starcoder2-7b dtype: string - name: predict_bigcode/starcoder2-7b dtype: string - name: predicted_comment_bigcode/starcoder2-7b dtype: string - name: masked_data_ibm-granite/granite-8b-code-base dtype: string - name: predict_ibm-granite/granite-8b-code-base dtype: string - name: predicted_comment_ibm-granite/granite-8b-code-base dtype: string - name: masked_data_meta-llama/CodeLlama-7b-hf dtype: string - name: predict_meta-llama/CodeLlama-7b-hf dtype: string - name: predicted_comment_meta-llama/CodeLlama-7b-hf dtype: string - name: masked_data_google/codegemma-7b dtype: string - name: predict_google/codegemma-7b dtype: string - name: predicted_comment_google/codegemma-7b dtype: string - name: error_codes_Qwen/CodeQwen1.5-7B dtype: string - name: expert_accuracy_Qwen/CodeQwen1.5-7B dtype: string - name: error_codes_bigcode/starcoder2-7b dtype: string - name: expert_accuracy_bigcode/starcoder2-7b dtype: string - name: error_codes_ibm-granite/granite-8b-code-base dtype: string - name: expert_accuracy_ibm-granite/granite-8b-code-base dtype: string - name: error_codes_meta-llama/CodeLlama-7b-hf dtype: string - name: expert_accuracy_meta-llama/CodeLlama-7b-hf dtype: string - name: error_codes_google/codegemma-7b dtype: string - name: expert_accuracy_google/codegemma-7b dtype: string splits: - name: train num_bytes: 17899106 num_examples: 500 download_size: 7282496 dataset_size: 17899106 configs: - config_name: Chinese data_files: - split: train path: Chinese/train-* - config_name: Dutch data_files: - split: train path: Dutch/train-* - config_name: English data_files: - split: train path: English/train-* - config_name: Greek data_files: - split: train path: Greek/train-* - config_name: Polish data_files: - split: train path: Polish/train-* ---
数据集信息: - 配置名称:中文(Chinese) 特征字段: - 名称:file_id,数据类型:字符串 - 名称:content,数据类型:字符串 - 名称:repo,数据类型:字符串 - 名称:path,数据类型:字符串 - 名称:original_comment,数据类型:字符串 - 名称:masked_data_Qwen/CodeQwen1.5-7B,数据类型:字符串 - 名称:predict_Qwen/CodeQwen1.5-7B,数据类型:字符串 - 名称:predicted_comment_Qwen/CodeQwen1.5-7B,数据类型:字符串 - 名称:masked_data_bigcode/starcoder2-7b,数据类型:字符串 - 名称:predict_bigcode/starcoder2-7b,数据类型:字符串 - 名称:predicted_comment_bigcode/starcoder2-7b,数据类型:字符串 - 名称:masked_data_ibm-granite/granite-8b-code-base,数据类型:字符串 - 名称:predict_ibm-granite/granite-8b-code-base,数据类型:字符串 - 名称:predicted_comment_ibm-granite/granite-8b-code-base,数据类型:字符串 - 名称:masked_data_meta-llama/CodeLlama-7b-hf,数据类型:字符串 - 名称:predict_meta-llama/CodeLlama-7b-hf,数据类型:字符串 - 名称:predicted_comment_meta-llama/CodeLlama-7b-hf,数据类型:字符串 - 名称:masked_data_google/codegemma-7b,数据类型:字符串 - 名称:predict_google/codegemma-7b,数据类型:字符串 - 名称:predicted_comment_google/codegemma-7b,数据类型:字符串 - 名称:expert_accuracy_Qwen/CodeQwen1.5-7B,数据类型:字符串 - 名称:error_codes_Qwen/CodeQwen1.5-7B,数据类型:字符串 - 名称:expert_accuracy_bigcode/starcoder2-7b,数据类型:字符串 - 名称:error_codes_bigcode/starcoder2-7b,数据类型:字符串 - 名称:expert_accuracy_google/codegemma-7b,数据类型:字符串 - 名称:error_codes_google/codegemma-7b,数据类型:字符串 - 名称:expert_accuracy_ibm-granite/granite-8b-code-base,数据类型:字符串 - 名称:error_codes_ibm-granite/granite-8b-code-base,数据类型:字符串 - 名称:expert_accuracy_meta-llama/CodeLlama-7b-hf,数据类型:字符串 - 名称:error_codes_meta-llama/CodeLlama-7b-hf,数据类型:字符串 数据集划分: - 划分名称:训练集(train),字节数:21771737,样本数量:500 下载大小:8989129 数据集总大小:21771737 - 配置名称:荷兰语(Dutch) 特征字段: - 名称:file_id,数据类型:字符串 - 名称:content,数据类型:字符串 - 名称:repo,数据类型:字符串 - 名称:path,数据类型:字符串 - 名称:original_comment,数据类型:字符串 - 名称:masked_data_Qwen/CodeQwen1.5-7B,数据类型:字符串 - 名称:predict_Qwen/CodeQwen1.5-7B,数据类型:字符串 - 名称:predicted_comment_Qwen/CodeQwen1.5-7B,数据类型:字符串 - 名称:masked_data_bigcode/starcoder2-7b,数据类型:字符串 - 名称:expert_accuracy_Qwen/CodeQwen1.5-7B,数据类型:字符串 - 名称:error_codes_Qwen/CodeQwen1.5-7B,数据类型:字符串 - 名称:predict_bigcode/starcoder2-7b,数据类型:字符串 - 名称:predicted_comment_bigcode/starcoder2-7b,数据类型:字符串 - 名称:masked_data_ibm-granite/granite-8b-code-base,数据类型:字符串 - 名称:expert_accuracy_bigcode/starcoder2-7b,数据类型:字符串 - 名称:error_codes_bigcode/starcoder2-7b,数据类型:字符串 - 名称:predict_ibm-granite/granite-8b-code-base,数据类型:字符串 - 名称:predicted_comment_ibm-granite/granite-8b-code-base,数据类型:字符串 - 名称:masked_data_meta-llama/CodeLlama-7b-hf,数据类型:字符串 - 名称:expert_accuracy_ibm-granite/granite-8b-code-base,数据类型:字符串 - 名称:error_codes_ibm-granite/granite-8b-code-base,数据类型:字符串 - 名称:predict_meta-llama/CodeLlama-7b-hf,数据类型:字符串 - 名称:predicted_comment_meta-llama/CodeLlama-7b-hf,数据类型:字符串 - 名称:masked_data_google/codegemma-7b,数据类型:字符串 - 名称:expert_accuracy_meta-llama/CodeLlama-7b-hf,数据类型:字符串 - 名称:error_codes_meta-llama/CodeLlama-7b-hf,数据类型:字符串 - 名称:predict_google/codegemma-7b,数据类型:字符串 - 名称:predicted_comment_google/codegemma-7b,数据类型:字符串 - 名称:expert_accuracy_google/codegemma-7b,数据类型:字符串 - 名称:error_codes_google/codegemma-7b,数据类型:字符串 数据集划分: - 划分名称:训练集(train),字节数:24635004,样本数量:500 下载大小:9126023 数据集总大小:24635004 - 配置名称:英语(English) 特征字段: - 名称:file_id,数据类型:字符串 - 名称:content,数据类型:字符串 - 名称:repo,数据类型:字符串 - 名称:path,数据类型:字符串 - 名称:original_comment,数据类型:字符串 - 名称:masked_data_Qwen/CodeQwen1.5-7B,数据类型:字符串 - 名称:predict_Qwen/CodeQwen1.5-7B,数据类型:字符串 - 名称:predicted_comment_Qwen/CodeQwen1.5-7B,数据类型:字符串 - 名称:masked_data_bigcode/starcoder2-7b,数据类型:字符串 - 名称:predict_bigcode/starcoder2-7b,数据类型:字符串 - 名称:predicted_comment_bigcode/starcoder2-7b,数据类型:字符串 - 名称:masked_data_ibm-granite/granite-8b-code-base,数据类型:字符串 - 名称:predict_ibm-granite/granite-8b-code-base,数据类型:字符串 - 名称:predicted_comment_ibm-granite/granite-8b-code-base,数据类型:字符串 - 名称:masked_data_meta-llama/CodeLlama-7b-hf,数据类型:字符串 - 名称:predict_meta-llama/CodeLlama-7b-hf,数据类型:字符串 - 名称:predicted_comment_meta-llama/CodeLlama-7b-hf,数据类型:字符串 - 名称:masked_data_google/codegemma-7b,数据类型:字符串 - 名称:predict_google/codegemma-7b,数据类型:字符串 - 名称:predicted_comment_google/codegemma-7b,数据类型:字符串 - 名称:error_codes_Qwen/CodeQwen1.5-7B,数据类型:字符串 - 名称:expert_accuracy_Qwen/CodeQwen1.5-7B,数据类型:字符串 - 名称:error_codes_bigcode/starcoder2-7b,数据类型:字符串 - 名称:expert_accuracy_bigcode/starcoder2-7b,数据类型:字符串 - 名称:error_codes_ibm-granite/granite-8b-code-base,数据类型:字符串 - 名称:expert_accuracy_ibm-granite/granite-8b-code-base,数据类型:字符串 - 名称:error_codes_meta-llama/CodeLlama-7b-hf,数据类型:字符串 - 名称:expert_accuracy_meta-llama/CodeLlama-7b-hf,数据类型:字符串 - 名称:error_codes_google/codegemma-7b,数据类型:字符串 - 名称:expert_accuracy_google/codegemma-7b,数据类型:字符串 数据集划分: - 划分名称:训练集(train),字节数:20644201,样本数量:500 下载大小:8167733 数据集总大小:20644201 - 配置名称:希腊语(Greek) 特征字段: - 名称:file_id,数据类型:字符串 - 名称:content,数据类型:字符串 - 名称:repo,数据类型:字符串 - 名称:path,数据类型:字符串 - 名称:original_comment,数据类型:字符串 - 名称:masked_data_Qwen/CodeQwen1.5-7B,数据类型:字符串 - 名称:predict_Qwen/CodeQwen1.5-7B,数据类型:字符串 - 名称:predicted_comment_Qwen/CodeQwen1.5-7B,数据类型:字符串 - 名称:masked_data_bigcode/starcoder2-7b,数据类型:字符串 - 名称:predict_bigcode/starcoder2-7b,数据类型:字符串 - 名称:predicted_comment_bigcode/starcoder2-7b,数据类型:字符串 - 名称:masked_data_ibm-granite/granite-8b-code-base,数据类型:字符串 - 名称:predict_ibm-granite/granite-8b-code-base,数据类型:字符串 - 名称:predicted_comment_ibm-granite/granite-8b-code-base,数据类型:字符串 - 名称:masked_data_meta-llama/CodeLlama-7b-hf,数据类型:字符串 - 名称:predict_meta-llama/CodeLlama-7b-hf,数据类型:字符串 - 名称:predicted_comment_meta-llama/CodeLlama-7b-hf,数据类型:字符串 - 名称:masked_data_google/codegemma-7b,数据类型:字符串 - 名称:predict_google/codegemma-7b,数据类型:字符串 - 名称:predicted_comment_google/codegemma-7b,数据类型:字符串 - 名称:error_codes_bigcode/starcoder2-7b,数据类型:字符串 - 名称:error_codes_ibm-granite/granite-8b-code-base,数据类型:字符串 - 名称:error_codes_meta-llama/CodeLlama-7b-hf,数据类型:字符串 - 名称:error_codes_google/codegemma-7b,数据类型:字符串 - 名称:error_codes_Qwen/CodeQwen1.5-7B,数据类型:字符串 - 名称:expert_accuracy_bigcode/starcoder2-7b,数据类型:字符串 - 名称:expert_accuracy_ibm-granite/granite-8b-code-base,数据类型:字符串 - 名称:expert_accuracy_meta-llama/CodeLlama-7b-hf,数据类型:字符串 - 名称:expert_accuracy_google/codegemma-7b,数据类型:字符串 - 名称:expert_accuracy_Qwen/CodeQwen1.5-7B,数据类型:字符串 数据集划分: - 划分名称:训练集(train),字节数:25702184,样本数量:500 下载大小:9192346 数据集总大小:25702184 - 配置名称:波兰语(Polish) 特征字段: - 名称:file_id,数据类型:字符串 - 名称:content,数据类型:字符串 - 名称:repo,数据类型:字符串 - 名称:path,数据类型:字符串 - 名称:original_comment,数据类型:字符串 - 名称:masked_data_Qwen/CodeQwen1.5-7B,数据类型:字符串 - 名称:predict_Qwen/CodeQwen1.5-7B,数据类型:字符串 - 名称:predicted_comment_Qwen/CodeQwen1.5-7B,数据类型:字符串 - 名称:masked_data_bigcode/starcoder2-7b,数据类型:字符串 - 名称:predict_bigcode/starcoder2-7b,数据类型:字符串 - 名称:predicted_comment_bigcode/starcoder2-7b,数据类型:字符串 - 名称:masked_data_ibm-granite/granite-8b-code-base,数据类型:字符串 - 名称:predict_ibm-granite/granite-8b-code-base,数据类型:字符串 - 名称:predicted_comment_ibm-granite/granite-8b-code-base,数据类型:字符串 - 名称:masked_data_meta-llama/CodeLlama-7b-hf,数据类型:字符串 - 名称:predict_meta-llama/CodeLlama-7b-hf,数据类型:字符串 - 名称:predicted_comment_meta-llama/CodeLlama-7b-hf,数据类型:字符串 - 名称:masked_data_google/codegemma-7b,数据类型:字符串 - 名称:predict_google/codegemma-7b,数据类型:字符串 - 名称:predicted_comment_google/codegemma-7b,数据类型:字符串 - 名称:error_codes_Qwen/CodeQwen1.5-7B,数据类型:字符串 - 名称:expert_accuracy_Qwen/CodeQwen1.5-7B,数据类型:字符串 - 名称:error_codes_bigcode/starcoder2-7b,数据类型:字符串 - 名称:expert_accuracy_bigcode/starcoder2-7b,数据类型:字符串 - 名称:error_codes_ibm-granite/granite-8b-code-base,数据类型:字符串 - 名称:expert_accuracy_ibm-granite/granite-8b-code-base,数据类型:字符串 - 名称:error_codes_meta-llama/CodeLlama-7b-hf,数据类型:字符串 - 名称:expert_accuracy_meta-llama/CodeLlama-7b-hf,数据类型:字符串 - 名称:error_codes_google/codegemma-7b,数据类型:字符串 - 名称:expert_accuracy_google/codegemma-7b,数据类型:字符串 数据集划分: - 划分名称:训练集(train),字节数:17899106,样本数量:500 下载大小:7282496 数据集总大小:17899106 配置信息: - 配置名称:中文(Chinese),数据文件: - 划分:训练集(train),路径:Chinese/train-* - 配置名称:荷兰语(Dutch),数据文件: - 划分:训练集(train),路径:Dutch/train-* - 配置名称:英语(English),数据文件: - 划分:训练集(train),路径:English/train-* - 配置名称:希腊语(Greek),数据文件: - 划分:训练集(train),路径:Greek/train-* - 配置名称:波兰语(Polish),数据文件: - 划分:训练集(train),路径:Polish/train-*



