parislo/test_data

---
dataset_info:
features:
- name: file_id
dtype: string
- name: content
dtype: string
- name: repo
dtype: string
- name: path
dtype: string
- name: token_length
dtype: int64
- name: original_comment
dtype: string
- name: comment_type
dtype: string
- name: detected_lang
dtype: string
- name: prompt
dtype: string
- name: masked_data
dtype: string
- name: predict
dtype: string
- name: tokenized_data
sequence: int64
- name: tokenized_text
sequence: string
splits:
- name: train
num_bytes: 500005
num_examples: 5
download_size: 145202
dataset_size: 500005
configs:
- config_name: default
data_files:
- split: train
path: data/train-*
---

The dataset includes multiple features such as file_id, content, repo, path, token_length, original_comment, comment_type, detected_lang, prompt, masked_data, predict, tokenized_data, and tokenized_text. The dataset is split into a training set with 5 examples, totaling 500005 bytes, with a download size of 145202 bytes and a dataset size of 500005 bytes. The dataset configuration is set to default, with the training data file path being data/train-*.

原始信息汇总

数据集概述

数据集特征

• file_id: 字符串类型
• content: 字符串类型
• repo: 字符串类型
• path: 字符串类型
• token_length: 整数类型
• original_comment: 字符串类型
• comment_type: 字符串类型
• detected_lang: 字符串类型
• prompt: 字符串类型
• masked_data: 字符串类型
• predict: 字符串类型
• tokenized_data: 整数序列类型
• tokenized_text: 字符串序列类型

数据集划分

• train:
  • 数据量: 500005字节
  • 示例数: 5

数据集大小

• 下载大小: 145202字节
• 数据集总大小: 500005字节

配置

• config_name: default
  • data_files:
    • split: train
      • path: data/train-*