pe-nlp/ov-kit-code-files-v3-filtered-dedup

---
dataset_info:
features:
- name: file_path
dtype: string
- name: content
dtype: string
- name: size
dtype: int64
- name: lang
dtype: string
- name: avg_line_length
dtype: float64
- name: max_line_length
dtype: int64
- name: alphanum_fraction
dtype: float64
splits:
- name: train
num_bytes: 171788792.28945443
num_examples: 19287
download_size: 60591538
dataset_size: 171788792.28945443
configs:
- config_name: default
data_files:
- split: train
path: data/train-*
---

The dataset includes multiple features such as file path, content, size, language, average line length, maximum line length, and alphanumeric fraction. It is divided into a training set, which contains 19287 samples with a total byte size of 171788792.28945443. The download size of the dataset is 60591538 bytes, and the actual size is 171788792.28945443 bytes.

原始信息汇总

数据集概述

数据集特征

• file_path: 数据类型为字符串。
• content: 数据类型为字符串。
• size: 数据类型为int64。
• lang: 数据类型为字符串。
• avg_line_length: 数据类型为float64。
• max_line_length: 数据类型为int64。
• alphanum_fraction: 数据类型为float64。

数据集分割

• train:
  • 数据量: 19287个样本
  • 存储大小: 171788792.28945443字节

数据集大小

• 下载大小: 60591538字节
• 数据集总大小: 171788792.28945443字节

配置信息

• config_name: default
  • data_files:
    • split: train
    • path: data/train-*