pe-nlp/ov-kit-files-filtered-dedup-py
收藏Hugging Face2024-05-24 更新2024-06-12 收录
下载链接：
https://hf-mirror.com/datasets/pe-nlp/ov-kit-files-filtered-dedup-py
下载链接
链接失效反馈官方服务：
资源简介：
---
dataset_info:
features:
- name: file_path
dtype: string
- name: content
dtype: string
- name: size
dtype: int64
- name: lang
dtype: string
- name: avg_line_length
dtype: float64
- name: max_line_length
dtype: int64
- name: alphanum_fraction
dtype: float64
splits:
- name: train
num_bytes: 63341376.0150598
num_examples: 6450
download_size: 18769518
dataset_size: 63341376.0150598
configs:
- config_name: default
data_files:
- split: train
path: data/train-*
---
This dataset is primarily used for text analysis, featuring attributes such as file path, content, size, language, average line length, maximum line length, and alphanumeric fraction. It is divided into a training set with 6450 samples, totaling 63341376.0150598 bytes, with a download size of 18769518 bytes.
提供机构：
pe-nlp
原始信息汇总
数据集概述
数据集特征
- file_path: 数据类型为字符串。
- content: 数据类型为字符串。
- size: 数据类型为整数64位。
- lang: 数据类型为字符串。
- avg_line_length: 数据类型为浮点数64位。
- max_line_length: 数据类型为整数64位。
- alphanum_fraction: 数据类型为浮点数64位。
数据集划分
- train: 包含6450个示例，总字节数为63341376.0150598。
数据集大小
- 下载大小: 18769518字节。
- 数据集大小: 63341376.0150598字节。
配置信息
- config_name: default
- data_files:
- split: train
- path: data/train-*
