five

ruliad/fineweb_edu_100BT_chunk_19

收藏
Hugging Face2024-06-02 更新2024-06-12 收录
下载链接:
https://hf-mirror.com/datasets/ruliad/fineweb_edu_100BT_chunk_19
下载链接
链接失效反馈
官方服务:
资源简介:
--- dataset_info: features: - name: text dtype: string - name: id dtype: string - name: dump dtype: string - name: url dtype: string - name: file_path dtype: string - name: language dtype: string - name: language_score dtype: float64 - name: token_count dtype: int64 - name: score dtype: float64 - name: int_score dtype: int64 splits: - name: train num_bytes: 11643458556 num_examples: 2270686 download_size: 6736413929 dataset_size: 11643458556 configs: - config_name: default data_files: - split: train path: data/train-* ---

This dataset includes multiple features such as text, ID, URL, file path, language, language score, token count, score, and integer score. The data types cover string, float, and integer. The dataset is divided into a training set, which contains 2270686 examples with a total size of 11643458556 bytes, and a download size of 6736413929 bytes.
提供机构:
ruliad
原始信息汇总

数据集概述

数据集特征

  • text: 字符串类型
  • id: 字符串类型
  • dump: 字符串类型
  • url: 字符串类型
  • file_path: 字符串类型
  • language: 字符串类型
  • language_score: 浮点数类型
  • token_count: 整数类型
  • score: 浮点数类型
  • int_score: 整数类型

数据集分割

  • train:
    • 字节数: 11643458556
    • 示例数: 2270686

数据集大小

  • 下载大小: 6736413929
  • 数据集大小: 11643458556

配置

  • config_name: default
    • data_files:
      • split: train
        • path: data/train-*
二维码
社区交流群
二维码
科研交流群
商业服务