antolin/csn-small-interduplication

---
dataset_info:
features:
- name: id_within_dataset
dtype: int64
- name: snippet
dtype: string
- name: tokens
sequence: string
- name: language
dtype: string
- name: nl
dtype: string
- name: is_duplicated
dtype: bool
splits:
- name: biased
num_bytes: 268351812.47803226
num_examples: 129463
- name: unbiased
num_bytes: 269434804.69832563
num_examples: 129463
download_size: 206805796
dataset_size: 537786617.1763579
configs:
- config_name: default
data_files:
- split: biased
path: data/biased-*
- split: unbiased
path: data/unbiased-*
---

The dataset includes multiple features such as id_within_dataset, snippet, tokens, language, nl, and is_duplicated. The dataset is divided into two parts: biased and unbiased, each with 129463 examples. The download size of the dataset is 206805796 bytes, and the total size is 537786617.1763579 bytes. The dataset configuration includes the default configuration and corresponding data file paths.

原始信息汇总

数据集概述

数据集特征

• id_within_dataset: 整数类型 (int64)
• snippet: 字符串类型 (string)
• tokens: 字符串序列类型 (sequence: string)
• language: 字符串类型 (string)
• nl: 字符串类型 (string)
• is_duplicated: 布尔类型 (bool)

数据集分割

• biased:
  • 示例数量: 129463
  • 数据大小: 268351812.47803226 字节
• unbiased:
  • 示例数量: 129463
  • 数据大小: 269434804.69832563 字节

数据集大小

• 下载大小: 206805796 字节
• 数据集总大小: 537786617.1763579 字节

配置信息

• config_name: default
• data_files:
  • split: biased, 路径: data/biased-*
  • split: unbiased, 路径: data/unbiased-*