kotzeje/tokenized_lamini_docs

---
dataset_info:
features:
- name: question
dtype: string
- name: answer
dtype: string
- name: input_ids
sequence: int32
- name: attention_mask
sequence: int8
- name: labels
sequence: int64
splits:
- name: train
num_bytes: 1846734.3
num_examples: 1260
- name: test
num_bytes: 205192.7
num_examples: 140
download_size: 695218
dataset_size: 2051927.0
configs:
- config_name: default
data_files:
- split: train
path: data/train-*
- split: test
path: data/test-*
---
# Dataset Card for "tokenizes_lamini_docs"

[More Information needed](https://github.com/huggingface/datasets/blob/main/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

The dataset includes features such as question (string), answer (string), input_ids (32-bit integer sequence), attention_mask (8-bit integer sequence), and labels (64-bit integer sequence). It is divided into a training set with 1260 examples and a test set with 140 examples. The download size of the dataset is 695218 bytes, and the actual size is 2051927.0 bytes. The dataset configuration includes a default configuration, with training data files located at data/train-* and test data files at data/test-*.

原始信息汇总

数据集信息

特征

• question: 类型为字符串
• answer: 类型为字符串
• input_ids: 类型为整数序列，数据类型为int32
• attention_mask: 类型为整数序列，数据类型为int8
• labels: 类型为整数序列，数据类型为int64

数据分割

• train: 包含1260个样本，大小为1846734.3字节
• test: 包含140个样本，大小为205192.7字节

数据大小

• 下载大小: 695218字节
• 数据集大小: 2051927.0字节

配置

• default:
  • train: 路径为data/train-*
  • test: 路径为data/test-*