kye/all-lucidrain-code-python-tokenized-8192

--- dataset_info: features: - name: repo_name sequence: string - name: file_path sequence: string - name: input_ids sequence: int32 - name: attention_mask sequence: int8 splits: - name: train num_bytes: 2299336 num_examples: 21 download_size: 349131 dataset_size: 2299336 --- # Dataset Card for "all-lucidrain-code-python-tokenized-8192" [More Information needed](https://github.com/huggingface/datasets/blob/main/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

原始信息汇总

数据集概述

数据集名称

• 名称: all-lucidrain-code-python-tokenized-8192

数据特征

• repo_name: 字符串序列
• file_path: 字符串序列
• input_ids: 32位整数序列
• attention_mask: 8位整数序列

数据分割

• 训练集
  • 字节数: 2299336
  • 样本数: 21

数据集大小

• 下载大小: 349131 字节
• 数据集大小: 2299336 字节