tf-tpu/wikitext-v1-tfrecords

This dataset repository contains the [TFRecord](https://www.tensorflow.org/tutorials/load_data/tfrecord) shards of the [WikText (v1) dataset](https://huggingface.co/datasets/wikitext.

We used [this script](https://github.com/huggingface/transformers/blob/main/examples/tensorflow/language-modeling-tpu/prepare_tfrecord_shards.py) to prepare these TFRecord shards.

For more details on how these TFRecord shards should be used, refer to the following tutorial: [Training a masked language model end-to-end from scratch on TPUs
](https://github.com/huggingface/transformers/tree/main/examples/tensorflow/language-modeling-tpu).

原始信息汇总

数据集概述

数据集名称

WikText (v1) 数据集

数据集格式

TFRecord 分片

数据集准备工具

使用脚本 prepare_tfrecord_shards.py 准备 TFRecord 分片。

数据集使用指南

详细使用方法请参考教程：Training a masked language model end-to-end from scratch on TPUs。