Ti-Ma/TiMaGPT2-2013

---
license: other
license_name: paracrawl-license
license_link: LICENSE
---
The following dataset is constructed using entirely historical data up to the cutoff date "31-12-2013". The data comes from the WMT News dataset (https://data.statmt.org/news-crawl/en/) and Wikipedia. This dataset is the training dataset for a GPT-2-small-based model, and is available on Huggingface at the following location: "TiMa/TiMaGPT2-2013".

The dataset uses the same license as the WMT News dataset (https://data.statmt.org/news-crawl/README) as this is the less permissive license of the datasets that create this training dataset, further details are outlined in the paper.

Please refer to and cite the following paper when using this dataset in any downstream applications:

@inproceedings{drinkall-tima-2024,
title = "Time Machine GPT",
author = "Drinkall, Felix and Zohren, Stefan and Pierrehumbert, Janet",
booktitle = "Findings of the Association for Computational Linguistics: NAACL 2024",
month = june,
year = "2024",
publisher = "Association for Computational Linguistics" }

原始信息汇总

数据集概述

数据来源

• 数据集由WMT News数据集（https://data.statmt.org/news-crawl/en/）和Wikipedia的历史数据构成，截止日期为2013年12月31日。

数据用途

• 该数据集是用于训练基于GPT-2-small模型的训练数据集。

数据集位置

• 数据集可在Huggingface上获取，具体位置为："TiMa/TiMaGPT2-2013"。

许可证

• 数据集遵循paracrawl-license，与WMT News数据集的许可证相同，详情见LICENSE文件。

引用信息

• 使用此数据集时，请引用以下论文：
  • 标题：Time Machine GPT
  • 作者：Drinkall, Felix and Zohren, Stefan and Pierrehumbert, Janet
  • 出版信息：Findings of the Association for Computational Linguistics: NAACL 2024, June 2024, Association for Computational Linguistics