Ti-Ma/TiMaGPT2-2015

---
license: other
license_name: paracrawl-license
license_link: LICENSE
---
The following dataset is constructed using entirely historical data up to the cutoff date "31-12-2015". The data comes from the WMT News dataset (https://data.statmt.org/news-crawl/en/) and Wikipedia. This dataset is the training dataset for a GPT-2-small-based model, and is available on Huggingface at the following location: "TiMa/TiMaGPT2-2015".

The dataset uses the same license as the WMT News dataset (https://data.statmt.org/news-crawl/README) as this is the less permissive license of the datasets that create this training dataset, further details are outlined in the paper.

Please refer to and cite the following paper when using this dataset in any downstream applications:

@inproceedings{drinkall-tima-2024,
title = "Time Machine GPT",
author = "Drinkall, Felix and Zohren, Stefan and Pierrehumbert, Janet",
booktitle = "Findings of the Association for Computational Linguistics: NAACL 2024",
month = june,
year = "2024",
publisher = "Association for Computational Linguistics" }

原始信息汇总

数据集概述

数据来源

• 数据集由WMT News数据集（https://data.statmt.org/news-crawl/en/）和Wikipedia的历史数据构建，截止日期为2015年12月31日。

数据用途

• 该数据集是为基于GPT-2-small模型的训练数据集。

数据集位置

• 数据集可在Huggingface上获取，链接为："TiMa/TiMaGPT2-2015"。

许可证信息

• 数据集使用与WMT News数据集相同的许可证（https://data.statmt.org/news-crawl/README），该许可证较为限制。

引用信息

• 使用此数据集时，请引用以下论文：
  • 论文标题：Time Machine GPT
  • 作者：Drinkall, Felix and Zohren, Stefan and Pierrehumbert, Janet
  • 出版信息：Findings of the Association for Computational Linguistics: NAACL 2024, June 2024, Association for Computational Linguistics