Ti-Ma/TiMaGPT2-2019

---
license: other
license_name: paracrawl-license
license_link: LICENSE
---
The following dataset is constructed using entirely historical data up to the cutoff date "31-12-2019". The data comes from the WMT News dataset (https://data.statmt.org/news-crawl/en/) and Wikipedia. This dataset is the training dataset for a GPT-2-small-based model, and is available on Huggingface at the following location: "TiMa/TiMaGPT2-2019".

The dataset uses the same license as the WMT News dataset (https://data.statmt.org/news-crawl/README) as this is the less permissive license of the datasets that create this training dataset, further details are outlined in the paper.

Please refer to and cite the following paper when using this dataset in any downstream applications:

@inproceedings{drinkall-tima-2024,
title = "Time Machine GPT",
author = "Drinkall, Felix and Zohren, Stefan and Pierrehumbert, Janet",
booktitle = "Findings of the Association for Computational Linguistics: NAACL 2024",
month = june,
year = "2024",
publisher = "Association for Computational Linguistics" }

原始信息汇总

数据集概述

数据来源

• WMT News 数据集：https://data.statmt.org/news-crawl/en/
• Wikipedia

数据截止日期

• 截止日期为 "31-12-2019"

数据集用途

• 用于训练基于 GPT-2-small 的模型

数据集位置

• 在 Huggingface 上的位置：TiMa/TiMaGPT2-2019

许可证

• 许可证类型：paracrawl-license
• 许可证详情：LICENSE

引用信息

• 当使用此数据集时，请引用以下论文：

  @inproceedings{drinkall-tima-2024, title = "Time Machine GPT", author = "Drinkall, Felix and Zohren, Stefan and Pierrehumbert, Janet", booktitle = "Findings of the Association for Computational Linguistics: NAACL 2024", month = june, year = "2024", publisher = "Association for Computational Linguistics" }