AG News

<b>AG's News Topic Classification Dataset</b><br>Version 3, Updated 09/09/2015<br><br><b>ORIGIN</b><br>AG is a collection of more than 1 million news articles. News articles have been gathered from more than 2000 news sources by ComeToMyHead in more than 1 year of activity. ComeToMyHead is an academic news search engine which has been running since July, 2004. The dataset is provided by the academic comunity for research purposes in data mining (clustering, classification, etc), information retrieval (ranking, search, etc), xml, data compression, data streaming, and any other non-commercial activity. For more information, please refer to the link http://www.di.unipi.it/~gulli/AG_corpus_of_news_articles.html .<br>The AG's news topic classification dataset is constructed by Xiang Zhang ([e-mail]) from the dataset above. It is used as a text classification benchmark in the following paper: Xiang Zhang, Junbo Zhao, Yann LeCun. Character-level Convolutional Networks for Text Classification. Advances in Neural Information Processing Systems 28 (NIPS 2015).<br><br><b>DESCRIPTION</b><br>The AG's news topic classification dataset is constructed by choosing 4 largest classes from the original corpus. Each class contains 30,000 training samples and 1,900 testing samples. The total number of training samples is 120,000 and testing 7,600.<br>The file classes.txt contains a list of classes corresponding to each label.<br>The files train.csv and test.csv contain all the training samples as comma-sparated values. There are 3 columns in them, corresponding to class index (1 to 4), title and description. The title and description are escaped using double quotes ("), and any internal double quote is escaped by 2 double quotes (""). New lines are escaped by a backslash followed with an "n" character, that is "\n".<br><b>CLASSES</b><b><br></b>WorldSportsBusinessSci/Tech<br><br>**AG新闻主题分类数据集（AG's News Topic Classification Dataset）**<br>版本3，更新于2015年9月9日<br><br>**来源**<br>AG数据集包含超过100万篇新闻文章，由学术新闻搜索引擎ComeToMyHead从2000多个新闻来源中收集，历时一年多。ComeToMyHead是一款自2004年7月起投入运行的学术新闻搜索引擎。本数据集由学术社区提供，可用于数据挖掘（聚类、分类等）、信息检索（排序、搜索等）、XML、数据压缩、数据流及其他非商业性质的研究活动。更多信息请参阅链接：http://www.di.unipi.it/~gulli/AG_corpus_of_news_articles.html。<br>AG新闻主题分类数据集由张翔（[e-mail]）基于上述数据集构建，并在以下论文中作为文本分类基准测试集使用：Xiang Zhang, Junbo Zhao, Yann LeCun. 《面向文本分类的字符级卷积神经网络（Character-level Convolutional Networks for Text Classification）》，收录于《神经信息处理系统进展》28卷（NIPS 2015）。<br><br>**数据集说明**<br>AG新闻主题分类数据集从原始语料库中选取了4个规模最大的类别。每个类别包含30000条训练样本与1900条测试样本，总训练样本数为120000条，测试样本数为7600条。<br>文件classes.txt包含了各标签对应的类别列表。<br>文件train.csv与test.csv以逗号分隔值（CSV）格式存储全部训练样本，文件内共包含3列，分别对应类别索引（1至4）、标题与描述信息。标题与描述信息使用双引号（"）进行转义，内部出现的双引号需通过两个双引号（""）转义；换行符则通过反斜杠加字母n（即 ）进行转义。<br><br>**类别**<br>世界新闻、体育、商业、科技（Sci/Tech）