English Gigaword Fourth Edition

<h3>Introduction</h3> <p>This file contains documentation for English Gigaword Fourth Edition, Linguistic Data Consortium (LDC) catalog number LDC2009T13 and isbn 1-58563-515-4. </p><p> English Gigaword, now being released in its fourth edition, is a comprehensive archive of newswire text data that has been acquired over several years by the LDC at the University of Pennsylvania. The fourth edition includes all of the contents in English Gigawaord Third Edition (<a href="http://catalog.ldc.upenn.edu/LDC2007T07" rel="nofollow">LDC2007T07</a>) plus new data covering the 24-month period of January 2007 through December 2008. </p><p>The six distinct international sources of English newswire included in this edition are the following:</p> <ul> <li>Agence France-Presse, English Service (afp_eng) </li> <li>Associated Press Worldstream, English Service (apw_eng) </li> <li>Central News Agency of Taiwan, English Service (cna_eng) </li> <li>Los Angeles Times/Washington Post Newswire Service (ltw_eng) </li> <li>New York Times Newswire Service (nyt_eng) </li> <li>Xinhua News Agency, English Service (xin_eng) </li> </ul> <h3>New in the Fourth Edition</h3> <ul> <li>Articles with significant Spanish language content have now been identified and documented. </li> <li>Markup has been simplified and made consistent throughout the corpus. </li> <li>Information structure has been simplified. </li> <li>Character entities have been simplified. </li> </ul><h3>Samples</h3> <p>For an example of the data in this corpus, please review this <a href="./desc/addenda/LDC2009T13.html" rel="nofollow">sample file</a>. </p><h3>Sponsorship</h3> <p>This work was supported in part by the Defense Advanced Research Projects Agency, GALE Program Grant No. HR0011-06-1-0003. The content of this publication does not necessarily reflect the position or the policy of the Government, and no official endorsement should be inferred.</p> </br>
Portions © 1994-2008 Agence France Presse, © 1994-2008 The Associated Press, © 1997-2008 Central News Agency (Taiwan), © 1994-1998, 2003-2008 Los Angeles Times-Washington Post News Service, Inc., © 1994-2008 New York Times, © 1995-2008 Xinhua News Agency, © 2009 Trustees of the University of Pennsylvania

<h3>引言</h3> <p>本文件包含英语巨著语料库（English Gigaword）第四版的相关文档，其语言数据联盟（Linguistic Data Consortium, LDC）目录编号为LDC2009T13，国际标准书号（ISBN）为1-58563-515-4。</p><p>英语巨著语料库（English Gigaword）第四版是宾夕法尼亚大学语言数据联盟（LDC）历时多年采集的新闻文本综合存档。本版包含第三版英语巨著语料库（<a href="http://catalog.ldc.upenn.edu/LDC2007T07" rel="nofollow">LDC2007T07</a>）的全部内容，以及2007年1月至2008年12月共24个月的新增数据。</p><p>本版收录的英语新闻文本来自6家不同的国际机构，具体如下：</p> <ul> <li>法新社英语专线（afp_eng）</li> <li>美联社全球专线英语服务（apw_eng）</li> <li>台湾中央通讯社英语专线（cna_eng）</li> <li>《洛杉矶时报》/《华盛顿邮报》新闻专线服务（ltw_eng）</li> <li>《纽约时报》新闻专线服务（nyt_eng）</li> <li>新华通讯社英语专线（xin_eng）</li> </ul> <h3>第四版新增内容</h3> <ul> <li>已完成对含大量西班牙语内容的文本的识别与标注</li> <li>语料库的标记格式已简化并实现全库统一规范</li> <li>信息结构已优化简化</li> <li>字符实体已简化处理</li> </ul><h3>示例</h3> <p>如需查看本语料库的示例数据，请查阅该<a href="./desc/addenda/LDC2009T13.html" rel="nofollow">示例文件</a>。</p><h3>资助说明</h3> <p>本项目部分获得美国国防高级研究计划局（Defense Advanced Research Projects Agency）GALE项目资助（资助编号HR0011-06-1-0003）。本出版物的内容不一定代表美国政府的立场或政策，亦不应被视为获得官方背书。</p> </br>
部分内容 © 1994-2008 法新社，© 1994-2008 美联社，© 1997-2008 台湾中央通讯社，© 1994-1998, 2003-2008 洛杉矶时报-华盛顿邮报新闻服务公司，© 1994-2008 《纽约时报》，© 1995-2008 新华通讯社，© 2009 宾夕法尼亚大学托管会

搜集汇总

背景与挑战

背景概述

English Gigaword Fourth Edition是一个由LDC发布的综合性英文新闻文本档案，基于第三版扩展了2007年至2008年的数据。它包含来自六个国际新闻机构的文本，第四版新增了对西班牙语内容的识别，并简化了标记、信息结构和字符实体。