Chinese Treebank 7.0

<h3> Introduction </h3> <p> Chinese Treebank 7.0, Linguistic Data Consortium (LDC) catalog number LDC2010T07 and isbn 1-58563-542-1, consists of over one million words of annotated and parsed text from Chinese newswire, magazine news, various broadcast news and broadcast conversation programs, web newsgroups and weblogs. </p> <p> The Chinese Treebank project began at the University of Pennsylvania in 1998, continued at the University of Colorado and is now at <a href="http://www.cs.brandeis.edu/%7Ellc/page2/page2.html" rel="nofollow">Brandeis University</a>. The projects goal is to provide a large, part-of-speech tagged and fully bracketed Chinese language corpus. The first delivery, Chinese Treebank 1.0, contained 100,000 syntactically annotated words from Xinhua News Agency (Xinhua) newswire. It was later corrected and released in 2001 as <a href="http://catalog.ldc.upenn.edu/LDC2001T11" rel="nofollow">Chinese Treebank 2.0 (LDC2001T11)</a> and consisted of approximately 100,000 words. The LDC released <a href="http://catalog.ldc.upenn.edu/LDC2004T05" rel="nofollow">Chinese Treebank 4.0 (LDC2004T05)</a>, an updated version containing roughly 400,000 words, in 2004. A year later, the LDC published the 500,000 word <a href="http://catalog.ldc.upenn.edu/LDC2005T01" rel="nofollow">Chinese Treebank 5.0 (LDC2005T01)</a>. <a href="http://catalog.ldc.upenn.edu/LDC2007T36" rel="nofollow">Chinese Treebank 6.0 (LDC2007T36)</a>, released in 2007, consisted of 780,000 words. Chinese Treebank 7.0 adds new annotated newswire data, broadcast material and web text to this effort. </p><h3> Data </h3> <p> This release consists of 2,448 text files, 51,447 sentences, 1,196,329 words and 1,931,381 hanzi (Chinese characters). The data is provided in UTF-8 encoding and the annnotation has Penn Treebank-style labeled brackets. Details of the annotation standard can be found in the enclosed segmentation, POS-tagging and bracketing guidelines. The data is provided in four different formats: raw text, word segmented, word segmented and POS-tagged and syntactically-bracketed formats. </p> <p>Chinese Treebank 7.0 includes text from the following genres and sources:</p> <table> <tr> <td> <strong>Genre</strong> </td> <td> <strong># words</strong> </td> </tr> <tr> <td> Newswire (Agence France Presse, China News Service, Guangming Daily, Peoples Daily, Xinhua News Agency) </td> <td> 260,164 </td> </tr> <tr> <td> News Magazine (Sinorama) </td> <td> 256,305 </td> </tr> <tr> <td> Broadcast News (China Broadcasting System, China Central TV, China National Radio, China Television System, New Tang Dynasty TV, Phoenix TV, Voice of America) </td> <td> 287,442 </td> </tr> <tr> <td> Broadcast Conversation (Anhui TV, China Central TV, CNN, MSNBC, New Tang Dynasty TV, Phoenix TV) </td> <td> 184,161 </td> </tr> <tr> <td> Newsgroups, Weblogs </td> <td> 208,257 </td> </tr> <tr> <td> Total </td> <td> 1,196,329 </td> </tr> </table><h3>Sponsorship </h3> <p> This work was supported in part by the Defense Advanced Research Projects Agency, GALE Program Grant No. HR0011-06-0022. The content of this publication does not necessarily reflect the position or the policy of the Government, and no official endorsement should be inferred. </p> <h3>Samples</h3> <p>For an example of the data in this corpus, please review the <a href="./desc/addenda/LDC2010T07.png" rel="nofollow"> sample </a> file. </p><h3>Updates</h3> <p> No updates have been issued as of this time.</p> Contact: <a rel="nofollow"> <b>[e-mail]</b> </a> © 2010 <a href="http://www.ldc.upenn.edu" rel="nofollow"> <b>Linguistic Data Consortium</b> </a>, <a href="http://www.upenn.edu" rel="nofollow"> <b>Trustees of the University of Pennsylvania</b> </a>. All Rights Reserved.</br>
Portions © 2006 Agence France Presse, © 2006 Anhui TV, © 2005 Cable News Network, LP, LLLP, © 2000-2001 China Broadcasting System, © 2000-2001, 2005-2006 China Central TV, © 2000-2001 China National Radio, © 2006 Chinanews.com, © 2000-2001 China Television System, © 2006 Guangming Daily, © 2006 National Broadcasting Company, Inc., © 2006 New Tang Dynasty TV, © 2006 Peoples Daily Online, © 2005-2006 Phoenix TV, © 1999-2001 Sinorama Magazine, © 1996-1998, 2006 Xinhua News Agency, © 2001, 2004, 2005, 2007, 2009, 2010 Trustees of the University of Pennsylvania

<h3>引言</h3> <p>中文树库7.0（Chinese Treebank 7.0），语言数据联盟（LDC）编号LDC2010T07，ISBN 1-58563-542-1，包含超过一百万词的标注与句法分析文本，语料来源涵盖中文新闻专线、杂志新闻、各类广播新闻和广播对话节目、网络新闻组及博客。</p> <p>中文树库项目于1998年在宾夕法尼亚大学启动，后在科罗拉多大学继续推进，现由<a href="http://www.cs.brandeis.edu/%7Ellc/page2/page2.html" rel="nofollow">布兰迪斯大学</a>主持。该项目的目标是提供一个大规模、带词性标注且完整括号结构的汉语语料库。首个版本中文树库1.0包含10万词来自新华社新闻专线的句法标注语料。该版本后来经过修正，于2001年以<a href="http://catalog.ldc.upenn.edu/LDC2001T11" rel="nofollow">中文树库2.0（LDC2001T11）</a>形式发布，规模约为10万词。LDC于2004年发布了<a href="http://catalog.ldc.upenn.edu/LDC2004T05" rel="nofollow">中文树库4.0（LDC2004T05）</a>，为更新版本，包含约40万词。一年后，LDC发布了50万词的<a href="http://catalog.ldc.upenn.edu/LDC2005T01" rel="nofollow">中文树库5.0（LDC2005T01）</a>。<a href="http://catalog.ldc.upenn.edu/LDC2007T36" rel="nofollow">中文树库6.0（LDC2007T36）</a>于2007年发布，包含78万词。中文树库7.0在此基础上新增了经过标注的新闻专线数据、广播材料和网络文本。</p><h3>数据</h3> <p>本次发布包含2,448个文本文件、51,447个句子、1,196,329个词和1,931,381个汉字（中文汉字）。数据采用UTF-8编码提供，标注采用宾州树库风格的带标签括号结构。标注标准的详细信息可参见随附的分词、词性标注和括号结构标注指南。数据以四种不同格式提供：原始文本、分词文本、分词并标注词性文本，以及句法括号结构标注文本。</p> <p>中文树库7.0涵盖以下体裁和来源的文本：</p> <table> <tr> <td><strong>体裁</strong></td> <td><strong>词数</strong></td> </tr> <tr> <td>新闻专线（法新社、中国新闻社、光明日报、人民日报、新华社）</td> <td>260,164</td> </tr> <tr> <td>新闻杂志（光华杂志）</td> <td>256,305</td> </tr> <tr> <td>广播新闻（中国广播公司、中国中央电视台、中央人民广播电台、中华电视公司、新唐人电视台、凤凰卫视、美国之音）</td> <td>287,442</td> </tr> <tr> <td>广播对话（安徽电视台、中国中央电视台、CNN、MSNBC、新唐人电视台、凤凰卫视）</td> <td>184,161</td> </tr> <tr> <td>新闻组、博客</td> <td>208,257</td> </tr> <tr> <td>总计</td> <td>1,196,329</td> </tr> </table><h3>资助</h3> <p>本工作部分由国防高级研究计划局（DARPA）GALE计划资助，资助编号HR0011-06-0022。本出版物内容不一定反映美国政府的立场或政策，亦不应推断为官方认可。</p><h3>样例</h3> <p>如需查看本语料库的数据示例，请查阅<a href="./desc/addenda/LDC2010T07.png" rel="nofollow">样例</a>文件。</p><h3>更新</h3> <p>截至目前尚未发布任何更新。</p>
联系方式：<a rel="nofollow"><b>[e-mail]</b></a>

© 2010 <a href="http://www.ldc.upenn.edu" rel="nofollow"><b>语言数据联盟</b></a>，<a href="http://www.upenn.edu" rel="nofollow"><b>宾夕法尼亚大学校董会</b></a>。版权所有。

部分版权 © 2006 法新社，© 2006 安徽电视台，© 2005 有线新闻网络（Cable News Network, LP, LLLP），© 2000-2001 中国广播公司，© 2000-2001、2005-2006 中国中央电视台，© 2000-2001 中央人民广播电台，© 2006 中国新闻网，© 2000-2001 中华电视公司，© 2006 光明日报，© 2006 国家广播公司（National Broadcasting Company, Inc.），© 2006 新唐人电视台，© 2006 人民网，© 2005-2006 凤凰卫视，© 1999-2001 光华杂志，© 1996-1998、2006 新华社，© 2001、2004、2005、2007、2009、2010 宾夕法尼亚大学校董会。

搜集汇总

背景与挑战

背景概述

Chinese Treebank 7.0是一个中文自然语言处理数据集，包含超过100万个词的标注和解析文本，数据来源多样，包括新闻通讯、杂志、广播和网络内容。该数据集提供了分词、词性标注和句法括号标注，适用于解析、机器翻译和信息提取等NLP应用。