Chinese Treebank 7.0

<h3> Introduction </h3> <p> Chinese Treebank 7.0, Linguistic Data Consortium (LDC) catalog number LDC2010T07 and isbn 1-58563-542-1, consists of over one million words of annotated and parsed text from Chinese newswire, magazine news, various broadcast news and broadcast conversation programs, web newsgroups and weblogs. </p> <p> The Chinese Treebank project began at the University of Pennsylvania in 1998, continued at the University of Colorado and is now at <a href="http://www.cs.brandeis.edu/%7Ellc/page2/page2.html" rel="nofollow">Brandeis University</a>. The projects goal is to provide a large, part-of-speech tagged and fully bracketed Chinese language corpus. The first delivery, Chinese Treebank 1.0, contained 100,000 syntactically annotated words from Xinhua News Agency (Xinhua) newswire. It was later corrected and released in 2001 as <a href="http://catalog.ldc.upenn.edu/LDC2001T11" rel="nofollow">Chinese Treebank 2.0 (LDC2001T11)</a> and consisted of approximately 100,000 words. The LDC released <a href="http://catalog.ldc.upenn.edu/LDC2004T05" rel="nofollow">Chinese Treebank 4.0 (LDC2004T05)</a>, an updated version containing roughly 400,000 words, in 2004. A year later, the LDC published the 500,000 word <a href="http://catalog.ldc.upenn.edu/LDC2005T01" rel="nofollow">Chinese Treebank 5.0 (LDC2005T01)</a>. <a href="http://catalog.ldc.upenn.edu/LDC2007T36" rel="nofollow">Chinese Treebank 6.0 (LDC2007T36)</a>, released in 2007, consisted of 780,000 words. Chinese Treebank 7.0 adds new annotated newswire data, broadcast material and web text to this effort. </p><h3> Data </h3> <p> This release consists of 2,448 text files, 51,447 sentences, 1,196,329 words and 1,931,381 hanzi (Chinese characters). The data is provided in UTF-8 encoding and the annnotation has Penn Treebank-style labeled brackets. Details of the annotation standard can be found in the enclosed segmentation, POS-tagging and bracketing guidelines. The data is provided in four different formats: raw text, word segmented, word segmented and POS-tagged and syntactically-bracketed formats. </p> <p>Chinese Treebank 7.0 includes text from the following genres and sources:</p> <table> <tr> <td> <strong>Genre</strong> </td> <td> <strong># words</strong> </td> </tr> <tr> <td> Newswire (Agence France Presse, China News Service, Guangming Daily, Peoples Daily, Xinhua News Agency) </td> <td> 260,164 </td> </tr> <tr> <td> News Magazine (Sinorama) </td> <td> 256,305 </td> </tr> <tr> <td> Broadcast News (China Broadcasting System, China Central TV, China National Radio, China Television System, New Tang Dynasty TV, Phoenix TV, Voice of America) </td> <td> 287,442 </td> </tr> <tr> <td> Broadcast Conversation (Anhui TV, China Central TV, CNN, MSNBC, New Tang Dynasty TV, Phoenix TV) </td> <td> 184,161 </td> </tr> <tr> <td> Newsgroups, Weblogs </td> <td> 208,257 </td> </tr> <tr> <td> Total </td> <td> 1,196,329 </td> </tr> </table><h3>Sponsorship </h3> <p> This work was supported in part by the Defense Advanced Research Projects Agency, GALE Program Grant No. HR0011-06-0022. The content of this publication does not necessarily reflect the position or the policy of the Government, and no official endorsement should be inferred. </p> <h3>Samples</h3> <p>For an example of the data in this corpus, please review the <a href="./desc/addenda/LDC2010T07.png" rel="nofollow"> sample </a> file. </p><h3>Updates</h3> <p> No updates have been issued as of this time.</p> Contact: <a rel="nofollow"> <b>[e-mail]</b> </a> © 2010 <a href="http://www.ldc.upenn.edu" rel="nofollow"> <b>Linguistic Data Consortium</b> </a>, <a href="http://www.upenn.edu" rel="nofollow"> <b>Trustees of the University of Pennsylvania</b> </a>. All Rights Reserved.</br>
Portions © 2006 Agence France Presse, © 2006 Anhui TV, © 2005 Cable News Network, LP, LLLP, © 2000-2001 China Broadcasting System, © 2000-2001, 2005-2006 China Central TV, © 2000-2001 China National Radio, © 2006 Chinanews.com, © 2000-2001 China Television System, © 2006 Guangming Daily, © 2006 National Broadcasting Company, Inc., © 2006 New Tang Dynasty TV, © 2006 Peoples Daily Online, © 2005-2006 Phoenix TV, © 1999-2001 Sinorama Magazine, © 1996-1998, 2006 Xinhua News Agency, © 2001, 2004, 2005, 2007, 2009, 2010 Trustees of the University of Pennsylvania