Chinese Treebank 6.0

<h3>Introduction</h3><br>
<p>This file contains documentation for Chinese Treebank 6.0, Linguistic Data Consortium (LDC) catalog number LDC2007T36 and isbn 1-58563-450-6.</p><br>
<p>The Chinese Treebank project began at the University of Pennsylvania in 1998 and continues at Penn and the University of Colorado. Chinese Treebank 6.0 is the latest version produced from this effort, consisting of 780,000 words (over 1.28 million Chinese characters) that are segmented, part-of-speech tagged and fully bracketed. The data sources include newswire from Xinhua News Agency, articles from Sinorama Magazine, news from the website of the Hong Kong Special Administrative Region and transcripts from various broadcast news programs.</p><br>
<p>The LDC published Chinese Treebank 1.0 in 2000; it was later corrected and released in 2001 as <a href="http://catalog.ldc.upenn.edu/LDC2001T11" rel="nofollow">Chinese Treebank 2.0 (LDC2001T11)</a> and consisted of approximately 100,000 words. The LDC released <a href="http://catalog.ldc.upenn.edu/LDC2004T05" rel="nofollow">Chinese Treebank 4.0 (LDC2004T05)</a>, an updated version containing roughly 400,000 words, in 2004. A year later, the LDC published the 500,000 word <a href="http://catalog.ldc.upenn.edu/LDC2005T01" rel="nofollow">Chinese Treebank 5.0 (LDC2005T01)</a>.</p><br>
<p>For information about Chinese Treebank methodology and guidelines, consult the attached documentation files and the <a href="https://www.cs.brandeis.edu/~llc/page2/page2.html">Chinese Treebank Project</a> website.</p><br>
<p>This release encompasses 2,036 text files, containing 28,295 sentences, 781,351 words and 1,285,149 hanzi (Chinese characters). The data is provided in two encodings: GBK and UTF-8, and the annotation has Penn Treebank-style labeled brackets. Details of the annotation standard can be found in the enclosed segmentation, POS-tagging and bracketing guidelines. The data is provided in four different formats: raw text, word segmented, word segmented and POS-tagged, and syntactically bracketed.</p><br>
<h3>Samples</h3><br>
<p>For an example of the data in this publication, please examine this <a href="desc/addenda/LDC2007T36.jpg" rel="nofollow">sample</a> of the bracketed data.</p></br>
Portions © 2000-2001 China Broadcasting System, © 2000-2001 China Central TV, © 2000-2001 China National Radio, © 2000-2001 China Television System, © 1997 The Government of the Hong Kong Special Administrative Region, © 1996-2001 Sinorama Magazine, © 1994-1998 Xinhua News Agency, © 2001, 2004, 2005, 2007 Trustees of the University of Pennsylvania

<h3>简介</h3><br><p>本文件为《中文树库6.0》的说明文档，其语言数据联盟（Linguistic Data Consortium，LDC）目录号为LDC2007T36，国际标准书号为1-58563-450-6。</p><br><p>中文树库（Chinese Treebank）项目于1998年在宾夕法尼亚大学启动，目前由宾大与科罗拉多大学持续推进。本次发布的中文树库6.0是该项目的最新版本，包含78万个词（逾128万个汉字），所有数据均经过分词、词性标注与完整句法括号标注。数据来源包括新华社（Xinhua News Agency）新闻专线、Sinorama杂志文章、香港特别行政区政府网站新闻，以及各类广播新闻节目转写文本。</p><br><p>语言数据联盟（LDC）于2000年发布了中文树库1.0；后经修正，于2001年以<a href="http://catalog.ldc.upenn.edu/LDC2001T11" rel="nofollow">中文树库2.0（LDC2001T11）</a>之名再次发布，包含约10万个词。该联盟于2004年推出更新版<a href="http://catalog.ldc.upenn.edu/LDC2004T05" rel="nofollow">中文树库4.0（LDC2004T05）</a>，收录约40万个词；次年，语言数据联盟发布了包含50万个词的<a href="http://catalog.ldc.upenn.edu/LDC2005T01" rel="nofollow">中文树库5.0（LDC2005T01）</a>。</p><br><p>如需了解中文树库的研究方法与标注规范，请参阅随附的说明文档，以及<a href="https://www.cs.brandeis.edu/~llc/page2/page2.html">中文树库项目</a>官方网站。</p><br><p>本次发布包包含2036个文本文件，共计28295个句子、781351个词与1285149个汉字。数据提供GBK与UTF-8两种编码格式，标注采用宾州树库（Penn Treebank）风格的带标签括号。标注标准的详细说明可参阅随附的分词、词性标注与句法括号标注规范文档。数据共提供四种格式：原始文本、分词文本、分词且词性标注文本，以及句法括号标注文本。</p><br><h3>示例</h3><br><p>如需查看本发布包中数据的示例，请参阅<a href="desc/addenda/LDC2007T36.jpg" rel="nofollow">此括号标注数据样本</a>。</p><br>部分内容 © 2000-2001 中国广播系统、© 2000-2001 中国中央电视台、© 2000-2001 中国国家广播电台、© 2000-2001 中国电视系统、© 1997 香港特别行政区政府、© 1996-2001 Sinorama杂志、© 1994-1998 新华社、© 2001、2004、2005、2007 宾夕法尼亚大学受托人

搜集汇总

背景与挑战

背景概述

Chinese Treebank 6.0是一个中文树库数据集，发布于2007年，包含约78万个词（1.28百万汉字），数据源自新闻文本如新华社和Sinorama杂志，并进行了分词、词性标注和句法括号化标注。该数据集适用于自然语言处理、句法分析和机器翻译等任务，是中文树库系列的更新版本，提供多种数据格式和编码支持。