Chinese English News Magazine Parallel Text

<h3>Introduction</h3> <p>This file contains documentation on the Chinese English News Magazine Parallel Text, Linguistic Data Consortium (LDC) catalog number LDC2005T10 and ISBN 1-58563-333-X. </p><p>This corpus contains Chinese news stories and their English translations LDC collected via Sinorama Magazine, Taiwan, from 1976 to 2004. It totals 6,366 story pairs, 365,568 sentence pairs, 20M Chinese characters and 9M English words. The corpus is aligned at sentence level.</p><h3>Data</h3> <p>Sinorama Magazine is published monthly in several languages, including Chinese, English, Japanese. LDC received its 1976 to 2000 publications on a single CD, and its 2001 to 2004 publications via Sinorama's website. </p> <p>The Sinorama Chinese text was encoded in Big5. The data came story aligned but were lack of sentence level alignment. The sentence alignment was done at the LDC using <a href="http://champollion.sourceforge.net" rel="nofollow">Champollion</a> v 1.1. </p> <p>The final data is put in the data directory, which contains subdirectories for Chinese documents, English documents, and the sentence level alignment, identified as "Chinese," "English," and "alignment." </p> <p>The English and Chinese files may contain one or more documents, with each document formatted in SGML as follows: </p><p> [English or Chinese text] </p><p> [English or Chinese text] [English or Chinese text] ... </p><p>Notes: * the </p><p> and tags are always assigned sequential numeric IDs, starting at one. * the tags are always placed on the same line with their contents, and are always separated from the contents by a space. </p> * if an English file and a Chinese file share the same file name, they contain the same documents. * all Chinese text is encoded in Big5. <p>Each alignment file contains the sentence level alignment of multiple documents, each being formatted in SGML as follows: ... </p><p>Notes: * the docid in an English file, its Chinese translation and the ALIGNMENT are the same. * EnglishSegId and ChineseSegId may have none, one, or more than one segment IDs. </p><h3>Samples</h3> <p>The following files provide an example of this corpus: </p><ul> <li> <a href="desc/addenda/LDC2005T10_Chinese.txt" rel="nofollow">Chinese</a> </li> <li> <a href="desc/addenda/LDC2005T10_English.txt" rel="nofollow">English</a> </li> <li> <a href="desc/addenda/LDC2005T10_align.txt" rel="nofollow">Alignment</a> </li> </ul> <p>Portions © 2005 Trustees of the University of Pennsylvania</p></br>
Portions © 1976-2004 Sinorama Magazine <br><br>Portions © 2005 Trustees of the University of Pennsylvania