BOLT CTS CallFriend CallHome Mainland Mandarin Chinese Transcripts and Translations

<h3>Introduction</h3>

<p>BOLT CTS CALLFRIEND CALLHOME Mainland Mandarin Chinese Transcripts and Translations, Linguistic Data Consortium (LDC) Catalog Number LDC2025T05, was developed by LDC and consists of transcripts and their corresponding English translations for 93 hours of conversational telephone speech between native speakers of the Mandarin Chinese dialect spoken in mainland China.</p>
<p>The DARPA BOLT (Broad Operational Language Translation) program developed machine translation and information retrieval for less formal genres, focusing particularly on user-generated content. LDC supported the BOLT program by collecting informal data sources -- discussion forums, conversational telephone speech, text messaging and chat -- in Chinese, Egyptian Arabic and English. The telephone data was transcribed, translated and annotated for various tasks including word alignment, treebanking, and co-reference.</p>

<h3>Data</h3>
<p>The source audio recordings consist of 236 telephone conversations taken from LDC's multilingual CALLFRIEND and CALLHOME series developed to support speech identification and language identification technology development.</p>
<p>Transcribers were required to produce a verbatim transcript of all speech within a file using simplified Chinese orthography and to add minimal markup to capture salient features of the speech. Some transcripts include redactions for potential personally identifying information. Further information about the transcription methodology is contained in the transcription guidelines accompanying this release. All speech data was transcribed.</p>
<p>The goal of the BOLT translation task was to translate the Chinese transcripts into fluent English while preserving the meaning present in the original Chinese text. Transcripts in the development and evaluation partitions received first pass and gold standard translations. Further information about the translation methodology is contained in the translation guidelines accompanying this release. 89% of the transcripts were translated into English.</p>
<p>The transcripts are divided into training, development and evaluation partitions as follows:</p>
<table border="1" summary="data volume">
<tbody>
<tr>
<td>partition</td>
<td>doc count</td>
<td>su count</td>
<td>src ntoken</td>
<td>src nword</td>
<td>eng nword</td>
</tr>
<tr>
<td>train</td>
<td>30</td>
<td>7,490</td>
<td>72,242</td>
<td>48,161</td>
<td>60,303</td>
</tr>
<tr>
<td>dev</td>
<td>101</td>
<td>31,429</td>
<td>332,201</td>
<td>221,467</td>
<td>215,714</td>
</tr>
<tr>
<td>eval</td>
<td>170</td>
<td>113,149</td>
<td>1,189,415</td>
<td>792,943</td>
<td>880,202</td>
</tr>
<tr>
<td>total</td>
<td>301</td>
<td>152,068</td>
<td>1,593,858</td>
<td>1,062,572</td>
<td>1,155,679</td>
</tr>
</tbody>
</table>
<p>Transcripts and translations are presented in xml format, UTF-8 encoded.</p>

<h3>Directory Structure</h3>
<p>Please see <a href="docs/file.tbl">file.tbl</a> for a complete file list as well as checksums for this publication.</p>
<p>The data in this package is organized by the partition as used by the BOLT program - development data (dev), training data (train) and evaluation data (eval).</p>
<ul>
<li><a href="data/">data/</a> - Contains the transcription and translation files.</li>
<ul>
<li><a href="train/">dev/</a> - Contains the development data</li>
<li><a href="train/">train/</a> - Contains the training data</li>
<li><a href="train/">eval/</a> - Contains the evaluation data</li>
</ul>
<li><a href="docs/">docs/</a> - Contains additional documentation, guidelines and a file table.</li>
</ul>

<h3>Acknowledgement</h3>
<p>This material is based upon work supported by the Defense Advanced Research Projects Agency (DARPA) under Contract No. HR0011-11-C-0145. The content does not necessarily reflect the position or the policy of the Government, and no official endorsement should be inferred.</p>

<h3>Updates</h3>
<p>No updates at this time.</p>