Fisher and CALLHOME Spanish--English Speech Translation

<h3>Introduction</h3><br>
<p>Fisher and CALLHOME Spanish-English Speech Translation was developed at Johns Hopkins University and contains English reference translations and speech recognizer output (in various forms) that complement the LDC Fisher Spanish (<a href="../../../LDC2010T04">LDC2010T04</a>) and CALLHOME Spanish audio and transcript releases (<a href="../../../LDC96T17">LDC96T17</a>). Together, they make a four-way parallel text dataset representing approximately 38 hours of speech, with defined training, development, and held-out test sets.</p><br>
<h3>Data</h3><br>
<p>The source data are the Fisher Spanish and CALLOME Spanish corpora developed by LDC, comprising transcribed telephone conversations between (mostly native) Spanish speakers in a variety of dialects. The Fisher Spanish data set consists of 819 transcribed conversations on an assortment of provided topics primarily between strangers, resulting in approximately 160 hours of speech aligned at the utterance level, with 1.5 million tokens. The CALLHOME Spanish corpus comprises 120 transcripts of spontaneous conversations primarily between friends and family members, resulting in approximately 20 hours of speech aligned at the utterance level, with just over 200,000 words (tokens) of transcribed text.</p><br>
<p>Translations were obtained by crowdsourcing using Amazon's Mechanical Turk, after which the data was split into training, development, and test sets. The CALLHOME data set defines its own data splits, organized into train, devtest, and evltest, which were retained here. For the Fisher material, four data splits were produced: a large training section and three test sets. These test sets correspond to portions of the data where four translations exist.</p><br>
<h3>Samples</h3><br>
<p>Please view this <a href="desc/addenda/LDC2014T23.corpus.txt">corpus</a> and <a href="desc/addenda/LDC2014T23.mapping.txt">mapping</a>&nbsp;sample.</p><br>
<h3>Updates</h3><br>
<p>None at this time.</p></br>
Portions © 2014 Chris Callison-Burch, Matt Post, © 1996, 1997, 2005-2006, 2010, 2014 Trustees of the University of Pennsylvania