RT-04 MDE Training Data Text/Annotations
收藏资源简介：
<h3>Introduction</h3> <p> This corpus was created by Linguistic Data Consortium to provide training data for the RT-04 Fall Metadata Extraction (MDE) Evaluation, part of the DARPA EARS (Efficient, Affordable, Reusable Speech-to-Text) Program. This data set has been created and distributed by Linguistic Data Consortium. This data was previously released to the EARS MDE community as LDC2004E31. </p> <p> The goal of MDE is to enable technology that can take raw Speech-to-Text output and refine it into forms that are of more use to humans and to downstream automatic processes. In simple terms, this means the creation of automatic transcripts that are maximally readable. This readability might be achieved in a number of ways: flagging non-content words like filled pauses and discourse markers for optional removal; marking sections of disfluent speech; and creating boundaries between natural breakpoints in the flow of speech so that each sentence or other meaningful unit of speech might be presented on a separate line within the resulting transcript. Natural capitalization, punctuation and standardized spelling, plus sensible conventions for representing speaker turns and identity are further elements in the readable transcript. LDC has defined a SimpleMDE annotation task specification and has annotated English telephone and broadcast news data to provide training data for MDE. </p> <p> In this release, some original annotations contained in LDC2004E31 have been re-mapped to new MDE elements to support better annotation consistency. In particular, the mapping affects Discourse Responses (DR), Discourse Markers (DM) and Backchannel SUs (BC). A description of the original mapping proposed by ICSI appears in 3) below, with complete documentation of the mapping rules contained in the docs/drmap-discussion directory. The scripts used to apply the mapping can be found in the docs/scripts/drmap directory. </p> <h3>Samples</h3> <p> For an example of this corpus, please review the following xml samples. </p><ul> <li> <a href="desc/addenda/LDC2005T24_bnews.xml" rel="nofollow">Broadcast News Annotations</a> </li> <li> <a href="desc/addenda/LDC2005T24_cts.xml" rel="nofollow">Telephone Conversation Annotation</a> </li> </ul> <p> The World is a co-production of Public Radio International and the British Broadcasting Corporation and is produced at WGBH Boston.</p></br> Portions © 2004 Trustees of the University of Pennsylvania,© 2003 American Broadcasting Company,© 2003 National Broadcasting Company,© 2003 Public Radio International,© 2003 Cable News Network, Inc. All Rights Reserved,© 2003 National Cable Satellite Corporation <br><br> The World is a co-production of Public Radio International and the British Broadcasting Corporation and is produced at WGBH Boston.
<h3>引言</h3> <p>本语料库由语言数据联盟（Linguistic Data Consortium, LDC）构建，旨在为隶属于美国国防高级研究计划局（Defense Advanced Research Projects Agency, DARPA）高效、经济、可复用的语音转文本（Efficient, Affordable, Reusable Speech-to-Text, EARS）计划的RT-04秋季元数据提取（Metadata Extraction, MDE）评估任务提供训练数据。本数据集由语言数据联盟（LDC）创建并分发，此前曾以LDC2004E31编号向EARS MDE社区发布。</p> <p>元数据提取（MDE）的目标是开发能够处理原始语音转文本输出，并将其优化为更适用于人类用户与下游自动流程的形式的技术。简言之，这意味着构建可读性最大化的自动转录文本。此类可读性可通过多种方式实现：标记无实质内容的词汇（如填充停顿语与话语标记语）以供选择性移除；标注不流畅的语音片段；在语音流的自然断点处划分边界，使每个句子或其他有意义的语音单元可在生成的转录文本中单独成行。自然大小写规范、标点符号与标准拼写，以及用于表示说话人轮次与身份的合理约定，均为提升转录文本可读性的额外要素。语言数据联盟（LDC）制定了SimpleMDE标注任务规范，并对英语电话通话与广播新闻数据进行了标注，以为元数据提取（MDE）任务提供训练数据。</p> <p>在本次发布中，LDC2004E31中的部分原始标注已被重新映射至新的元数据提取（MDE）要素，以提升标注一致性。具体而言，此次映射涉及话语回应（Discourse Responses, DR）、话语标记语（Discourse Markers, DM）与反向通道语音单元（Backchannel SUs, BC）。由国际计算机科学研究所（International Computer Science Institute, ICSI）提出的原始映射规则说明详见下文第3点，映射规则的完整文档可在docs/drmap-discussion目录中获取。用于执行该映射的脚本位于docs/scripts/drmap目录下。</p> <h3>示例</h3> <p>若需查看本语料库的示例，请参阅以下XML格式样本。</p><ul> <li> <a href="desc/addenda/LDC2005T24_bnews.xml" rel="nofollow">广播新闻标注</a> </li> <li> <a href="desc/addenda/LDC2005T24_cts.xml" rel="nofollow">电话通话对话标注</a> </li> </ul> <p>《世界新闻》（The World）由美国公共广播国际公司（Public Radio International）与英国广播公司（British Broadcasting Corporation, BBC）联合制作，并于波士顿WGBH电台出品。</p></br> 部分内容 © 2004 宾夕法尼亚大学托管委员会，© 2003 美国广播公司，© 2003 美国全国广播公司，© 2003 美国公共广播国际公司，© 2003 美国有线电视新闻网股份有限公司，保留所有权利，© 2003 美国国家有线电视卫星公司 <br><br> 《世界新闻》（The World）由美国公共广播国际公司（Public Radio International）与英国广播公司（British Broadcasting Corporation, BBC）联合制作，并于波士顿WGBH电台出品。
