GALE Phase 2 Arabic Broadcast Conversation Speech Part 2

<h3>Introduction</h3><br>
<p>GALE Phase 2 Arabic Broadcast Conversation Speech Part 2 was developed by the Linguistic Data Consortium (LDC) and is comprised of approximately 128 hours of Arabic broadcast conversation speech collected in 2007 by LDC, MediaNet, Tunis, Tunisia and MTC, Rabat, Morocco during Phase 2 of the DARPA GALE (Global Autonomous Language Exploitation) Program.</p><br>
<p>Corresponding transcripts are released as GALE Phase 2 Arabic Broadcast Conversation Transcripts Part 2 (<a href="http://catalog.ldc.upenn.edu/LDC2013T17" rel="nofollow">LDC2013T17</a>).</p><br>
<p>Broadcast audio for the GALE program was collected at LDCs Philadelphia, PA USA facilities and at three remote collection sites: Hong Kong University of Science and Technology, Hong Kong, Republic of China (Chinese), Medianet (Tunis, Tunisia) (Arabic), and MTC (Rabat, Morocco) (Arabic). The combined local and outsourced broadcast collection supported GALE at a rate of approximately 300 hours per week of programming from more than 50 broadcast sources for a total of over 30,000 hours of collected broadcast audio over the life of the program.</p><br>
<p>LDC's&nbsp;<a href="https://www.ldc.upenn.edu/about/facilities/broadcast-collection">local broadcast collection system</a> is highly automated, easily extensible and robust and capable of collecting, processing and evaluating hundreds of hours of content from several dozen sources per day. The broadcast material is served to the system by a set of free-to-air (FTA) satellite receivers, commercial direct satellite systems (DSS) such as DirecTV, direct broadcast satellite (DBS) receivers, and cable television (CATV) feeds. The mapping between receivers and recorders is dynamic and modular. All signal routing is performed under computer control, using a 256x64 A/V matrix switch. Programs are recorded in a high bandwidth A/V format and are then processed to extract audio, to generate keyframes and compressed audio/video, to produce time-synchronized closed captions (in the case of North American English) and to generate automatic speech recognition (ASR) output. An overview of the system, the sources recorded and the configuration of the recording laboratory are contained in the Guidelines for Broadcast Audio Collection Version 3.0 included in this release.</p><br>
<p>LDC designed a portable platform for remote broadcast collection. This is a TiVO-style digital video recording (DVR) system that records two streams of A/V material simultaneously. It supports analog CATV (NTSC and PAL) and FTA DVB-S satellite programming and can operate outside of the United States. It has a small footprint, weighs less than 30 pounds and can be transported as carry-on luggage.</p><br>
<p>Medianet collected Arabic programming from across the Gulf region using its internal system and LDC's portable broadcast collection platform installed in 2008. The portable platform deployed at the Medianet Tunisian collection facility collected multiple streams of regional Arabic programming from various sources. MTC collected Arabic programming using its internal collection system.</p><br>
<p>LDC has also released GALE Phase 2 Arabic Broadcast Conversation Speech Part 1 (<a href="http://catalog.ldc.upenn.edu/LDC2013S02" rel="nofollow">LDC2013S02</a>) and GALE Phase 2 Arabic Broadcast Conversation Transcripts Part 1 (<a href="http://catalog.ldc.upenn.edu/LDC2013T04" rel="nofollow">LDC2013T04</a>).</p><br>
<h3>Data</h3><br>
<p>The broadcast conversation recordings in this release feature interviews, call-in programs and roundtable discussions focusing principally on current events from the following sources: Abu Dhabi TV, based in Abu Dhabi, United Arab Emirates; Al Alam News Channel, based in Iran; Al Arabiya, a news television station based in Dubai; Aljazeera, a regional broadcaster located in Doha, Qatar; Lebanese Broadcasting Corporation, a Lebanese television station; Oman TV, a national broadcaster located in the Sultanate of Oman; Saudi TV, a national television station based in Saudi Arabia; and Syria TV, the national television station in Syria. A table showing the number of programs and hours recorded from each source is contained in the readme file.</p><br>
<p>This release contains 141 audio files presented in <a href="http://flac.sourceforge.net" rel="nofollow">FLAC</a>-compressed Waveform Audio File format (.flac), 16000 Hz single-channel 16-bit PCM. Each file was audited by a native Arabic speaker following Audit Procedure Specification Version 2.0 which is included in this release. The broadcast auditing process served three principal goals: as a check on the operation of the broadcast collection system equipment by identifying failed, incomplete or faulty recordings; as an indicator of broadcast schedule changes by identifying instances when the incorrect program was recorded; and as a guide for data selection by retaining information about a program's genre, data type and topic.</p><br>
<h3>Samples</h3><br>
<p>Please view this <a href="desc/addenda/LDC2013S07.wav" rel="nofollow">audio sample</a>.</p><br>
<h3>Updates</h3><br>
<p>None at this time.</p><br>
<h3>Acknowledgement</h3><br>
<p>This work was supported in part by the Defense Advanced Research Projects Agency, GALE Program Grant No. HR0011-06-1-0003. The content of this publication does not necessarily reflect the position or the policy of the Government, and no official endorsement should be inferred.</p></br>
Portions © 2007 Abu Dhabi TV, Al Alam News Channel, Al Arabiya, Aljazeera, Oman TV, PAC Ltd, Saudi TV, Syria TV, © 2007, 2011, 2013 Trustees of the University of Pennsylvania

<h3>简介</h3><br><p>GALE第二阶段阿拉伯语广播对话语音数据集（第二部分）由语言数据联盟（Linguistic Data Consortium, LDC）开发，包含约128小时阿拉伯语广播对话语音素材，该素材由LDC、突尼斯突尼斯市的MediaNet以及摩洛哥拉巴特的MTC于2007年在美国国防高级研究计划局（Defense Advanced Research Projects Agency, DARPA）的全球自主语言利用（Global Autonomous Language Exploitation, GALE）计划第二阶段期间采集。</p><br><p>配套的转写文本以《GALE第二阶段阿拉伯语广播对话转写文本（第二部分）》形式发布，编号为<a href="http://catalog.ldc.upenn.edu/LDC2013T17" rel="nofollow">LDC2013T17</a>。</p><br><p>GALE计划的广播音频素材分别在美国宾夕法尼亚州费城的LDC总部，以及三个远程采集站点采集：中国香港科技大学（中文语种）、突尼斯突尼斯市的Medianet（阿拉伯语语种）以及摩洛哥拉巴特的MTC（阿拉伯语语种）。本地采集与外包采集相结合的广播采集体系为GALE计划提供支撑，每周可采集来自50余个广播源的约300小时节目内容，整个计划周期内累计采集广播音频时长超30000小时。</p><br><p>LDC的<a href="https://www.ldc.upenn.edu/about/facilities/broadcast-collection">本地广播采集系统</a>具备高度自动化、易扩展且稳定可靠的特性，可每日从数十个信号源采集、处理并评估数百小时的内容。该系统的信号来源包括多套免费收视（Free-to-Air, FTA）卫星接收机、DirecTV等商用直播卫星系统（Direct Satellite System, DSS）、直播卫星（Direct Broadcast Satellite, DBS）接收机以及有线电视（Cable Television, CATV）信号源。接收机与录制设备间的映射关系采用动态模块化设计。所有信号路由均通过计算机控制，依托256×64音视频矩阵切换器完成。节目先以高带宽音视频格式录制，随后经过处理提取音频、生成关键帧与压缩音视频文件、生成时间同步的隐藏式字幕（针对北美英语节目），并输出自动语音识别（Automatic Speech Recognition, ASR）结果。本发布包中包含的《广播音频采集指南3.0版》涵盖了该系统、采集信号源以及录制实验室配置的整体概述。</p><br><p>LDC还设计了一款用于远程广播采集的便携平台。该平台采用类TiVO数字视频录制（Digital Video Recording, DVR）系统架构，可同时录制两路音视频流。它支持模拟有线电视（NTSC与PAL制式）以及免费收视DVB-S卫星节目，且可在美国境外部署。该平台占地面积小、重量不足30磅，可作为随身行李进行托运。</p><br><p>Medianet依托其内部采集系统以及2008年部署的LDC便携广播采集平台，从海湾地区各地采集阿拉伯语节目。部署在Medianet突尼斯采集点的便携平台可从多个信号源采集多路区域阿拉伯语节目内容。MTC则通过其内部采集系统完成阿拉伯语节目的采集工作。</p><br><p>LDC同时还发布了GALE第二阶段阿拉伯语广播对话语音数据集（第一部分）<a href="http://catalog.ldc.upenn.edu/LDC2013S02" rel="nofollow">LDC2013S02</a>，以及配套的GALE第二阶段阿拉伯语广播对话转写文本（第一部分）<a href="http://catalog.ldc.upenn.edu/LDC2013T04" rel="nofollow">LDC2013T04</a>。</p><br><h3>数据</h3><br><p>本发布包中的广播对话录音内容涵盖访谈节目、热线互动节目以及圆桌讨论，主题以时事新闻为主，素材来自以下广播源：总部位于阿联酋阿布扎比的阿布扎比电视台（Abu Dhabi TV）、伊朗阿拉姆新闻频道（Al Alam News Channel）、迪拜阿拉伯新闻电视台（Al Arabiya）、卡塔尔多哈地区广播机构半岛电视台（Aljazeera）、黎巴嫩黎巴嫩广播公司（Lebanese Broadcasting Corporation）、阿曼苏丹国国家电视台阿曼电视台（Oman TV）、沙特阿拉伯国家电视台沙特电视台（Saudi TV）以及叙利亚国家电视台叙利亚电视台（Syria TV）。自述文件（readme）中包含了各信号源的节目录制数量与时长统计表。</p><br><p>本发布包包含141个音频文件，采用<a href="http://flac.sourceforge.net" rel="nofollow">FLAC</a>压缩波形音频文件格式（.flac），采样率为16000Hz、单声道、16位脉冲编码调制（PCM）。本发布包附带《审核流程规范2.0版》，所有音频文件均由阿拉伯语母语审核员按照该规范完成审核。广播音频审核流程主要实现三大目标：一是通过识别失效、不完整或存在缺陷的录音，对广播采集系统设备的运行状态进行校验；二是通过识别误录节目的情况，反映广播播出计划的变更；三是通过保留节目类型、数据类别与主题信息，为数据筛选提供依据。</p><br><h3>示例</h3><br><p>请查看<a href="desc/addenda/LDC2013S07.wav" rel="nofollow">此音频示例</a>。</p><br><h3>更新说明</h3><br><p>暂无更新。</p><br><h3>致谢</h3><br><p>本研究部分得到美国国防高级研究计划局GALE计划资助（资助编号：HR0011-06-1-0003）。本发布内容不一定代表美国政府的立场或政策，不应视为获得官方背书。</p><br>部分内容 © 2007 阿布扎比电视台、阿拉姆新闻频道、阿拉伯新闻电视台、半岛电视台、阿曼电视台、PAC有限公司、沙特电视台、叙利亚电视台；© 2007、2011、2013 宾夕法尼亚大学董事会

搜集汇总

背景与挑战

背景概述

该数据集是GALE项目Phase 2的一部分，包含约128小时2007年收集的阿拉伯语广播对话语音，来源于多个中东广播机构，如Abu Dhabi TV和Aljazeera，用于语音识别研究。数据以FLAC格式提供，采样率为16kHz，并配有相应的转录文本，支持标准阿拉伯语处理。