Birdvox-70K: A Dataset For Species-Agnostic Flight Call Detection In Half-Second Clips

BirdVox-70k: a dataset for avian flight call detection in half-second clips<br> ======================================================================================<br> Version 1.0, April 2018. <br> Created By<br> ---------- Vincent Lostanlen (1, 2, 3), Justin Salamon (2, 3), Andrew Farnsworth (1), Steve Kelling (1), and Juan Pablo Bello (2, 3). (1): Cornell Lab of Ornithology (CLO)<br> (2): Center for Urban Science and Progress, New York University<br> (3): Music and Audio Research Lab, New York University https://wp.nyu.edu/birdvox Description<br> ----------- The BirdVox-70k dataset contains 70k half-second clips from 6 audio recordings in the BirdVox-full-night dataset, each about ten hours in duration. These recordings come from ROBIN autonomous recording units, placed near Ithaca, NY, USA during the fall 2015. They were captured on the night of September 23rd, 2015, by six different sensors, originally numbered 1, 2, 3, 5, 7, and 10. Andrew Farnsworth used the Raven software to pinpoint every avian flight call in time and frequency. He found 35402 flight calls in total. He estimates that about 25 different species of passerines (thrushes, warblers, and sparrows) are present in this recording. Species are not labeled in BirdVox-70k, but it is possible to tell apart thrushes from warblers and sparrrows by looking at the center frequencies of their calls. The annotation process took 102 hours. The dataset can be used, among other things, for the research,development and testing of bioacoustic classification mode ls, including the reproduction of the results reported in [1]. For details on the hardware of ROBIN recording units, we refer the reader to [2]. [1] V. Lostanlen, J. Salamon, A. Farnsworth, S. Kelling, J. Bello. BirdVox-full-night: a dataset and benchmark for avian flight call detection. Proc. IEEE ICASSP, 2018. [2] J. Salamon, J. P. Bello, A. Farnsworth, M. Robbins, S. Keen, H. Klinck, and S. Kelling. Towards the Automatic Classification of Avian Flight Calls for Bioacoustic Monitoring. PLoS One, 2016. @inproceedings{lostanlen2018icassp,<br> title = {BirdVox-full-night: a dataset and benchmark for avian flight call detection},<br> author = {Lostanlen, Vincent and Salamon, Justin and Farnsworth, Andrew and Kelling, Steve and Bello, Juan Pablo},<br> booktitle = {Proc. IEEE ICASSP},<br> year = {2018},<br> published = {IEEE},<br> venue = {Calgary, Canada},<br> month = {April},<br> } Data Files<br> ------------ BirdVox-70k contains the recordings as HDF5 files, sampled at 24 kHz, with a single channel (mono). Each HDF5 file corresponds to a different sensor. The name of the HDF5 dataset in each file is "waveforms". Metadata Files<br> -------------- Contrary to BirdVox-full-night, BirdVox-70k is not shipped with a metadata file. Rather, the metadata is included in the keys of the elements in the HDF5 files themselves, whose values are the waveforms. An example of BirdVox-70k key is: <pre>unitID_TIMESTAMP_FREQ_LABEL </pre> where ID is the identifier of the unit (01, 02, 03, 05, 07, or 10) TIMESTAMP is the timestamp of the center of the clip in the BirdVox-full-night recording. This timestamp is measured in samples at 24 kHz. It is accurate at about 10 ms. FREQ is the center frequency of the flight call, measured in Hertz. It is accurate at about 1 kHz. When the clip is negative, i.e. does not contain any flight call, it is set equal to zero by convention. LABEL is the label of the clip, positive (1) or negative (0). Example: <pre>unit01_085256784_03636_1</pre> is a positive clip in unit 01, with timestamp 085256784 (3552.37 seconds after dividing by the sample rate 24000), center frequency 3636 Hz. Another example: <pre>unit05_284775340_00000_0</pre> is a negative clip in unit 05, with timestamp 284775340 (11865.64 seconds). The approximate GPS coordinates of the sensors (latitudes and longitudes rounded to 2 decimal points) and UTC timestamps corresponding to the start of the recording for each sensor are included as CSV files in the main directory. Please acknowledge BirdVox-70k in academic research<br> ---------------------------------------------------------- When BirdVox-70k is used for academic research, we would highly appreciate it if scientific publications of works partly based on this dataset cite the following publication: V. Lostanlen, J. Salamon, A. Farnsworth, S. Kelling, J. Bello. BirdVox-full-night: a dataset and benchmark for avian flight call detection, Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2018. The creation of this dataset was supported by NSF grants 1125098 (BIRDCAST) and 1633259 (BIRDVOX), a Google Faculty Award, the Leon Levy Foundation, and two anonymous donors. Conditions of Use<br> ----------------- Dataset created by Vincent Lostanlen, Justin Salamon, Andrew Farnsworth, Steve Kelling, and Juan Pablo Bello. The BirdVox-70k dataset is offered free of charge under the terms of the Creative Commons Attribution 4.0 International (CC BY 4.0) license:<br> https://creativecommons.org/licenses/by/4.0/ The dataset and its contents are made available on an "as is" basis and without warranties of any kind, including without limitation satisfactory quality and conformity, merchantability, fitness for a particular purpose, accuracy or completeness, or absence of errors. Subject to any liability that may not be excluded or limited by law, Cornell Lab of Ornithology is not liable for, and expressly excludes all liability for, loss or damage however and whenever caused to anyone by any use of the BirdVox-70k dataset or any part of it. Feedback<br> ----------- Please help us improve BirdVox-70k by sending your feedback to:<br> [e-mail] and [e-mail] In case of a problem, please include as many details as possible. Acknowledgements<br> ---------------- Jessie Barry, Ian Davies, Tom Fredericks, Jeff Gerbracht, Sara Keen, Holger Klinck, Anne Klingensmith, Ray Mack, Peter Marchetto, Ed Moore, Matt Robbins, Ken Rosenberg, and Chris Tessaglia-Hymes. We acknowledge that the land on which the data was collected is the unceded territory of the Cayuga nation, which is part of the Haudenosaunee (Iroquois) confederacy.BirdVox-70k：适用于半秒音频片段中鸟类飞行叫声检测的数据集 ====================================================================================== 版本 1.0，2018年4月 ## 创建者 ---------- Vincent Lostanlen (1, 2, 3)、Justin Salamon (2, 3)、Andrew Farnsworth (1)、Steve Kelling (1) 与 Juan Pablo Bello (2, 3)。 (1)：康奈尔鸟类学实验室（Cornell Lab of Ornithology, CLO） (2)：纽约大学城市科学与进步中心 (3)：纽约大学音乐与音频研究实验室 官方主页：https://wp.nyu.edu/birdvox ## 数据集描述 ----------- BirdVox-70k 数据集包含源自 BirdVox-full-night 数据集的70000条半秒音频片段，该数据集的6段原始录音每段时长约10小时。所有录音均由 ROBIN 自主录音设备采集，于2015年秋季部署在美国纽约州伊萨卡附近，6组录音于2015年9月23日晚间由编号分别为1、2、3、5、7、10的6台独立传感器录制完成。 Andrew Farnsworth 使用 Raven 软件精准定位了每一处鸟类飞行叫声的时间与频率坐标，总计标注35402条飞行叫声。他估计本次录音中包含约25种雀形目鸟类（鸫类、鸣禽与麻雀类）的叫声。BirdVox-70k 未对物种进行标注，但可通过叫声的中心频率区分鸫类与鸣禽、麻雀类。本次标注工作总计耗时102小时。 本数据集可用于生物声学分类模型的研究、开发与测试等场景，包括复现文献[1]中报道的实验结果。关于 ROBIN 录音设备的硬件细节，请参阅文献[2]。 [1] V. Lostanlen, J. Salamon, A. Farnsworth, S. Kelling, J. Bello. BirdVox-full-night: a dataset and benchmark for avian flight call detection. Proc. IEEE ICASSP, 2018. [2] J. Salamon, J. P. Bello, A. Farnsworth, M. Robbins, S. Keen, H. Klinck, and S. Kelling. Towards the Automatic Classification of Avian Flight Calls for Bioacoustic Monitoring. PLoS One, 2016. bibtex @inproceedings{lostanlen2018icassp, title = {BirdVox-full-night: a dataset and benchmark for avian flight call detection}, author = {Lostanlen, Vincent and Salamon, Justin and Farnsworth, Andrew and Kelling, Steve and Bello, Juan Pablo}, booktitle = {Proc. IEEE ICASSP}, year = {2018}, published = {IEEE}, venue = {Calgary, Canada}, month = {April}, } ## 数据文件 ------------ BirdVox-70k 的录音以分层数据格式5（Hierarchical Data Format 5，HDF5）存储，采样率为24 kHz，采用单声道。每个 HDF5 文件对应一台独立传感器，文件内部的 HDF5 数据集名称为"waveforms"。 ## 元数据文件 -------------- 与 BirdVox-full-night 不同，BirdVox-70k 未附带独立的元数据文件，元数据直接存储在 HDF5 文件中元素的键（key）内，键对应的值即为音频波形。 BirdVox-70k 的键格式示例如下： <pre>unitID_TIMESTAMP_FREQ_LABEL</pre> 其中： - ID：传感器的编号（取值为01、02、03、05、07或10） - TIMESTAMP：该片段中心在 BirdVox-full-night 原始录音中的时间戳，以24 kHz采样率下的采样点数表示，精度约为10 ms - FREQ：飞行叫声的中心频率，单位为赫兹（Hz），精度约为1 kHz；若片段为阴性（无飞行叫声），则按惯例设为0 - LABEL：片段标签，阳性（包含飞行叫声）为1，阴性为0 ### 示例： <pre>unit01_085256784_03636_1</pre> 代表01号传感器的阳性片段，时间戳为085256784（除以采样率24000后对应3552.37秒），中心频率为3636 Hz。 另一示例： <pre>unit05_284775340_00000_0</pre> 代表05号传感器的阴性片段，时间戳为284775340（对应11865.64秒）。 各传感器的近似GPS坐标（经纬度保留两位小数）以及对应录音开始时刻的UTC时间戳，已以CSV格式存储在主目录下的文件中。 ## 学术引用须知 ---------------------------------------------------------- 当在学术研究中使用 BirdVox-70k 数据集时，若基于该数据集开展的研究成果发表为学术出版物，请引用以下文献： V. Lostanlen, J. Salamon, A. Farnsworth, S. Kelling, J. Bello. BirdVox-full-night: a dataset and benchmark for avian flight call detection, Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2018. 本数据集的制作得到了美国国家科学基金会（NSF）编号为1125098（BIRDCAST）与1633259（BIRDVOX）的项目资助、谷歌学院学者奖、利昂·利维基金会以及两位匿名捐赠者的支持。 ## 使用条款 ----------------- 本数据集由 Vincent Lostanlen、Justin Salamon、Andrew Farnsworth、Steve Kelling 与 Juan Pablo Bello 创建。 BirdVox-70k 数据集基于知识共享署名4.0国际许可协议（CC BY 4.0）免费发布，许可协议链接：https://creativecommons.org/licenses/by/4.0/ 本数据集及其内容按“现状”提供，不附带任何形式的保证，包括但不限于对产品质量、适用性、特定用途的适配性、准确性或完整性，以及无错误的保证。除法律规定不得排除或限制的责任外，康奈尔鸟类学实验室不承担因任何用户使用 BirdVox-70k 数据集或其部分内容而造成的任何损失或损害的全部责任，并明确排除此类责任。 ## 反馈 ----------- 请将您的反馈发送至 [e-mail] 与 [e-mail]，以帮助我们改进 BirdVox-70k。若遇到问题，请尽可能提供详细的相关信息。 ## 致谢 ---------------- Jessie Barry、Ian Davies、Tom Fredericks、Jeff Gerbracht、Sara Keen、Holger Klinck、Anne Klingensmith、Ray Mack、Peter Marchetto、Ed Moore、Matt Robbins、Ken Rosenberg 以及 Chris Tessaglia-Hymes。 我们谨此确认，数据采集所在的土地是卡尤加族（Cayuga nation）未被割让的领土，该区域属于豪德诺索尼联盟（Haudenosaunee，即易洛魁联盟）的一部分。