BAF: an audio fingerprinting dataset for broadcast monitoring

<strong>Overview</strong> Broadcast Audio Fingerprinting dataset is an open, available upon request, annotated dataset for the task of music monitoring in broadcast. It contains 2,000 tracks from Epidemic Sound's private catalogue as reference tracks that represent 74 hours. As queries, it contains over 57 hours of TV broadcast audio from 23 countries and 203 channels distributed with 3,425 one-min audio excerpts. It has been annotated by six annotators in total and each query has been cross-annotated by three of them obtaining high inter-annotator agreement percentages, which validates the annotation methodology and ensures the reliability of the annotations. <strong>Purpose of the dataset</strong> This dataset aims to become the standard dataset to evaluate Audio Fingerprinting algorithms since it’s built on real data, without the use of any data-augmentation techniques. It is also the first dataset to address background music fingerprinting, which is a real problem in royalties distribution. <strong>Dataset use</strong> This dataset is available for conducting non-commercial research related to audio analysis. It shall not be used for music generation or music synthesis. <strong>About the data</strong> All audio files are monophonic, 8kHz, 128kb/s, pcm_s16le encoded in .wav. Annotations mark which tracks sound (either in foreground or background) in each query (if any) and also the specific times where it starts and ends sound in the query. <em>Note that there are 88 queries that do not have any matches.</em> For more information check the dedicated Github repository: https://github.com/guillemcortes/baf-dataset and the dataset datasheet included in the files. <strong>Dataset contents</strong> The dataset is structured following this schema <pre><code>baf-dataset/ ├── baf_datasheet.pdf ├── annotations.csv ├── changelog.md ├── cross_annotations.csv ├── queries_info.csv ├── queries │ ├── query_0001.wav │ ├── query_0002.wav │ ├── … │ └── query_3425.wav ├── queries_info.csv └── references ├── ref_0001.wav ├── ref_0002.wav ├── … └── ref_2000.wav</code></pre> There are two folders named <strong>queries</strong> and <strong>references</strong> containing the <em>wav</em> files of TV broadcast recordings and the reference tracks, respectively. <strong>annotations.csv</strong> file contains the annotations made by the 6 annotators, giving the following information: annotations.csv content summary query reference query_start query_end annotator query_0692.wav ref_1235.wav 0.0 59.904 annotator_6 <strong>cross_annotations.csv </strong>contains the resulting annotations after merging the overlapping annotations in <strong>annotations.csv</strong> file. x_tag has three different values: single: the segment has only been annotated by one annotator. majority: the segment has been annotated by two annotators. unanimity: the segment has been annotated by the three annotators. cross_annotations.csv content summary query reference query_Start query_end annotators x_tag query_0693.wav ref_1834.wav 37.53 38.07 ['annotator_3'] single query_0693.wav ref_1834.wav 18.18 37.48 ['annotator_3', 'annotator_5', 'annotator_3'] unanimity query_0693.wav ref_1834.wav 37.48 37.53 ['annotator_5', 'annotator_3'] majority <strong>queries_info.csv </strong>contains information about the queries as a citation reference. It contains the country, the channel and the date where the broadcast happened. queries_info.csv content summary filename country channel datetime query_0001.wav Norway Discovery Channel 2021-02-26 14:45:26 <strong>changelog.md </strong>contains a curated, chronologically ordered list of notable changes for each version of the dataset. <strong>baf_datasheet.pdf</strong> contains standardized documentation for datasets <strong>Ownership of the data</strong> Next, we specify the ownership of all the data included in BAF: Broadcast Audio Fingerprinting dataset. For licensing information, please refer to the “License” section. <strong>Reference tracks</strong> The reference tracks are owned by Epidemic Sound AB, which has given a worldwide, revocable, non-exclusive, royalty-free licence to use and reproduce this data collection consisting of 2,000 low-quality monophonic 8kHz downsampled audio recordings. <strong>Query tracks</strong> The query tracks come from publicly available TV broadcast emissions so the ownership of each recording belongs to the channel that emitted the content. We publish them under the right of quotation provided by the Berne Convention. <strong>Annotations</strong> Guillem Cortès together with Alex Ciurana and Emilio Molina from BMAT Music Licensing S.L. have managed the annotation therefore the annotations belong to BMAT. <strong>Accessing the dataset</strong> The dataset is available upon request. Please include, in the justification field, your academic affiliation (if you have one) and a brief description of your research topics and why you would like to use this dataset. Bear in mind that this information is important for the evaluation of every access request. <strong>License</strong> This dataset is available for conducting non-commercial research related to audio analysis. <strong>It shall not be used for music generation or music synthesis</strong>. Given the different ownership of the elements of the dataset, the dataset is licensed under the <strong>following conditions</strong>: User’s access request Research only, non-commercial purposes No adaptations nor derivative works Attribution to Epidemic Sound and the authors as it is indicated in the ”citation” section. <strong>Please include, in the justification field, your academic affiliation (if you have one) and a brief description of your research topics and why you would like to use this dataset.</strong> <strong>Acknowledgments</strong> With the support of Ministerio de Ciencia Innovación y universidades through Retos-Colaboración call, reference: RTC2019-007248-7, and also with the support of the Industrial Doctorates Plan of the Secretariat of Universities and Research of the Department of Business and Knowledge of the Generalitat de Catalunya. Reference: DI46-2020.