MERGE Dataset

The MERGE dataset is a collection of audio, lyrics, and bimodal datasets for conducting research on Music Emotion Recognition. A complete version is provided for each modality. The audio datasets provide 30-second excerpts for each sample, while full lyrics are provided in the relevant datasets. The amount of available samples in each dataset is the following:

MERGE Audio Complete: 3554

MERGE Audio Balanced: 3232

MERGE Lyrics Complete: 2568

MERGE Lyrics Balanced: 2400

MERGE Bimodal Complete: 2216

MERGE Bimodal Balanced: 2000

Additional Contents

Each dataset contains the following additional files:

av_values: File containing the arousal and valence values for each sample sorted by their identifier;

tvt_dataframes: Train, validate, and test splits for each dataset. Both a 70-15-15 and a 40-30-30 split are provided.

Metadata

A metadata spreadsheet is provided for each dataset with the following information for each sample, if available:

Song (Audio and Lyrics datasets) - Song identifiers. Identifiers starting with MT were extracted from the AllMusic platform, while those starting with A or L were collected from private collections;

Quadrant - Label corresponding to one of the four quadrants from Russell's Circumplex Model;

AllMusic Id -  For samples starting with A or L, the matching AllMusic identifier is also provided. This was used to complement the available information for the samples originally obtained from the platform;

Artist - First performing artist or band;

Title - Song title;

Relevance - AllMusic metric representing the relevance of the song in relation to the query used;

Duration - Song length in seconds;

Moods - User-generated mood tags extracted from the AllMusic platform and available in Warriner's affective dictionary;

MoodsAll - User-generated mood tags extracted from the AllMusic platform;

Genres - User-generated genre tags extracted from the AllMusic platform;

Themes - User-generated theme tags extracted from the AllMusic platform;

Styles - User-generated style tags extracted from the AllMusic platform;

AppearancesTrackIDs - All AllMusic identifiers related with a sample;

Sample - Availability of the sample in the AllMusic platform;

SampleURL - URL to the 30-second excerpt in AllMusic;

ActualYear - Year of song release.

Citation

If you use some part of the MERGE dataset in your research, please cite the following article:

Louro, P. L. and Redinho, H. and Santos, R. and Malheiro, R. and Panda, R. and Paiva, R. P. (2024). MERGE - A Bimodal Dataset For Static Music Emotion Recognition. arxiv. URL: https://arxiv.org/abs/2407.06060.

BibTeX:

@misc{louro2024mergebimodaldataset,      title={MERGE -- A Bimodal Dataset for Static Music Emotion Recognition},       author={Pedro Lima Louro and Hugo Redinho and Ricardo Santos and Ricardo Malheiro and Renato Panda and Rui Pedro Paiva},      year={2024},      eprint={2407.06060},      archivePrefix={arXiv},      primaryClass={cs.SD},      url={https://arxiv.org/abs/2407.06060}, }

Acknowledgements

This work is funded by FCT - Foundation for Science and Technology, I.P., within the scope of the projects: MERGE - DOI: 10.54499/PTDC/CCI-COM/3171/2021 financed with national funds (PIDDAC) via the Portuguese State Budget; and project CISUC - UID/CEC/00326/2020 with funds from the European Social Fund, through the Regional Operational Program Centro 2020.

Renato Panda was supported by Ci2 - FCT UIDP/05567/2020.