MuSe-Humor: Cross-Cultural Humor Detection Sub-Challenge (MuSe 2023)

<strong>Description</strong>: Predicting the presence of humor in football press conference recordings. Available modalities: audio and video, transcriptions. The dataset offers a cross-cultural setting: all press conferences in the training and development partition are held in German, all videos in the test partition are taken from English Premier League press conferences. <strong>Important</strong>: <strong>this package does not include the recordings themselves, please find them here</strong>: https://zenodo.org/record/7843460 <strong>Labels</strong>: windows of 2 seconds are given a binary label, indicating presence and absence of humor. At least 7 human annotators labelled each video. <strong>Dataset</strong>: MuSe-Humor is based on the Passau-Spontaneous Football Coach Humor (Passau-SFCH) dataset (paper). It includes press conference recordings of 10 different German Bundesliga football coaches collected in 2017. Moreover, for the MuSe 2023 challenge, recordings of 6 Premier League coaches have been added. The data provided here only includes segments in which the respective coach is speaking. The training data set contains recordings of 7 German-speaking coaches, development data consists of videos of 3 German-speaking coaches; and the test data set comprises recordings of 6 English-speaking coaches (one native speaker). <strong>General</strong>: The 4th Multimodal Sentiment Analysis Challenge and Workshop (MuSe) 2023 adresses research questions that are of interest to affective computing, machine learning and multimodal signal processing communities and encourages a fusion of their disciplines. The goal of the MuSe workshop and challenge is to gain new insights into the merits of each of the core modalities and to serve as a stimulating environment for the development and evaluation of multimodal affect recognition approaches.