Cantonese Audio-Visual Emotional Speech (CAVES) dataset

This database consists of audio visual recordings of Cantonese spoken expressions of emotions produced by 10 native speakers of Cantonese.

5 speakers are female and their folders are labeled from fm1 to fm5; 5 speakers are male and their folders are labeled from m1 to m5.

Each folder consists of 21 zip files (e.g., 7 emotions x 3 presentation modes (audio only AO, visual only VO, audio visual AV).
Each zip file contains a file for each of the 50 Cantonese sentences produced in one emotion type (angry, disgust, fear, happy, neutral, sad, surprise)
and in one modality (AO, VO, AV). Note: the AV files are in MTS format(https://docs.fileformat.com/video/avchd/).

FM5 is an exception to the above; only 25 Cantonese sentences were recorded for Sad.

To get an idea of the material, we provide 6 files in AV format as a sample.
The sample consists of sentence 1 spoken in the 6 emotions by Speaker FM1.

The data from the perception study (validation experiment) are in the file CAVES_data_final.csv

本数据库收录10名粤语母语者录制的粤语情感口语表达音视频资料。
其中5名为女性，对应文件夹命名为fm1至fm5；其余5名为男性，对应文件夹命名为m1至m5。
每个文件夹内含21个压缩包，对应7种情感类型 × 3种呈现模式：仅音频（Audio Only, AO）、仅视频（Visual Only, VO）、音视频结合（Audio Visual, AV）。每个压缩包中包含针对某一种情感类型（愤怒、厌恶、恐惧、喜悦、中性、悲伤、惊讶）与某一种模态（AO、VO、AV）所录制的50句粤语语句对应的文件。注：AV格式文件采用MTS格式（https://docs.fileformat.com/video/avchd/）。
FM5为本数据集的例外情况，仅录制了用于表达悲伤情绪的25句粤语语句。
为便于使用者直观了解数据集内容，我们提供了6个AV格式文件作为示例。该示例包含说话者FM1以6种情感表达的第1句粤语语句。
感知实验（验证实验）的相关数据存储于文件CAVES_data_final.csv中。

搜集汇总

背景与挑战

背景概述

Cantonese Audio-Visual Emotional Speech (CAVES) 数据集是一个粤语情感语音多模态数据集，包含10位说话者的音频和视觉记录，覆盖7种基本情感和3种呈现模式。该数据集旨在支持情感识别、心理学和感知研究，并提供样本和验证实验数据，适用于非商业学术用途。