Multimodal Learning

Name: Multimodal Learning
Creator: Aoqiang Zhu
Published: 2026-04-17T17:24:52+08:00

IEEE2026-04-17 收录

多模态情感

情感计算

数据链接：

https://ieee-dataport.org/documents/multimodal-fusion 数据链接链接失效反馈

官方服务：

资源简介：

Four widely-used tri-modal datasets: MOSI , MOSEI , SIMS, and CHERMA.

提供机构：

MultiPhysio-HRC是一个包含生理、音频和面部数据的多元数据集，收集于真实世界的人机协作场景中。该数据集包括脑电图（EEG）、心电图（ECG）、电导活动（EDA）、呼吸（RESP）、肌电图（EMG）、语音录音和面部动作单元。数据集整合了受控的认知任务、沉浸式虚拟现实体验和手动以及机器人辅助的工业拆卸活动，以捕捉参与者的全面心理状态。通过验证的心理自我评估问卷获得了丰富的真实标注。基准模型

arXiv2025-10-01 更新920

A multi-level emotion-driven v oice c loning method based on adaptive grouped code modeling [Code]

语音克隆

情感计算

A multi-level emotion-driven v oice c loning method based on adaptive grouped code modeling [Code]

Figshare2025-11-08 更新80

The confusion matrix of relationships between the presented facial expressions and the participants' judgments.

人脸表情识别

情感计算

The data presented in each column is the probability of the participants' judgments. The recognition accuracy for each facial expression is marked in bold. All trials from Tests 1 and 2 are included.

Figshare2015-12-02 更新10

antgroup/HumanSense_Benchmark

多模态学习

大语言模型

情感计算

HumanSense是一个旨在评估多模态大型语言模型（MLLMs）在以人为中心的场景中感知和交互能力的全面基准，它关注对复杂人类意图的深刻理解和提供理性的、情境感知的反馈。

Hugging Face2025-12-19 更新120

Expected eyebrow movement in combinations of emotions and sentence types.

情感计算

面部动作分析

Expected eyebrow movement in combinations of emotions and sentence types.

Figshare2020-06-02 更新20