EmoRoad: A Multimodal Dataset of Psychological, Physiological, and Behavioral Responses in Diverse Driving Scenarios

Overview This dataset is a multimodal dataset collected under multiple driving tasks and conditions. It includes data from 50 participants and 8 driving tasks defined by a 2 × 2 × 2 factorial design: weather (2 levels), traffic volume (2 levels), and road scenario (2 levels). The recorded modalities include: facial video, in-car first-person screen recordings, car dynamics (e.g., speed, acceleration, etc.), EmoSense (steering-wheel touch sensor), EEG, eye tracking, and emotion annotations from both iMotions and participant self-reports. The dataset supports research on emotion and behavior modeling and analysis, and driving context's effects on emotion and behavior, with potential applications in driver state monitoring and adaptive vehicle system. Contents & file organization The upload contains two top-level folders: `Clip/` and `RawData/`. Clip/ `Clip/` provides task-aligned (clipped) data for all modalities. All signals/videos are clipped according to the valid driving-task start and end timestamps. The corresponding timestamps and helper code are provided in `ref_timestamp.py` in our GitHub repository (see “Repository URL” in this record). For EEG data in `Clip/`, we provide a preprocessed version with artifacts removed using ICA and amplitude-thresholding. The preprocessing scripts are also available in the GitHub repository. RawData/ `RawData/` provides representative raw recordings (including raw EEG), enabling users to apply their preferred preprocessing pipelines. Folder structure The overall folder structure is illustrated below. Data are organized by modality under `Clip/` or `RawData/`, using the prefix `Clip_` or `RawData_` followed by the modality name. Within each modality folder, data are organized as:- `P1/`–`P50/` (participants) - 8 driving tasks per participant, each containing the corresponding recordings for that task. Clip/├─ Clip_Car_Dynamics/├─ Clip_EEG_noArtifact/│ ├─ P1/│ │ ├─ 0925_p1_1.csv│ │ ├─ 0925_p1_2.csv│ │ ├─ ...│ │ └─ 0925_p1_8.csv│ ├─ P2/│ ├─ ...│ └─ P50/├─ Clip_EmoSense/├─ ...└─ Clip_ScreenRecord/ RawData/├─ RawData_Car_Dynamics/├─ RawData_EEG/├─ RawData_EmoSense/└─ RawData_iMotions/