Processed-Data for ConfLab: A Rich Multimodal Multisensor Dataset of Free-Standing Social Interactions In-the-Wild

This folder contains processed data (video and wearable sensors) for 16 mins of interaction that were annotated for the Conflab dataset. ./cameras ./video_segments contains the overhead video recordings for 5 cameras in MP4 files. These are split into 2 min segments, down-scaled to 960x540px, and denoised. The resulting files are the ones that were used to annotate poses and actions. For applications that require higher resolutions, the original video files in the "data_raw" folder are at 1920x1080 resolution and a script is provided to extract the same 2min segments. ./camera-calibration contains the camera instrinsic files obtained from: https://github.com/idiap/multicamera-calibration. Camera extrinsic parameters can be calculated using the existing intrinsic parameters and the instructions in the multicamera-calibration repo. The coordinates in the image are provided by the crosses marked on the floor, which are visible in the video recordings. The crosses are 1m apart (=100cm). ./wearables contains one single dataframe with aggregated sensor information (accelerometer, gyroscope, magnetometer, rotation, proximity) per each person. The data has been interpolated and imputed at 50Hz (fixed). The code used to obtain these files from the raw data can be found at: https://github.com/TUDelft-SPC-Lab/conflab/blob/master/preprocessing/midge/preprocess.ipynb This code can be used to preprocess larger segments of the werable data from the "data_raw" folder. Audio files are not part of this folder, but are provided in the "data_raw" file.本文件夹包含针对Conflab数据集（Conflab Dataset）标注的16分钟交互场景的处理后数据，涵盖视频与可穿戴传感器（wearable sensors）数据。 在./cameras目录下的video_segments子目录中，存储了5个摄像头的俯视录制视频，格式为MP4文件。这些视频被切割为2分钟片段，分辨率下调至960×540像素，并经过降噪处理，所得文件用于人体姿态与动作标注。若应用场景需要更高分辨率，"data_raw"文件夹内的原始视频分辨率为1920×1080，同时附带脚本可提取相同的2分钟片段。 ./camera-calibration目录内含从https://github.com/idiap/multicamera-calibration 获取的相机内参文件。相机外参可通过现有内参及该多相机校准仓库中的说明进行计算。图像中的坐标由地面标记的十字靶标提供，该靶标在视频录制中可见，相邻十字间距为1米（即100厘米）。 ./wearables目录内含单个聚合传感器信息的数据框（dataframe），包含每位参与者的加速度计（accelerometer）、陀螺仪（gyroscope）、磁力计（magnetometer）、旋转传感器数据与近距传感器数据。该数据已被插值补全至固定50Hz的采样率。从原始数据生成此类文件的代码可在https://github.com/TUDelft-SPC-Lab/conflab/blob/master/preprocessing/midge/preprocess.ipynb 获取，该代码可用于预处理"data_raw"文件夹中更多片段的可穿戴传感器数据。 音频文件未包含在本文件夹中，可于"data_raw"文件夹中获取。