arkimjh/MMSI-train

--- license: cc-by-4.0 task_categories: - video-text-to-text - visual-question-answering language: - en tags: - video - social-interaction - training - multi-person - gaze - gesture-recognition size_categories: - 1K<n<10K --- # MMSI Train Dataset ## Description MMSI training dataset containing original and extended video clips with QA annotations for social reasoning tasks. ## Dataset Statistics | Type | Videos | Size | |------|--------|------| | Original Videos | 6,544 | ~1.5 GB | | Extended Videos | 5,567 | ~18 GB | | **Total** | **12,111** | **~19.5 GB** | | JSON | Description | |------|-------------| | mmsi_train_mpp_ctx5.json | MPP task, 5-context | | mmsi_train_mpp_ctx15.json | MPP task, 15-context | | mmsi_train_pcr_ctx5.json | PCR task, 5-context | | mmsi_train_pcr_ctx15.json | PCR task, 15-context | | mmsi_train_sti_ctx5.json | STI task, 5-context | | mmsi_train_sti_ctx15.json | STI task, 15-context | ## Dataset Structure ``` MMSI-train/ ├── json/ │ ├── mmsi_train_mpp_ctx5.json │ ├── mmsi_train_mpp_ctx15.json │ ├── mmsi_train_pcr_ctx5.json │ ├── mmsi_train_pcr_ctx15.json │ ├── mmsi_train_sti_ctx5.json │ └── mmsi_train_sti_ctx15.json └── tars/ ├── mmsi_train_original_videos_part001.tar ├── mmsi_train_extended_videos_part001.tar ├── mmsi_train_extended_videos_part002.tar └── ... ``` ## Usage ```python from huggingface_hub import snapshot_download # Download everything snapshot_download( repo_id="arkimjh/MMSI-train", repo_type="dataset", local_dir="./MMSI-train" ) # Extract video archives import tarfile from pathlib import Path for tar_file in Path("./MMSI-train/tars").glob("*.tar"): with tarfile.open(tar_file) as tf: tf.extractall("./MMSI-train/videos/") ``` ## Citation TBDlicense: 知识共享署名4.0许可协议（CC BY 4.0） task_categories: - 视频-文本到文本 - 视觉问答 language: - 英语 tags: - 视频 - 社会交互 - 训练 - 多人物 - 视线 - 手势识别 size_categories: - 1000 < n < 10000 # MMSI训练数据集（MMSI Train Dataset） ## 数据集描述 MMSI训练数据集包含用于社会推理任务的原始与扩展视频片段，并配套问答（Question Answering, QA）标注。 ## 数据集统计 | 类型 | 视频数量 | 容量 | |------|--------|------| | 原始视频 | 6,544 | ~1.5 GB | | 扩展视频 | 5,567 | ~18 GB | | **总计** | **12,111** | **~19.5 GB** | | JSON文件名 | 描述 | |------|-------------| | mmsi_train_mpp_ctx5.json | MPP任务，上下文长度为5 | | mmsi_train_mpp_ctx15.json | MPP任务，上下文长度为15 | | mmsi_train_pcr_ctx5.json | PCR任务，上下文长度为5 | | mmsi_train_pcr_ctx15.json | PCR任务，上下文长度为15 | | mmsi_train_sti_ctx5.json | STI任务，上下文长度为5 | | mmsi_train_sti_ctx15.json | STI任务，上下文长度为15 | ## 数据集结构 MMSI-train/ ├── json/ │ ├── mmsi_train_mpp_ctx5.json │ ├── mmsi_train_mpp_ctx15.json │ ├── mmsi_train_pcr_ctx5.json │ ├── mmsi_train_pcr_ctx15.json │ ├── mmsi_train_sti_ctx5.json │ └── mmsi_train_sti_ctx15.json └── tars/ ├── mmsi_train_original_videos_part001.tar ├── mmsi_train_extended_videos_part001.tar ├── mmsi_train_extended_videos_part002.tar └── ... ## 使用方法 python from huggingface_hub import snapshot_download # 下载全部数据集内容 snapshot_download( repo_id="arkimjh/MMSI-train", repo_type="dataset", local_dir="./MMSI-train" ) # 解压视频归档文件 import tarfile from pathlib import Path for tar_file in Path("./MMSI-train/tars").glob("*.tar"): with tarfile.open(tar_file) as tf: tf.extractall("./MMSI-train/videos/") ## 引用信息 待补充（TBD）