MBZUAI/video_annotation_pipeline
收藏Hugging Face2024-06-17 更新2024-06-12 收录
下载链接：
https://hf-mirror.com/datasets/MBZUAI/video_annotation_pipeline
下载链接
链接失效反馈官方服务：
资源简介：
Video-ChatGPT项目引入了VideoInstruct100K数据集，该数据集通过半自动注释管道生成了75K个指令调优的问答对。为了解决这一注释过程的局限性，我们提出了通过改进的注释管道开发的VCG+112K数据集。我们的方法通过优化关键帧提取、利用最先进的大型多模态模型（LMMs）进行详细描述以及改进指令生成策略，提高了指令调优对的准确性和质量。
Video-ChatGPT introduces the VideoInstruct100K dataset, which employs a semi-automatic annotation pipeline to generate 75K instruction-tuning QA pairs. To address the limitations of this annotation process, we present VCG+112K dataset developed through an improved annotation pipeline. Our approach improves the accuracy and quality of instruction tuning pairs by improving keyframe extraction, leveraging SoTA large multimodal models (LMMs) for detailed descriptions, and refining the instruction generation strategy.
提供机构：
MBZUAI
原始信息汇总
数据集概述
许可证信息
- 许可证类型：MIT
