VATEX Dataset

VATEX is multilingual, large, linguistically complex, and diverse dataset in terms of both video and natural language descriptions. It has two tasks for video-and-language research: (1) Multilingual Video Captioning, aimed at describing a video in various languages with a compact unified captioning model, and (2) Video-guided Machine Translation, to translate a source language description into the target language using the video information as additional spatiotemporal context.

VATEX 是一个多语言、大型、语言复杂且内容多样的数据集，既涉及视频又包含自然语言描述。该数据集针对视频与语言研究设定了两个任务：(1) 多语言视频字幕生成，旨在通过紧凑统一的字幕模型用多种语言描述视频，以及(2) 视频引导的机器翻译，利用视频信息作为额外的时空背景，将源语言描述翻译成目标语言。