Charades-CG

Charades-CG是流行的数据集Charades-STA的拆分，我们在视频中使用I3D功能。Charades-CG.Specifically，我们定义了两个新的测试拆分: 新颖的构图和新颖的单词。小说作品分割中的每个句子都包含一种类型的小说作品。如果在训练过程中同时观察到成分，但它们的组合方式是新颖的，我们将其定义为新颖的成分。novel-word spliits中的每个句子都包含一个新颖的单词，该单词旨在测试模型是否可以根据上下文中出现的其他已学习的组成成分来推断出看不见的单词的潜在语义。

Charades-CG is a split derived from the widely-used Charades-STA dataset, where I3D features are utilized for the videos. Specifically, we define two novel test splits: novel composition and novel word. Each sentence in the novel composition split contains one type of novel composition: if the constituent components are observed simultaneously during training but their combination is novel, we define this scenario as novel composition. Each sentence in the novel word split contains a novel word, which aims to test whether the model can infer the latent semantics of unseen words based on other learned constituents that appear in the context.

搜集汇总

背景与挑战

背景概述

Charades-CG是Charades-STA的拆分版本，专注于视频I3D功能，包含新颖构图和单词的测试拆分，用于模型推理能力测试。