builddotai/Egocentric-100K-Evaluation
收藏资源简介：
--- extra_gated_fields: First Name: text Last Name: text Affiliation: text Email: text Phone Number: text Country: country license: apache-2.0 pretty_name: Egocentric-100K Evaluation Dataset dataset_info: features: - name: mp4 dtype: binary - name: json dtype: string --- <div style="margin: 20px 0;"> <table style="border-collapse: collapse; width: 100%;"> <tr> <td style="text-align: center; padding: 10px; width: 33.33%;"><img src="https://cdn-uploads.huggingface.co/production/uploads/690d75303df78b892c337cd4/fE2zlpAoi0s_BJtulmoEz.png" style="width: 100%; max-width: 100%;"/></td> <td style="text-align: center; padding: 10px; width: 33.33%;"><img src="https://cdn-uploads.huggingface.co/production/uploads/690d75303df78b892c337cd4/ba_6c35-M_qrzjXe1aYOf.png" style="width: 100%; max-width: 100%;"/></td> <td style="text-align: center; padding: 10px; width: 33.33%;"><img src="https://cdn-uploads.huggingface.co/production/uploads/690d75303df78b892c337cd4/O2JIcQw7eEcqlngCXsWWV.png" style="width: 100%; max-width: 100%;"/></td> </tr> <tr> <td style="text-align: center; padding: 5px;"><strong>Egocentric-100K</strong></td> <td style="text-align: center; padding: 5px;"><strong>Ego4D</strong></td> <td style="text-align: center; padding: 5px;"><strong>Epic-Kitchens</strong></td> </tr> </table> </div> <p style="margin: 20px 0; line-height: 1.6;"> To evaluate the three in-the-wild egocentric datasets Egocentric-100K, Ego4D, and EPIC-KITCHENS-100 on hand visibility and active manipulation density as a proxy for data efficiency, we randomly sample 10k frames from each dataset and run them through a gemini-2.5-flash. </p> ## Hand Visibility <div style="border: 1px solid #d0d7de; border-radius: 6px; padding: 15px; margin: 15px 0;"> <p style="margin: 0 0 10px 0; font-size: 14px; line-height: 1.6;"> <strong>Prompt:</strong><br/> You are labeling an egocentric first-person image. Your task is to count how many camera-wearer's hands are visually present in the image: 0, 1, or 2.<br/><br/> <strong>Rules:</strong><br/> • Only count hands that are directly visible.<br/> • Do not infer hands that are outside the frame or potentially behind objects.<br/> • Ignore hands belonging to other people.<br/> • Any amount of visibility counts (even fingertips).<br/> • Return only one of: 0, 1, 2. No extra words. </p> <p style="margin: 10px 0 5px 0; font-size: 14px;"><strong>Response Schema:</strong></p> <pre style="padding: 10px; border-radius: 4px; margin: 0; overflow-x: auto;"><code>{ "type": "OBJECT", "properties": { "hand_count": { "type": "INTEGER" } }, "required": ["hand_count"] }</code></pre> </div> <div style="width: 100%; overflow-x: auto;"> | Dataset | Frames | 0 Hands | 1+ Hands | 2 Hands | |---------|--------|---------|----------|---------| | **Egocentric-100K** | 10,000 | **3.04%** | **96.95%** | **79.05%** | | **Ego4D** | 10,000 | 32.67% | 67.33% | 36.95% | | **EPIC-KITCHENS** | 10,000 | 9.63% | 90.37% | 61.05% | </div> <div style="margin: 20px 0;"> <table style="border-collapse: collapse; width: 100%;"> <tr> <td style="text-align: center; padding: 10px; width: 33.33%;"><img src="https://cdn-uploads.huggingface.co/production/uploads/690d75303df78b892c337cd4/cKVEo491UvJ9DI19fnbWE.png" style="width: 100%; max-width: 100%;"/></td> <td style="text-align: center; padding: 10px; width: 33.33%;"><img src="https://cdn-uploads.huggingface.co/production/uploads/690d75303df78b892c337cd4/JucJX20yGU8PALGPbKzzZ.png" style="width: 100%; max-width: 100%;"/></td> <td style="text-align: center; padding: 10px; width: 33.33%;"><img src="https://cdn-uploads.huggingface.co/production/uploads/690d75303df78b892c337cd4/-oRVJBnoyKJxW9KIRY6ed.png" style="width: 100%; max-width: 100%;"/></td> </tr> <tr> <td style="text-align: center; padding: 5px;"><strong>Egocentric-100K</strong><br/>2 hands</td> <td style="text-align: center; padding: 5px;"><strong>Ego4D</strong><br/>1 hand</td> <td style="text-align: center; padding: 5px;"><strong>Epic-Kitchens</strong><br/>2 hands</td> </tr> </table> </div> ## Active Manipulation <div style="border: 1px solid #d0d7de; border-radius: 6px; padding: 15px; margin: 15px 0;"> <p style="margin: 0 0 10px 0; font-size: 14px; line-height: 1.6;"> <strong>Prompt:</strong><br/> You are labeling an egocentric first-person image. Your task is to determine whether the camera-wearer is actively manipulating an object at this exact moment.<br/><br/> <strong>Definition:</strong><br/> "Active Manpulation" means the wearer is visibly using their hands to work on, modify, assemble, process, or handle physical objects, materials, components in pursuit of a specific goal<br/><br/> <strong>Rules:</strong><br/> • Do not infer actions that are not visible in the frame.<br/> • If the action is ambiguous or not clearly happening, respond "no."<br/> • Ignore objects held by other people.<br/> • Respond only with: "yes" or "no." </p> <p style="margin: 10px 0 5px 0; font-size: 14px;"><strong>Response Schema:</strong></p> <pre style="padding: 10px; border-radius: 4px; margin: 0; overflow-x: auto;"><code>{ "type": "OBJECT", "properties": { "answer": { "type": "STRING", "enum": ["yes", "no"] } }, "required": ["answer"] }</code></pre> </div> <div style="width: 100%; overflow-x: auto;"> | Dataset | Frames | Active Labor | |---------|--------|--------------| | **Egocentric-100K** | 10,000 | **92.76%** | | **Ego4D** | 10,000 | 50.07% | | **EPIC-KITCHENS** | 10,000 | 85.04% | </div> <div style="margin: 20px 0;"> <table style="border-collapse: collapse; width: 100%;"> <tr> <td style="text-align: center; padding: 10px; width: 33.33%;"><img src="https://cdn-uploads.huggingface.co/production/uploads/690d75303df78b892c337cd4/KKj-Y8pcsALw1N9w4w8X8.png" style="width: 100%; max-width: 100%;"/></td> <td style="text-align: center; padding: 10px; width: 33.33%;"><img src="https://cdn-uploads.huggingface.co/production/uploads/690d75303df78b892c337cd4/uJYe6p8aM-rrM2nk-KoAY.png" style="width: 100%; max-width: 100%;"/></td> <td style="text-align: center; padding: 10px; width: 33.33%;"><img src="https://cdn-uploads.huggingface.co/production/uploads/690d75303df78b892c337cd4/q2G_-CGnSxHyYDrwacq_l.png" style="width: 100%; max-width: 100%;"/></td> </tr> <tr> <td style="text-align: center; padding: 5px;"><strong>Egocentric-100K</strong><br/>Active Labor: Yes</td> <td style="text-align: center; padding: 5px;"><strong>Ego4D</strong><br/>Active Labor: No</td> <td style="text-align: center; padding: 5px;"><strong>Epic-Kitchens</strong><br/>Active Labor: Yes</td> </tr> </table> </div>
extra_gated_fields: 姓名: 文本输入框 姓氏: 文本输入框 所属机构: 文本输入框 电子邮箱: 文本输入框 电话号码: 文本输入框 国家: 国家选择框 许可证: apache-2.0 数据集展示名: Egocentric-100K 评估数据集 dataset_info: 特征: - 字段名: mp4 数据类型: 二进制 - 字段名: json 数据类型: 字符串 <div style="margin: 20px 0;"> <table style="border-collapse: collapse; width: 100%;"> <tr> <td style="text-align: center; padding: 10px; width: 33.33%;"><img src="https://cdn-uploads.huggingface.co/production/uploads/690d75303df78b892c337cd4/fE2zlpAoi0s_BJtulmoEz.png" style="width: 100%; max-width: 100%;"/></td> <td style="text-align: center; padding: 10px; width: 33.33%;"><img src="https://cdn-uploads.huggingface.co/production/uploads/690d75303df78b892c337cd4/ba_6c35-M_qrzjXe1aYOf.png" style="width: 100%; max-width: 100%;"/></td> <td style="text-align: center; padding: 10px; width: 33.33%;"><img src="https://cdn-uploads.huggingface.co/production/uploads/690d75303df78b892c337cd4/O2JIcQw7eEcqlngCXsWWV.png" style="width: 100%; max-width: 100%;"/></td> </tr> <tr> <td style="text-align: center; padding: 5px;"><strong>Egocentric-100K</strong></td> <td style="text-align: center; padding: 5px;"><strong>Ego4D</strong></td> <td style="text-align: center; padding: 5px;"><strong>Epic-Kitchens</strong></td> </tr> </table> </div> <p style="margin: 20px 0; line-height: 1.6;"> 为以手部可见性与主动操作密度作为数据效率的代理评估指标，对三款野外第一人称视角数据集Egocentric-100K、Ego4D与EPIC-KITCHENS-100开展评估，我们从每个数据集中随机采样10000帧图像，并通过gemini-2.5-flash模型进行推理处理。 </p> ## 手部可见性分析 <div style="border: 1px solid #d0d7de; border-radius: 6px; padding: 15px; margin: 15px 0;"> <p style="margin: 0 0 10px 0; font-size: 14px; line-height: 1.6;"> <strong>标注提示:</strong><br/> 你正在标注第一人称视角图像，任务为统计图像中佩戴相机者的可见手部数量，可选结果为0、1或2。<br/><br/> <strong>标注规则:</strong><br/> • 仅统计直接可见的手部<br/> • 不得推断帧外或被物体遮挡的手部<br/> • 忽略其他人物的手部<br/> • 任何程度的可见性均可计入（即使仅指尖部分）<br/> • 仅返回0、1、2中的一个结果，不得添加任何额外内容。 </p> <p style="margin: 10px 0 5px 0; font-size: 14px;"><strong>响应格式:</strong></p> <pre style="padding: 10px; border-radius: 4px; margin: 0; overflow-x: auto;"><code>{ "type": "OBJECT", "properties": { "hand_count": { "type": "INTEGER" } }, "required": ["hand_count"] }</code></pre> </div> <div style="width: 100%; overflow-x: auto;"> | 数据集 | 采样帧数 | 0只手部占比 | 1只及以上手部占比 | 2只手部占比 | |---------|--------|---------|----------|---------| | **Egocentric-100K** | 10,000 | **3.04%** | **96.95%** | **79.05%** | | **Ego4D** | 10,000 | 32.67% | 67.33% | 36.95% | | **EPIC-KITCHENS** | 10,000 | 9.63% | 90.37% | 61.05% | </div> <div style="margin: 20px 0;"> <table style="border-collapse: collapse; width: 100%;"> <tr> <td style="text-align: center; padding: 10px; width: 33.33%;"><img src="https://cdn-uploads.huggingface.co/production/uploads/690d75303df78b892c337cd4/cKVEo491UvJ9DI19fnbWE.png" style="width: 100%; max-width: 100%;"/></td> <td style="text-align: center; padding: 10px; width: 33.33%;"><img src="https://cdn-uploads.huggingface.co/production/uploads/690d75303df78b892c337cd4/JucJX20yGU8PALGPbKzzZ.png" style="width: 100%; max-width: 100%;"/></td> <td style="text-align: center; padding: 10px; width: 33.33%;"><img src="https://cdn-uploads.huggingface.co/production/uploads/690d75303df78b892c337cd4/-oRVJBnoyKJxW9KIRY6ed.png" style="width: 100%; max-width: 100%;"/></td> </tr> <tr> <td style="text-align: center; padding: 5px;"><strong>Egocentric-100K</strong><br/>2只手部</td> <td style="text-align: center; padding: 5px;"><strong>Ego4D</strong><br/>1只手部</td> <td style="text-align: center; padding: 5px;"><strong>Epic-Kitchens</strong><br/>2只手部</td> </tr> </table> </div> ## 主动操作分析 <div style="border: 1px solid #d0d7de; border-radius: 6px; padding: 15px; margin: 15px 0;"> <p style="margin: 0 0 10px 0; font-size: 14px; line-height: 1.6;"> <strong>标注提示:</strong><br/> 你正在标注第一人称视角图像，任务为判断当前时刻佩戴相机者是否正在主动操作物体。<br/><br/> <strong>定义:</strong><br/> "主动操作"指佩戴者正通过双手可见地从事针对实体物体、材料、组件的加工、修改、组装、处理或操控行为，以达成特定目标<br/><br/> <strong>标注规则:</strong><br/> • 不得推断帧中未直观展示的动作<br/> • 若动作模糊或未明确发生，则回复"no"（否）<br/> • 忽略其他人物持有的物体<br/> • 仅回复"yes"（是）或"no"（否）。 </p> <p style="margin: 10px 0 5px 0; font-size: 14px;"><strong>响应格式:</strong></p> <pre style="padding: 10px; border-radius: 4px; margin: 0; overflow-x: auto;"><code>{ "type": "OBJECT", "properties": { "answer": { "type": "STRING", "enum": ["yes", "no"] } }, "required": ["answer"] }</code></pre> </div> <div style="width: 100%; overflow-x: auto;"> | 数据集 | 采样帧数 | 主动操作占比 | |---------|--------|--------------| | **Egocentric-100K** | 10,000 | **92.76%** | | **Ego4D** | 10,000 | 50.07% | | **EPIC-KITCHENS** | 10,000 | 85.04% | </div> <div style="margin: 20px 0;"> <table style="border-collapse: collapse; width: 100%;"> <tr> <td style="text-align: center; padding: 10px; width: 33.33%;"><img src="https://cdn-uploads.huggingface.co/production/uploads/690d75303df78b892c337cd4/KKj-Y8pcsALw1N9w4w8X8.png" style="width: 100%; max-width: 100%;"/></td> <td style="text-align: center; padding: 10px; width: 33.33%;"><img src="https://cdn-uploads.huggingface.co/production/uploads/690d75303df78b892c337cd4/uJYe6p8aM-rrM2nk-KoAY.png" style="width: 100%; max-width: 100%;"/></td> <td style="text-align: center; padding: 10px; width: 33.33%;"><img src="https://cdn-uploads.huggingface.co/production/uploads/690d75303df78b892c337cd4/q2G_-CGnSxHyYDrwacq_l.png" style="width: 100%; max-width: 100%;"/></td> </tr> <tr> <td style="text-align: center; padding: 5px;"><strong>Egocentric-100K</strong><br/>主动操作：是</td> <td style="text-align: center; padding: 5px;"><strong>Ego4D</strong><br/>主动操作：否</td> <td style="text-align: center; padding: 5px;"><strong>Epic-Kitchens</strong><br/>主动操作：是</td> </tr> </table> </div>
