遇见数据集

gsethia08/part1-fidget_magnetic_spinner_rings

收藏
Hugging Face2026-05-20 更新2026-05-31 收录
官方服务:

资源简介:

--- license: apache-2.0 task_categories: - robotics tags: - LeRobot configs: - config_name: default data_files: data/*/*.parquet --- This dataset was created using [LeRobot](https://github.com/huggingface/lerobot). <a class="flex" href="https://huggingface.co/spaces/lerobot/visualize_dataset?path=gsethia08/part1-fidget_magnetic_spinner_rings"> <img class="block dark:hidden" src="https://huggingface.co/datasets/huggingface/badges/resolve/main/visualize-this-dataset-xl.svg"/> <img class="hidden dark:block" src="https://huggingface.co/datasets/huggingface/badges/resolve/main/visualize-this-dataset-xl-dark.svg"/> </a> ## Dataset Description - **Homepage:** [More Information Needed] - **Paper:** [More Information Needed] - **License:** apache-2.0 ## Dataset Structure [meta/info.json](meta/info.json): ```json { "codebase_version": "v3.0", "robot_type": "hand", "total_episodes": 1075, "total_frames": 847368, "total_tasks": 26, "chunks_size": 1000, "data_files_size_in_mb": 100, "video_files_size_in_mb": 200, "fps": 30, "splits": { "train": "0:1075" }, "data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet", "video_path": "videos/{video_key}/chunk-{chunk_index:03d}/file-{file_index:03d}.mp4", "features": { "observation.camera.ego": { "dtype": "video", "shape": [ 1080, 1920, 3 ], "names": [ "height", "width", "rgb" ], "info": { "video.height": 1080, "video.width": 1920, "video.codec": "av1", "video.pix_fmt": "yuv420p", "video.is_depth_map": false, "video.fps": 30, "video.channels": 3, "has_audio": false } }, "observation.state": { "dtype": "float32", "shape": [ 48 ], "names": { "axes": [ "left_wrist_x", "left_wrist_y", "left_wrist_z", "left_rot_0", "left_rot_1", "left_rot_2", "left_rot_3", "left_rot_4", "left_rot_5", "left_thumb_x", "left_thumb_y", "left_thumb_z", "left_index_x", "left_index_y", "left_index_z", "left_middle_x", "left_middle_y", "left_middle_z", "left_ring_x", "left_ring_y", "left_ring_z", "left_little_x", "left_little_y", "left_little_z", "right_wrist_x", "right_wrist_y", "right_wrist_z", "right_rot_0", "right_rot_1", "right_rot_2", "right_rot_3", "right_rot_4", "right_rot_5", "right_thumb_x", "right_thumb_y", "right_thumb_z", "right_index_x", "right_index_y", "right_index_z", "right_middle_x", "right_middle_y", "right_middle_z", "right_ring_x", "right_ring_y", "right_ring_z", "right_little_x", "right_little_y", "right_little_z" ] } }, "camera.extrinsics": { "dtype": "float32", "shape": [ 16 ], "names": { "axes": [ "extrinsic_0", "extrinsic_1", "extrinsic_2", "extrinsic_3", "extrinsic_4", "extrinsic_5", "extrinsic_6", "extrinsic_7", "extrinsic_8", "extrinsic_9", "extrinsic_10", "extrinsic_11", "extrinsic_12", "extrinsic_13", "extrinsic_14", "extrinsic_15" ] } }, "camera.intrinsics": { "dtype": "float32", "shape": [ 9 ], "names": { "axes": [ "intrinsic_0", "intrinsic_1", "intrinsic_2", "intrinsic_3", "intrinsic_4", "intrinsic_5", "intrinsic_6", "intrinsic_7", "intrinsic_8" ] } }, "action": { "dtype": "float32", "shape": [ 48 ], "names": { "axes": [ "action_0", "action_1", "action_2", "action_3", "action_4", "action_5", "action_6", "action_7", "action_8", "action_9", "action_10", "action_11", "action_12", "action_13", "action_14", "action_15", "action_16", "action_17", "action_18", "action_19", "action_20", "action_21", "action_22", "action_23", "action_24", "action_25", "action_26", "action_27", "action_28", "action_29", "action_30", "action_31", "action_32", "action_33", "action_34", "action_35", "action_36", "action_37", "action_38", "action_39", "action_40", "action_41", "action_42", "action_43", "action_44", "action_45", "action_46", "action_47" ] } }, "language_instruction": { "dtype": "string", "shape": [ 1 ], "names": null }, "timestamp": { "dtype": "float32", "shape": [ 1 ], "names": null }, "frame_index": { "dtype": "int64", "shape": [ 1 ], "names": null }, "episode_index": { "dtype": "int64", "shape": [ 1 ], "names": null }, "index": { "dtype": "int64", "shape": [ 1 ], "names": null }, "task_index": { "dtype": "int64", "shape": [ 1 ], "names": null } } } ``` ## Citation **BibTeX:** ```bibtex [More Information Needed] ```

This dataset is a hand robot dataset for robotics learning, created using the LeRobot tool. It contains 1075 episodes and 847368 frames, covering 26 different tasks. The data is stored in parquet format, with videos in mp4 format at 30fps. The dataset features include observations (such as RGB camera images at 1080x1920 resolution, 48-dimensional hand state vectors), camera intrinsics and extrinsics, 48-dimensional action vectors, language instructions, timestamps, frame indices, episode indices, and task indices. All data is used for training, with no validation or test splits.

提供机构:
gsethia08
搜集汇总
数据集介绍
gsethia08/part1-fidget_magnetic_spinner_rings 数据集图片
构建方式
面向机器人学习中的灵巧操作与多模态策略研究,具身数据集的构建往往依赖统一采集规范与工具链。该数据集由LeRobot生成,说明其遵循LeRobot生态的标准流程,将1075个回合、847368帧、26项任务以30fps组织为训练集;观测涵盖自我中心相机视频、双手状态、动作、相机内外参及语言指令,并以meta/info.json记录结构,采用Parquet保存表格数据、AV1编码MP4保存视频,按分块路径归档。
特点
在具身智能数据资源中,该数据集展现出多模态、高帧率与任务语义并存的特征。其总规模为1075个回合、847368帧和26项任务,视频以1080×1920、30fps的自我中心视角记录,无音频;状态与动作均为48维浮点向量,对应双手腕位姿、旋转及五指位置等控制量,并辅以相机内参、外参、语言指令、时间戳、帧索引、回合索引与任务索引。Apache-2.0许可与LeRobot标签便于开放研究与复现。
使用方法
在机器人策略学习与模仿学习实践中,该数据集可用于训练视觉-语言-动作模型或状态-动作序列模型。研究者可借助HuggingFace datasets或LeRobot框架加载data目录下的Parquet文件,配合videos目录中AV1视频解码,并读取meta/info.json获得帧率、切分与特征定义;训练时将observation.camera.ego、observation.state及language_instruction作为条件输入,以action为监督信号,同时利用timestamp、frame_index和episode_index实现时序对齐与回合切分。README提供的LeRobot可视化空间亦可用于抽样检查与质量核验。
背景与挑战
背景概述
在具身智能与机器人模仿学习迅速演进的脉络中,高质量真实世界操作数据构成策略泛化的基石。该数据集依托Hugging Face LeRobot框架构建,由社区发布者gsethia08贡献,README未载明具体创建时间与学术机构,然其以Apache-2.0许可开放,聚焦双手对磁力旋转环类指尖玩具的精细操作。数据含1075个回合、847368帧、26项任务,融合第一视角视频、48维状态与动作、相机内外参及语言指令,核心问题在于以语言条件化示教驱动灵巧手操作建模,并为视觉-语言-动作模型提供可复现的机器人学习资源。
当前挑战
面向机器人灵巧操作,该数据集所应对的领域难题在于高维双手协调、接触丰富且动力学复杂的指尖玩具操控,以及多任务语言条件策略的泛化,其难度远超常规刚性物体抓取。构建过程中,高清第一视角视频与48维状态-动作序列需在30fps下严格同步,1075个回合、847368帧的数据规模对存储、解码与质量校验提出严苛要求。相机内外参标定、26项任务的语言指令映射、双手关节与指尖轨迹一致性、长时程示教中的噪声与缺失值控制,均构成数据可信度与下游模仿学习有效性的关键挑战。
常用场景
经典使用场景
在具身智能与灵巧手操作研究交织的背景下,part1-fidget_magnetic_spinner_rings以LeRobot标准格式汇聚了1075个回合、847368帧、26项任务的手部示范,涵盖第一视角视频、48维双手关节状态、动作指令与语言指令。其经典使用场景在于模仿学习与行为克隆:研究者以第一视角视觉和本体感觉为输入,预测连续48维手部动作,使机械手或灵巧手复现拨动、旋转、抓取磁性旋转环等精细操作;亦可用于离线策略评估、时序动作分割和多模态表征学习。
衍生相关工作
从LeRobot生态与具身操作研究脉络观察,围绕该数据集形成的典型工作多沿模仿学习与多模态策略展开,包括ACT、Diffusion Policy、视觉语言动作模型及灵巧手行为克隆基线等。这些工作借其高维手部轨迹和语言条件开展策略预训练、跨任务微调与基准评测,并延伸至fidget玩具操作、接触丰富灵巧操作和第一视角模仿学习等方向。数据集由此成为连接数据采集、策略学习与真实机器人验证的纽带,促进标准化灵巧手操作基准的积累与迭代。
数据集最近研究
最新研究方向
在具身智能迈向通用操作系统的进程中,part1-fidget_magnetic_spinner_rings 聚焦双手灵巧操控磁力旋转环的精细演示,构成视觉—语言—动作三元耦合的机器人学习资源。其1075条轨迹、847368帧与26类任务,配合第一视角高清视频、左右手48维关节状态与动作、相机内外参及语言指令,为模仿学习、VLA预训练和长时程策略泛化提供密集监督。近期研究沿LeRobot开源生态,探索跨任务语言条件策略、双手协调与细粒度手指控制,呼应通用机器人基础模型热点。该数据集有助于缓解灵巧操作数据稀缺,推动可迁移、可扩展的具身智能系统评估与复现。
以上内容由遇见数据集搜集并总结生成
二维码
社区交流群
二维码
科研交流群
商业服务