遇见数据集

ankile/real01c-marker-insert-d1-ours-sobol-r0

收藏
Hugging Face2026-05-27 更新2026-05-31 收录
官方服务:

资源简介:

--- license: apache-2.0 task_categories: - robotics tags: - LeRobot configs: - config_name: default data_files: data/*/*.parquet --- This dataset was created using [LeRobot](https://github.com/huggingface/lerobot). ## Dataset Description - **Homepage:** [More Information Needed] - **Paper:** [More Information Needed] - **License:** apache-2.0 ## Dataset Structure [meta/info.json](meta/info.json): ```json { "codebase_version": "v3.0", "robot_type": "franka", "total_episodes": 50, "total_frames": 10045, "total_tasks": 1, "chunks_size": 1000, "data_files_size_in_mb": 100, "video_files_size_in_mb": 200, "fps": 15, "splits": { "train": "0:50" }, "data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet", "video_path": "videos/{video_key}/chunk-{chunk_index:03d}/file-{file_index:03d}.mp4", "features": { "observation.state": { "dtype": "float32", "shape": [ 7 ], "names": [ "cart_pos_x", "cart_pos_y", "cart_pos_z", "cart_rot_x", "cart_rot_y", "cart_rot_z", "gripper_position" ] }, "action": { "dtype": "float32", "shape": [ 7 ], "names": [ "vel_x", "vel_y", "vel_z", "vel_roll", "vel_pitch", "vel_yaw", "gripper_action" ] }, "steps_to_go": { "dtype": "int64", "shape": [ 1 ], "names": [ "steps_to_go" ] }, "source": { "dtype": "int64", "shape": [ 1 ], "names": [ "source_id" ] }, "success": { "dtype": "int64", "shape": [ 1 ], "names": [ "success_flag" ] }, "is_valid": { "dtype": "int64", "shape": [ 1 ], "names": [ "is_valid_flag" ] }, "reward": { "dtype": "float32", "shape": [ 1 ], "names": [ "reward" ] }, "done": { "dtype": "int64", "shape": [ 1 ], "names": [ "done_flag" ] }, "manifest_idx": { "dtype": "int64", "shape": [ 1 ], "names": [ "manifest_idx" ] }, "pen_x": { "dtype": "float32", "shape": [ 1 ], "names": [ "pen_x" ] }, "pen_y": { "dtype": "float32", "shape": [ 1 ], "names": [ "pen_y" ] }, "pen_yaw": { "dtype": "float32", "shape": [ 1 ], "names": [ "pen_yaw" ] }, "action.cartesian_velocity": { "dtype": "float32", "shape": [ 6 ], "names": [ "x", "y", "z", "roll", "pitch", "yaw" ] }, "action.cartesian_position": { "dtype": "float32", "shape": [ 6 ], "names": [ "x", "y", "z", "roll", "pitch", "yaw" ] }, "action.joint_velocity": { "dtype": "float32", "shape": [ 7 ], "names": [ "joint_0", "joint_1", "joint_2", "joint_3", "joint_4", "joint_5", "joint_6" ] }, "action.joint_position": { "dtype": "float32", "shape": [ 7 ], "names": [ "joint_0", "joint_1", "joint_2", "joint_3", "joint_4", "joint_5", "joint_6" ] }, "action.gripper_position": { "dtype": "float32", "shape": [ 1 ], "names": [ "gripper" ] }, "action.gripper_velocity": { "dtype": "float32", "shape": [ 1 ], "names": [ "gripper" ] }, "observation.state.cartesian_position": { "dtype": "float32", "shape": [ 6 ], "names": [ "x", "y", "z", "roll", "pitch", "yaw" ] }, "observation.state.joint_position": { "dtype": "float32", "shape": [ 7 ], "names": [ "joint_0", "joint_1", "joint_2", "joint_3", "joint_4", "joint_5", "joint_6" ] }, "observation.state.joint_velocity": { "dtype": "float32", "shape": [ 7 ], "names": [ "joint_0", "joint_1", "joint_2", "joint_3", "joint_4", "joint_5", "joint_6" ] }, "observation.state.cartesian_velocity": { "dtype": "float32", "shape": [ 6 ], "names": [ "x", "y", "z", "roll", "pitch", "yaw" ] }, "observation.state.gripper_position": { "dtype": "float32", "shape": [ 1 ], "names": [ "gripper" ] }, "observation.images.18650758_left": { "dtype": "video", "shape": [ 480, 640, 3 ], "names": [ "height", "width", "channels" ], "info": { "video.height": 480, "video.width": 640, "video.codec": "h264", "video.pix_fmt": "yuv420p", "video.is_depth_map": false, "video.fps": 15, "video.channels": 3, "has_audio": false } }, "observation.images.25916956_left": { "dtype": "video", "shape": [ 480, 640, 3 ], "names": [ "height", "width", "channels" ], "info": { "video.height": 480, "video.width": 640, "video.codec": "h264", "video.pix_fmt": "yuv420p", "video.is_depth_map": false, "video.fps": 15, "video.channels": 3, "has_audio": false } }, "timestamp": { "dtype": "float32", "shape": [ 1 ], "names": null }, "frame_index": { "dtype": "int64", "shape": [ 1 ], "names": null }, "episode_index": { "dtype": "int64", "shape": [ 1 ], "names": null }, "index": { "dtype": "int64", "shape": [ 1 ], "names": null }, "task_index": { "dtype": "int64", "shape": [ 1 ], "names": null } } } ``` ## Citation **BibTeX:** ```bibtex [More Information Needed] ```

This dataset is a robotics learning dataset created using the LeRobot tool. It contains 50 total episodes, 10045 total frames, and is designed for the Franka robot type. The data is stored in parquet format, with video files in mp4 format at 15fps. The dataset includes rich features such as observation states (e.g., Cartesian position, joint position, velocity, gripper position), actions (e.g., Cartesian velocity, joint velocity, gripper action), rewards, done flags, success flags, and more. Additionally, it provides image observations from two different perspectives (resolution 480x640, RGB channels). The dataset is intended for robotics control, reinforcement learning, or imitation learning tasks, supporting model training and evaluation.

提供机构:
ankile
搜集汇总
数据集介绍
ankile/real01c-marker-insert-d1-ours-sobol-r0 数据集图片
构建方式
在机器人学习领域,高质量的真实世界操作数据是驱动策略泛化与算法验证的关键资源。该数据集依托LeRobot框架构建,以Franka机械臂为采集平台,通过遥操作或自主执行方式完成特定操作任务,将100个回合、总计19446帧的交互过程以15帧每秒的频率记录为Parquet格式与MP4视频。数据采集过程中同步捕获关节与笛卡尔空间下的位置、速度、夹爪状态及多路视觉观测,并引入步骤剩余量、成功率、有效性标志、奖励与干预标志等结构化标注,最终以分块存储与训练集划分形式组织,形成可复现的机器人操作数据集。
使用方法
面向机器人操作策略的学习与评估,该数据集可经由HuggingFace datasets或LeRobot工具链直接加载,用户依据meta/info.json中声明的数据路径与视频路径解析Parquet与MP4文件即可获取完整轨迹。在实际使用中,研究者可将observation.state及其派生字段作为策略输入,以action或其细粒度分量作为预测目标,开展行为克隆、离线强化学习或世界模型训练;步骤剩余量、奖励与完成标志可用于辅助任务或价值估计;干预标志则支持人机协同与干预感知策略的专门分析。训练集按0至100回合整体划分,便于直接进行模型拟合与泛化验证。
背景与挑战
背景概述
机器人学习领域长期面临真实世界操作数据稀缺的瓶颈,高质量、多模态的演示数据是训练通用操作策略的关键基础。该数据集由LeRobot框架构建,聚焦Franka机械臂的精细操作任务,包含100个演示回合、19446帧多模态数据,涵盖笛卡尔与关节空间的位置、速度以及双视角视觉观测。其核心研究问题在于如何利用真实机器人演示数据提升策略学习的泛化性与鲁棒性,通过引入干预标志、成功标志、有效标志及奖励信号,为模仿学习与离线强化学习提供了丰富的监督信息,对推动真实场景下的机器人技能学习具有重要支撑意义。
当前挑战
该数据集所面向的机器人精细操作领域,其核心挑战在于高维连续动作空间与视觉感知的耦合导致策略学习样本效率低下,且真实环境中的接触动力学、物体位姿变化与感知噪声使得演示数据分布偏移问题尤为突出,策略在长时程任务中易累积误差。构建过程中,多模态同步采集需保证视觉流与状态流的时间对齐精度,干预信号的标注需在人类介入时刻准确记录,同时回合级成功判定与有效性筛选依赖严格的任务定义,数据规模与任务单一性之间的平衡亦对后续泛化能力构成潜在制约。
常用场景
经典使用场景
在机器人学习领域,基于示教数据的策略学习一直是实现灵巧操作的核心范式。real01c-marker-insert-d1-ours-sobol-r0数据集最经典的使用场景便是面向Franka机械臂的插孔装配任务,通过100条包含视觉观测、本体状态与动作指令的完整示教轨迹,为模仿学习与离线强化学习算法提供标准化训练素材。研究者可借助该数据集训练视觉-运动策略,使机械臂在给定初始位姿下自主完成笔状标记物的精准插入,并利用成功标志与奖励信号评估策略的收敛性与鲁棒性。
解决学术问题
该数据集直击机器人操作研究中示教数据稀缺与任务成功判定模糊两大痛点。其细粒度动作空间涵盖笛卡尔与关节空间的位置、速度及夹爪指令,配合逐步奖励、完成标志、有效标志和干预标志,为离线策略评估、模仿学习中的因果混淆问题以及人机干预下的策略修正等学术议题提供了可复现的实验基准。数据集的出现使得研究者能够在统一条件下比较不同算法在接触密集型装配任务中的表现,从而推动样本高效学习与泛化能力研究的深入发展。
实际应用
在工业自动化与智能装配场景中,该数据集所承载的插孔技能可直接迁移至电子元器件组装、精密轴孔配合等实际产线任务。借助数据集中多视角视觉流与高频状态记录,工程人员能够训练具备视觉伺服能力的机械臂控制策略,减少对精确标定与专用夹具的依赖。同时,干预标志与成功标志可用于构建人机协作框架,在策略失效时由人工接管并持续积累修正数据,为边缘部署与在线自适应提供可行路径。
数据集最近研究
最新研究方向
在机器人学习领域,针对精密装配任务的策略泛化与鲁棒性提升已成为前沿焦点。该数据集依托Franka机械臂平台,以插销插入任务为核心,融合了多视角视觉观测与笛卡尔空间、关节空间的高频状态-动作对,并引入了干预标志与步骤剩余量等辅助信号,为研究模仿学习中的分布外泛化、人类干预下的策略修正以及基于Sobol序列的探索策略提供了细粒度基准。当前相关热点集中于利用此类真实世界数据评估扩散策略与动作分块Transformer在接触密集型任务中的表现,其意义在于推动从仿真到现实的迁移,并为工业装配自动化提供可复现的数据驱动范式。
以上内容由遇见数据集搜集并总结生成
二维码
社区交流群
二维码
科研交流群
商业服务