so101-self-replica-test
收藏资源简介:
该数据集是一个使用LeRobot框架创建的机器人学数据集,包含10个episodes,总计8969帧数据,针对so101_follower机器人类型。它提供了丰富的多模态信息:观察状态(包括6个关节角度:shoulder_pan、shoulder_lift、elbow_flex、wrist_flex、wrist_roll、gripper)、动作(对应6个关节控制),以及来自三个摄像头的视频观察:手腕摄像头(分辨率480x640,3通道)、顶部摄像头(分辨率480x848,3通道)和俯视摄像头(分辨率480x848,3通道)。所有视频以30fps录制,使用AV1编解码器。此外,数据集包含时间戳、帧索引、episode索引、任务索引等元数据。数据以parquet文件(总大小约100MB)和视频文件(总大小约200MB)格式存储,适用于机器人控制、模仿学习等任务。
This dataset is a robotics dataset created using the LeRobot framework. It contains 10 episodes, totaling 8969 frames of data, involving the so101_follower robot type. It provides rich multimodal information, including observation states (6 joint angles: shoulder_pan, shoulder_lift, elbow_flex, wrist_flex, wrist_roll, gripper), actions (corresponding to 6 joint controls), and video observations from three cameras: a wrist camera (resolution 480x640, 3 channels), a top camera (resolution 480x848, 3 channels), and an overhead camera (resolution 480x848, 3 channels). All videos are recorded at 30fps using the AV1 codec. Additionally, the dataset includes metadata such as timestamps, frame indices, episode indices, and task indices. The data is stored in parquet files (total size approximately 100MB) and video files (total size approximately 200MB), making it suitable for tasks like robot control and imitation learning.
数据集概述:so101-self-replica-test
- 许可证:Apache-2.0
- 任务类别:机器人学(robotics)
- 标签:LeRobot
数据集结构
该数据集使用 LeRobot 创建,包含以下关键特性:
- 代码库版本:v3.0
- 帧率(FPS):30
- 总片段数:10
- 总帧数:8969
- 总任务数:1
- 数据文件大小:约100 MB
- 视频文件大小:约200 MB
- 机器人类型:so101_follower
- 数据划分:训练集(train)包含所有10个片段,索引为0:10。
特征说明
数据集包含以下特征,其数据类型和形状如下:
| 特征名称 | 数据类型 | 形状 | 描述 |
|---|---|---|---|
| observation.state | float32 | (6,) | 机器人状态,包含6个关节:shoulder_pan, shoulder_lift, elbow_flex, wrist_flex, wrist_roll, gripper |
| action | float32 | (6,) | 动作指令,与状态对应的6个关节控制量 |
| observation.images.wrist | video | (480, 640, 3) | 腕部摄像头视频流,分辨率480×640,帧率30 FPS,编码格式AV1 |
| observation.images.top | video | (480, 848, 3) | 顶部摄像头视频流,分辨率480×848,帧率30 FPS,编码格式AV1 |
| observation.images.overhead | video | (480, 848, 3) | 俯视摄像头视频流,分辨率480×848,帧率30 FPS,编码格式AV1 |
| timestamp | float32 | (1,) | 时间戳 |
| frame_index | int64 | (1,) | 帧索引 |
| episode_index | int64 | (1,) | 片段索引 |
| index | int64 | (1,) | 全局索引 |
| task_index | int64 | (1,) | 任务索引 |
数据文件与视频路径
- 数据文件路径模式:
data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet - 视频文件路径模式:
videos/{video_key}/chunk-{chunk_index:03d}/file-{file_index:03d}.mp4 - 数据集配置文件:default,对应的数据文件为
data/*/*.parquet
可视化
可通过 LeRobot 数据集可视化空间预览本数据集:可视化链接



