Motion Capture Benchmark of Industrial Tasks for Ergonomic Assessment and European Historic Crafts
收藏资源简介:
<strong>General Info:</strong> This benchmark provides motion capture (MoCap) files in .bvh form. The recordings were done in the span of May 2019 to January 2020 for the needs of the <strong>CoLLaboratE</strong> and <strong>MINGEI</strong> H2020 projects<strong> </strong>funded by the European Commission. The tasks included are: TV assembling Airplane component manufacturing High ergonomic hazard motions Silk-Weaving Glassblowing Mastic Cultivation The TV assembly and airplane component manufacturing tasks were recorded in real-world conditions inside the factory during the actual production of the items. The high ergonomic hazard motions were recorded in a controlled lab environment and serve as baseline/prototype motions for ergonomic risk assessment. The silk-weaving, glassblowing, and mastic cultivation data sets were created, corresponding to movements performed by skilled craftsmen and mastic farmers. These data sets were produced in order to extract the expert's gestural knowledge and analyze their dexterity while doing their crafts. <strong>Naming Convention:</strong> All files in this benchmark follow a strict naming convention to allow for easier parsing by scripts. The names have a total of 12 or 13 characters that convey the following information: The first three or fours characters label the <strong>recording session </strong>(e.g., LAB, PLN, GBBC, MCSN, etc.) The next three characters label the <strong>subject number </strong>(e.g., S01, S02, S03, etc.) The next three characters label the <strong>posture or gesture number </strong>(e.g., P01, P02, G01, G02, etc.) The final three characters label the <strong>repetition number </strong>(e.g., R01, R02, R03, etc.) For example, LABS02P03R01 denotes a lab recording of the second subject, performing the third posture for the first time. <strong>Recording Sessions:</strong> There are six recording sessions in this benchmark, the ergonomic risk motion recorded in the lab (denoted as "<strong>LAB</strong>"), the construction of an airplane component (denoted as "<strong>PLN</strong>"), and the assembling and packaging of TVs (denoted as "<strong>TV*</strong>"), the silk weaving (denoted as "<strong>SW*</strong>"), glassblowing (denoted as "<strong>GB*</strong>"), and mastic cultivation (denoted as "<strong>MC*</strong>"). The postures are the following: <strong>LAB:</strong> <strong>Standing:</strong> <strong>P01</strong>: The subject stays in I-pose <strong>P02:</strong> The subject rotates his/her torso to the left as far the person can <strong>P03: </strong>The subject will laterally bend his/her torso to the left for 6 seconds <strong>P04</strong>: The subject bends more than 20° but less than 60° <strong>P05:</strong> The subject bends more than 20° but less than 60° while rotating and laterally bending the torso to the left <strong>P06: </strong>The subject stretches his/her arms, and bends forward more than 20° but less than 60° while rotating and laterally bending the torso to the left <strong>P07</strong>: The subject bends more than 60° <strong>P08:</strong> The subject bends more than 60° while rotating and laterally bending the torso to the left <strong>P09: </strong>The subject stretches his/her arms, and bends forward more than 60° while rotating and laterally bending the torso to the left <strong>P10:</strong> The subject upright, raises the elbows above the shoulder level with the forearms bent 90° ( <strong>P11</strong>: The subject raises the elbows above the shoulder level with the forearms bent 90° while rotating and laterally bending the torso to the left <strong>P12:</strong> The subject raises the elbows above the shoulder level with the arms stretched while rotating and laterally bending the torso to the left <strong>P13:</strong> The subject upright, raises the hands above the head <strong>P14: </strong>The subject raises the hands above the head with the arms stretched while rotating and laterally bending the torso to the left <strong>Sitting on a chair:</strong> <strong>P15: </strong>The subject sits upright <strong>P16:</strong> The subject bends forward more than 60° <strong>P17:</strong> The subject bends forward more than 60° while rotating and laterally bending the torso to the left <strong>P18:</strong> The subject stretches the arms, and bends forward more than 60° while rotating and laterally bending the torso to the left <strong>P19:</strong> The subject raises the hands above the head with arms stretched <strong>P20:</strong> The subject raises the hands above the head with the arms stretched while rotating and laterally bending the torso to the left <strong>Kneeling:</strong> <strong>P21:</strong> The subject stays upright <strong>P22:</strong> The subject rotates the torso to the left as far he/she can <strong>P23: </strong>The subject will laterally bend the torso to the left for 6 seconds <strong>P24:</strong> The subject bends more than 60° <strong>P25:</strong> The subject bends more than 60° while rotating and laterally bending the torso to the left <strong>P26:</strong> The subject stretches the arms, and bends forward more than 60° while rotating and laterally bending the torso to the left <strong>P27: </strong>The subject upright, raises the elbows to the shoulder level with the arms stretched <strong>P28:</strong> The subject raises the elbows to the shoulder level with the arms stretched while rotating and laterally bending the torso to the left The TV assembling tasks are further divided. The subtasks are: packing the TVs on a stack for shipping (denoted as "<strong>TVP</strong>" for medium-sized TVs and "<strong>TVL</strong>" for larger TVs), placing assembling and placing electronic circuit boards on the chassis (denoted as "<strong>TVB</strong>"), and screwing the boards on the TV chassis (denoted as "<strong>TV_</strong>"). Each task is comprised of a number of postures. <strong>TV Assembling:</strong> <strong>Assembling the board and placing it on the TV chassis (TVB):</strong> <strong>P01: </strong>Reaching high, above the shoulder level, to pick one component <strong>P02: </strong>Reaching low, below the knee level, to pick up the second component <strong>P03: </strong>Connecting the components and placing the board on the chassis to be screwed <strong>Screwing an electrical circuit board on the TV chassis (TV_) :</strong> <strong>P01: </strong>A screw is placed on a power tool and it is being screwed on the chassis. The process is repeated four times <strong>Preparing TVs for Shipping (TVP & TVL):</strong> <strong>P01: </strong>Placing TVs on a wooden pallet (bottom level) <strong>P02:</strong> Preparing to wrap the bottom level with a membrane <strong>P03:</strong> Wrapping the bottom level <strong>P04:</strong> Placing TVs on top of the bottom level (second level) <strong>P05:</strong> Placing TVs on top of the second level (third level) <strong>P06: </strong>Wrapping the second level with a plastic membrane <strong>P07:</strong> Wrapping the third level with a plastic membrane <strong>P08:</strong> Placing TVs on top of the third level (fourth level) <strong>P09:</strong> Wrapping the fourth level with a plastic membrane <strong>Riveting of an airplane floater (PLN):</strong> <strong>P01:</strong> Rivet with the pneumatic hammer. <strong>P02:</strong> Prepare the pneumatic hammer and grab rivets. <strong>P03:</strong> Place the bucking bar to counteract the incoming rivet. The tasks recorded for silk weaving, glassblowing, and mastic cultivation data sets were segmented by gestures (e.g., G01, G02, etc.) . The tasks recorded for these three data sets are the following: <strong>Silk weaving (SW*):</strong> The creation of the punch cards <strong>(SWPC)</strong>. Preparation of the beam <strong>(SWPB)</strong>. Wrapping of the beam <strong>(SWWB)</strong>. Jacquard weaving with small loom <strong>(SWSL)</strong>. Jacquard weaving with medium size loom <strong>(SWML)</strong>. Jacquard weaving with large loom <strong>(SWLL)</strong>. <strong>Glassblowing (GB*):</strong> Beak cutting <strong>(GBBC)</strong>. Blowing and shaping <strong>(GBBS)</strong>. Cervix refining <strong>(GBCR)</strong>. Cord laying <strong>(GBCL)</strong>. Finish details <strong>(GBFD)</strong>. Handle laying <strong>(GBHL)</strong>. Transfer to punty <strong>(GBTP)</strong>. Leg and foot laying <strong>(GBLF)</strong>. <strong>Mastic Cultivation (MC*):</strong> Scrapping with new tool <strong>(MCSN)</strong>. Scrapping with old tool <strong>(MCSO)</strong>. Sweeping <strong>(MCSW)</strong>. Dusting <strong>(MCDU)</strong>. Embroidery A <strong>(MCEA)</strong>. Embroidery B <strong>(MCEB)</strong>. Embroidery with an axe <strong>(MCEX)</strong>. Gathering <strong>(MCGA)</strong>. Harvesting <strong>(MCHA)</strong>. Wiping <strong>(MCWI)</strong>. Shifting A <strong>(MCSA)</strong>. Shifting B <strong>(MCSB)</strong>. Cleaning with the wind <strong>(MCCW).</strong> The motion capture files were processed and segmented with a 3D character animation software (MotionBuilder, Autodesk Inc., San Rafael, CA. USA) and exported to Biovision Hierarchy (BVH) files.
通用信息: 本基准数据集提供.bvh(Biovision Hierarchy)格式的动作捕捉(Motion Capture, MoCap)文件。录制工作于2019年5月至2020年1月期间开展,旨在支撑由欧盟委员会资助的**CoLLaboratE**与**MINGEI** H2020科研项目。 本次数据集涵盖的任务包括:电视组装、飞机部件制造、高人机工程学风险动作、丝绸织造、玻璃吹制、乳香种植。 其中,电视组装与飞机部件制造任务的录制场景为工厂实际生产环境,于物品量产过程中采集;高人机工程学风险动作的录制于受控实验室环境中完成,作为人机工程学风险评估的基准/原型动作集;丝绸织造、玻璃吹制及乳香种植数据集则由熟练工匠与乳香种植者的动作复刻生成,旨在提取专家的手势知识并分析其作业时的灵巧性。 命名规范: 本基准数据集内所有文件均遵循严格命名规则,便于脚本解析。文件名长度为12或13个字符,可传递以下信息: 1. 前3或4个字符为**录制会话标识**(例如LAB、PLN、GBBC、MCSN等); 2. 接下来3个字符为**受试者编号**(例如S01、S02、S03等); 3. 再接下来3个字符为**姿态或动作编号**(例如P01、P02、G01、G02等); 4. 最后3个字符为**重复次数编号**(例如R01、R02、R03等)。 示例:LABS02P03R01代表实验室录制场景中,第二位受试者第三次执行某姿态的首次重复动作。 录制会话: 本数据集共包含6类录制会话:实验室场景下的人机工程风险动作录制(标识为**LAB**)、飞机部件制造(标识为**PLN**)、电视组装与包装(标识为**TV***)、丝绸织造(标识为**SW***)、玻璃吹制(标识为**GB***)及乳香种植(标识为**MC***)。 各会话对应的姿态如下: ### LAB(实验室场景) #### 站立姿态: - P01:受试者保持I型站姿(I-pose) - P02:受试者尽可能向左转动躯干 - P03:受试者向左侧屈躯干,持续6秒 - P04:受试者躯干弯曲角度大于20°且小于60° - P05:受试者向左转动并侧屈躯干,同时躯干弯曲角度大于20°且小于60° - P06:受试者伸展双臂,向前弯腰且躯干弯曲角度大于20°且小于60°,同时向左转动并侧屈躯干 - P07:受试者躯干弯曲角度大于60° - P08:受试者向左转动并侧屈躯干,同时躯干弯曲角度大于60° - P09:受试者伸展双臂,向前弯腰且躯干弯曲角度大于60°,同时向左转动并侧屈躯干 - P10:受试者直立,肘部抬升至肩部以上,前臂弯曲90° - P11:受试者向左转动并侧屈躯干,同时肘部抬升至肩部以上,前臂弯曲90° - P12:受试者向左转动并侧屈躯干,同时伸展双臂并将肘部抬升至肩部以上 - P13:受试者直立,双手举过头顶 - P14:受试者向左转动并侧屈躯干,同时伸展双臂并将双手举过头顶 #### 坐姿(于座椅上): - P15:受试者挺直坐姿 - P16:受试者向前弯腰,躯干弯曲角度大于60° - P17:受试者向左转动并侧屈躯干,同时向前弯腰且躯干弯曲角度大于60° - P18:受试者伸展双臂,向左转动并侧屈躯干,同时向前弯腰且躯干弯曲角度大于60° - P19:受试者伸展双臂,将双手举过头顶 - P20:受试者向左转动并侧屈躯干,同时伸展双臂并将双手举过头顶 #### 跪姿: - P21:受试者保持直立姿态 - P22:受试者尽可能向左转动躯干 - P23:受试者向左侧屈躯干,持续6秒 - P24:受试者躯干弯曲角度大于60° - P25:受试者向左转动并侧屈躯干,同时躯干弯曲角度大于60° - P26:受试者伸展双臂,向左转动并侧屈躯干,同时向前弯腰且躯干弯曲角度大于60° - P27:受试者直立,伸展双臂并将肘部抬升至肩部高度 - P28:受试者向左转动并侧屈躯干,同时伸展双臂并将肘部抬升至肩部高度 ### 电视组装任务细分: 电视组装任务可进一步拆分为以下子任务: 1. 电视堆叠打包待运:中型电视标识为**TVP**,大型电视标识为**TVL** 2. 将电子电路板放置并组装至电视底盘:标识为**TVB** 3. 将电路板拧紧至电视底盘:标识为**TV_** 每个子任务均包含若干对应姿态。 #### 电路板组装与放置(TVB): - P01:抬手至肩部以上高度拾取零部件 - P02:俯身至膝部以下高度拾取第二件零部件 - P03:连接零部件并将电路板放置至待拧紧的底盘上 #### 电路板拧紧作业(TV_): - P01:将螺丝放置于电动工具上,对底盘进行拧紧操作,该流程重复4次 #### 电视打包待运(TVP与TVL): - P01:将电视放置于木质托盘底层 - P02:准备使用塑料膜包裹底层 - P03:完成底层塑料膜包裹 - P04:将电视放置于底层上方(第二层) - P05:将电视放置于第二层上方(第三层) - P06:使用塑料膜包裹第二层 - P07:使用塑料膜包裹第三层 - P08:将电视放置于第三层上方(第四层) - P09:使用塑料膜包裹第四层 #### 飞机部件铆接作业(PLN): - P01:使用气动锤进行铆接作业 - P02:准备气动锤并抓取铆钉 - P03:放置抵铁以配合铆钉铆接作业 ### 丝绸织造、玻璃吹制与乳香种植数据集: 该三类数据集的录制动作按手势进行分段(例如G01、G02等),对应任务如下: #### 丝绸织造(SW***): - 打孔卡制作(SWPC) - 织轴准备(SWPB) - 织轴缠绕(SWWB) - 小型织机提花织造(SWSL) - 中型织机提花织造(SWML) - 大型织机提花织造(SWLL) #### 玻璃吹制(GB***): - 杯口切割(GBBC) - 吹制与塑形(GBBS) - 颈部修整(GBCR) - 绳纹制作(GBCL) - 细节打磨(GBFD) - 把手安装(GBHL) - 转移至顶杆(GBTP) - 支脚与底座安装(GBLF) #### 乳香种植(MC***): - 新工具刮取(MCSN) - 旧工具刮取(MCSO) - 清扫(MCSW) - 除尘(MCDU) - 刺绣A(MCEA) - 刺绣B(MCEB) - 斧头刺绣(MCEX) - 收集(MCGA) - 收获(MCHA) - 擦拭(MCWI) - 移位A(MCSA) - 移位B(MCSB) - 风力清洁(MCCW) 所有动作捕捉文件均通过3D角色动画软件(Autodesk MotionBuilder,美国加利福尼亚州圣拉斐拉市欧特克公司出品)进行处理与分段,并导出为Biovision Hierarchy(BVH)格式文件。



