LOLY 1.0: A Proposed Human-Robot-Game Platform Architecture for the Engagement of Children with Autism in the Learning Process

Existing studies indicate the use of the Socially Assistive Robotic (SAR) system has enormous potential to advance therapeutic interventions in the learning process of children with Autistic Spectrum Disorder (ASD). Interactive technology, including the use of educational video games, can motivate ASD children to engage by adopting the technology as part of their communications tools. The complexity in the integration of various components of SAR linked to educational/serious games hinder the modularity and scalability of these robotic systems. This work proposes the design of an architecture for a SAR platform through the integration and reproduction of robot prototype, “Loly 1.0”. Loly 1.0 has mechanical movements, audio, and gestures connected to educational games in real-time. This will support the learning process of ASD children. The robotic platform architecture design is comprised of three main parts: robot, educational game, and cloud services. A proof of concept of the SAR prototype was per-formed with non-ASD and ASD children. Evaluation and analysis of “synchronized operational precision between robot and video game” and “degrees of attention and usability” will be conducted. The lessons learned during the testing process will help to improve the architectural designs of hardware/software integration and connectivity. The results of reproducing a SAR prototype will be to attract the attention of an ASD child through the use a video game to engage the process of “learn by playing”. This will contribute to the design of engaging and personalized Human-Robot-Interaction (HRI) and Human-Computer-Interaction (HCI) technology beneficial for inclusive education.现有研究表明，社交辅助机器人（Socially Assistive Robotic, SAR）系统的应用，在自闭症谱系障碍（Autistic Spectrum Disorder, ASD）儿童的学习进程中，具备推动治疗干预手段发展的巨大潜力。包括教育类电子游戏在内的交互技术，可通过将该技术作为沟通工具的一部分，激励自闭症儿童主动参与互动。与教育/严肃游戏结合的社交辅助机器人各项组件的集成复杂度，制约了此类机器人系统的模块化与可扩展性。本研究提出了一种社交辅助机器人平台的架构设计方案，该方案通过集成并复刻机器人原型“Loly 1.0”实现。Loly 1.0具备机械运动、音频输出与手势交互功能，可与教育类游戏实现实时联动，以此辅助自闭症儿童的学习过程。该机器人平台架构主要由三部分构成：机器人本体、教育类游戏以及云服务。研究团队已针对非自闭症儿童与自闭症儿童开展了社交辅助机器人原型的概念验证实验。后续将开展两项评估与分析工作，分别为“机器人与电子游戏间的同步运行精度”以及“注意力程度与易用性”。测试过程中积累的经验，将有助于优化软硬件集成与连接性的架构设计。复刻社交辅助机器人原型的研究成果，可通过电子游戏吸引自闭症儿童的注意力，推动“在玩乐中学习”的进程，这将助力于设计具备互动性与个性化的人机机器人交互（Human-Robot-Interaction, HRI）及人机交互（Human-Computer-Interaction, HCI）技术，为包容性教育提供支撑。