The questionnaire survey content and the answers.

In this paper, we present an interactive advertising system based on augmented reality(AR) called ARIAS, which is manipulated with gestures for displaying advertising videos. Two-dimensional markers are defined in the system. The system captures the frame data through the camera in real time, uses OpenCV library to identify the predefined markers, and calculates the pose of markers captured by the camera. With OpenGL library, a virtual cubic model is created at the position of the marker, and thus videos or images are displayed on the six faces of the cube. The virtual cube, together with the original frame data collected by the camera, is displayed in the interactive window to achieve the augmented reality effect. Customers are accessible to various advertising content by observing the marker from different positions. The system, meanwhile, supports gesture operation in order to make the customers pay attention to the content they are interested in with one hand. The MediaPipe Hand framework is used to extract the landmarks of hands, based on which, a series of gestures are designed for interactive operation. The efficiency and accuracy of the system are tested and analyzed with the result, indicating that the system has high reliability and good interactiveness. This system is open at https://github.com/wanzhuxie/ARIAS/tree/PLOS-ONE.

本研究提出一款基于增强现实（Augmented Reality）的交互式广告系统ARIAS，该系统支持通过手势操控以展示广告视频。本系统定义了二维标记物。系统通过摄像头实时采集帧数据，借助OpenCV库识别预定义的标记物，并计算摄像头采集到的标记物的位姿。借助OpenGL库，在标记物的对应位置生成虚拟立方体模型，并在立方体的六个面上展示视频或图像。将虚拟立方体与摄像头采集的原始帧数据一同渲染至交互窗口中，从而实现增强现实效果。用户通过从不同角度观察标记物，即可获取多样的广告内容。同时，本系统支持手势操作，用户可通过单手势快速聚焦于自身感兴趣的广告内容。本系统采用MediaPipe手部框架提取手部关键点，并基于此设计了一系列用于交互操作的手势。本研究对系统的效率与精度进行了测试与分析，结果表明该系统具备较高的可靠性与优异的交互性能。本系统的开源地址为：https://github.com/wanzhuxie/ARIAS/tree/PLOS-ONE。