Auditory Selective Attention Switch in a Virtual Reality Classroom Environment

General The audio-visual Auditory Selective Attention VR Proof of Concept (asaVRpoc) project serves to investigate the auditory selective attention switch in a close-to-real-life classroom setting. This dataset consists of a Unity project and Matlab code used to collect data on the voluntary switching of auditory selective attention in a virtual reality classroom scenario. The dataset contains: Unity project for visual display and the experiment structure Matlab code for experiment preparation and HpFT measurement Data collected in the experiment (experiment performance, head tracking, questionnaires) Experiment preparation using Matlab The code and software used to prepare the experiment is provided in the folder "matlab_asaVRpoc". The Matlab code used to prepare the trials for each participant as well as to measure the HpTFs. For the HpTF measurements, the ITA Toolbox for Matlab was used and is provided (https://git.rwth-aachen.de/ita/toolbox commit hash: 598675ef704c178365f53d41e03ff4b11dea390f). A developmental version of Virtual acoustics (VA) 2020b (https://www.virtualacoustics.org/VA/overview/) is provided. Software requirements: Matlab 2019a or higher ITA Toolbox for Matlab installed Experiment conduction in Unity The Unity project is provided in the folder "unity_pc_asaVRpoc". Therefore, a virtual classroom with some basic furniture is provided. The used models, prefabs and plugins can be found in the Assets folder. Note that the acoustic stimuli are NOT provided with this Unity project. The stimuli are available on request from the Institute for Hearing Technology and Acoustics, RWTH Aachen University. This Unity project was intended for the use in virtual reality using an HMD and respective controllers for input. However, it can also be used on a desktop pc. The mode can be changed using the "VRMode" toggle as described below. The audio reproduction is realized using the Unity plugin for Virtual Acoustics (VA, http://www.virtualacoustics.org/). Software requirements: Unity 2019.4.21.f1. SteamVR 1.19.7 Virtual Acoustics v2021a, VAUnity: https://git.rwth-aachen.de/ita/VAUnity Data evaluation The collected data is provided in the folder "dataEvaluation_asaVRpoc". This folder contains three types of data: the raw data collected in the experiment (reaction times and error rates), the head tracking data and responses from the simulator sickness questionnaire (before and after the experiment) and the igroup presence questionnaire (after the experiment). Matlab code for the evaluation of the head tracking data and the questionnaires is provided.通用概述 本视听类听觉选择性注意力虚拟现实概念验证（Auditory Selective Attention VR Proof of Concept，缩写asaVRpoc）项目，旨在探究贴近真实课堂场景下的听觉选择性注意力主动切换机制。本数据集包含用于在虚拟现实课堂场景中采集听觉选择性注意力主动切换数据的Unity项目与Matlab代码。 本数据集包含以下内容： 1. 用于视觉呈现与实验架构的Unity项目 2. 用于实验准备与头部传递函数（Head-related Transfer Function，简称HpFT）测量的Matlab代码 3. 实验采集数据（实验表现、头部追踪数据、调查问卷结果） Matlab实验准备流程 实验准备所用的代码与软件均存放于`matlab_asaVRpoc`文件夹中。 本代码用于为每位参与者生成实验试次，并可用于测量HpFT。在HpFT测量环节中，本数据集附带了Matlab版ITA工具箱（ITA Toolbox for Matlab），该工具箱的代码仓库提交哈希值为598675ef704c178365f53d41e03ff4b11dea390f，仓库地址为https://git.rwth-aachen.de/ita/toolbox。此外，本数据集还提供了开发版虚拟声学（Virtual Acoustics，简称VA）2020b版本，其官方介绍页面为https://www.virtualacoustics.org/VA/overview/。 软件环境要求： - Matlab 2019a及更高版本 - 已安装Matlab版ITA工具箱 Unity实验实施流程 Unity项目存放于`unity_pc_asaVRpoc`文件夹中。 该项目内置了配备基础家具的虚拟教室，所用模型、预设体与插件均可在Assets文件夹中找到。 请注意，本Unity项目未附带声学刺激素材。此类素材可通过亚琛工业大学听力技术与声学研究所申请获取。 本Unity项目最初设计为配合头戴式显示器（Head-Mounted Display，简称HMD）及对应控制器开展虚拟现实实验，但同样可在台式电脑上运行。运行模式可通过`VRMode`开关进行切换，具体操作说明详见下文。音频渲染功能通过虚拟声学（VA）的Unity插件实现，插件官方网址为http://www.virtualacoustics.org/。 软件环境要求： - Unity 2019.4.21.f1 - SteamVR 1.19.7 - 虚拟声学（VA）v2021a，配套VAUnity插件的仓库地址为https://git.rwth-aachen.de/ita/VAUnity 数据评估流程 采集到的实验数据存放于`dataEvaluation_asaVRpoc`文件夹中，该文件夹包含三类数据：实验原始采集数据（反应时与错误率）、头部追踪数据，以及实验前后填写的模拟器不适调查问卷，与实验后填写的群体存在感调查问卷的作答结果。本数据集同时提供了用于分析头部追踪数据与问卷结果的Matlab代码。