Collaborative Mixed Reality Simulation for Experiential Learning in STEM Education

<p>In the age of globalization and advanced technology, it is crucial to train future engineers, equip them with the necessary skills, and cultivate a mindset suited for an increasingly technological and globalized workplace is becoming a worldwide challenge for organizations. To ingratiate the need for such a working environment in the context of an increasingly becoming hybrid workplace, STEM education needs to not only help engineers develop knowledge and skills to overcome the distance and cultural restraints for global team collaboration but also engage them to the international collaboration experiences in a hands-on experiential learning environment.</p>

<p>This mixed reality (MR) simulation is designed to develop engineering technical skills as well as practice team collaboration skills. The simulation is composed of an introduction, a training, and a simulation section. The introduction section serves as an orientation for the team to get familiar with the MR environment by practicing necessary MR hand gestures and interaction functions. Upon successful completion of this part, participants move to work together to assemble a technical machine model. Instructions to assemble the model are provided in the training section including video, animated 3D models, and text explanations of the machine parts. When the model assembly is completed, collaborative work is required to run the machine built as part of the simulation. The validation section enables team members to engage in hands-on collaborative assembly activities without system instructions.</p>

<p><strong>Required Equipment and Programs to Run MR Training Simulation:</strong></p>

<p>· Microsoft Hololens 2</p>

<p>· Install Unity</p>

<p>o Unity OpenXR Plugin</p>

<p>· Install Microsoft Visual Studio</p>

<p>o .NET desktop development</p>

<p>o Desktop development with C++</p>

<p>o Universal Windows Platform (UWP) development</p>

<p>o Game development with Unity (if planning to use Unity)</p>

<p><strong>How to Download and Run MR Training Simulation:</strong></p>

<p>· Use the “Download Bundle” button to download a .zip folder of the project; this will require at least 3.5 GB of free space</p>

<p>· Once the file is downloaded, extract all contents to a desired location on your machine.</p>

<p>· Open all scenes in the scene folder and find ‘Table Anchor’ in the hierarchy.</p>

<p>· Follow the below the link to create a Spatial Anchors Resource: https://learn.microsoft.com/en-us/azure/spatial-anchors/quickstarts/get-started-unity-hololens?tabs=azure-portal#create-a-spatial-anchors-resource</p>

<p>· Find the Spatial Anchor Manager (Script) Component and follow the below components:</p>

<p>o In the Spatial Anchors Account ID field, paste the Account ID value from your Azure Spatial Anchors account.</p>

<p>o In the Spatial Anchors Account Key field, paste the primary or secondary Access Key value from your Azure Spatial Anchors account.</p>

<p>o In the Spatial Anchors Account Domain field, paste the Account Domain value from your Azure Spatial Anchors account.</p>

<p>· Follow the instruction of the below link to setup the Photon Unity Networking: https://learn.microsoft.com/en-us/windows/mixed-reality/develop/unity/tutorials/mr-learning-sharing-02</p>

<p>· Follow the instruction of the below link to build and deploy the application: https://learn.microsoft.com/en-us/training/modules/learn-mrtk-tutorials/1-7-exercise-hand-interaction-with-objectmanipulator</p>