6G-PATH OC1 [MMT project]: VR app for multiplayer medical training (haptic feedback and hand motion data)

Data were collected in multiple operation sessions in KAU testbed. During the testing and data collection setup a local connection in KAU was established to validate the smooth operation via 5G-6G. The connection was established via the 5G at KAU testbed. A user at KAU testbed (Karlstand, SWEDEN) connected over 5G (terminal 1) was the host and via Magos haptic exoskeletons was interacting with the Virtual environment. In parallel a client was also in KAU testbed (Karlstand, SWEDEN) connected over 5G, in view only mode. The client was able to see host’s hand interaction with the virtual environment. In early versions of the application, we used a mechanism that streamed all the objects transform (positions-rotations) of the 3D space. Even though this ensured that the application worked well, it required a lot of bandwidth and unnecessary data streaming. Through multiple iterations we managed to stop streaming all the objects and stream only the transform of the VR Hands (finger joints & transform in space) and combine it with the physics engine of Unity. The optimized version requires significantly less bandwidth since only the VR Hands are streamed, and the different interaction (game logic and steps) are calculated locally.