Zelda Smart Home Prototype

This is the avatar and animation set created for the Auslan Communication Technologies Pipeline project. It is the core of the demo presented in Zelenskaya et al., 2023, however the virtual smart home included in the demo was removed in this prototype, as it was created using third party assets. This prototype contains: 1) An Unreal Engine project with the Zelda avatar as it was used in the demo; 2) Models and scripts for recognising emblematic gestures inspired by Auslan signs, disambiguating from context, assembling a command, executing the command, and generating an appropriate response from the avatar; 3) Instructions on setting up SplitCam to use a single webcam as input in two locations; 4) Instructions on connecting MediaPipe to Unreal Engine to run the prototype; 5) The required version of Python (3.9); 6) The Unreal Engine project we used to record Auslan signs through motion capture; and 7) Several backup versions of the avatar, and tracking, and HTTP communication, from previous iterations of the prototype.