Code for Caption Crowd (IKILeUS)

CaptionCrowd is an interactive platform developed within the IKILeUS project at the University of Stuttgart to improve video caption accuracy for the Deaf and Hard of Hearing (DHH) community. While automatic captions provide some accessibility, they often contain errors in grammar, homophones, and domain-specific terminology, making comprehension challenging. CaptionCrowd enables users to collaboratively identify and correct inaccurate captions in real-time, improving their quality through community-driven feedback.<br>
The platform features a user-friendly web-based video player that allows users to highlight incorrect words in subtitles, with their selections recorded for further analysis. User testing with 16 participants revealed that manually correcting captions can be cognitively demanding, highlighting the ongoing need for enhanced accessibility solutions.