Development of an Indonesian Sign Language (BISINDO) Recognition System Using Deep Learning for Improved Communication Accessibility

Sign language recognition is a crucial step in enhancing the engagement of the deaf community. The system proposed in this paper focuses on developing a real-time recognition system for a single BISINDO hand gesture and converting it into the corresponding letter using a Convolutional Neural Network (CNN) model. The model is built with three convolutional layers, followed by a pooling layer and two fully connected layers for classification. The hand pose dataset is sourced from the Kaggle platform, incorporating various gesture variations for all letters to improve the model's accuracy and generalization capability. The tangible result is a prototype, which, although limited to converting a single hand gesture into a single letter, demonstrates that the CNN model approach can achieve an accuracy rate of 86.06% on test data. This project is expected to contribute to facilitating communication between the hearing and deaf communities while opening opportunities for further development, such as translating into complete sentences and real-time speech conversion.