πŸ“ž +91-7667918914 | βœ‰οΈ ijarcce@gmail.com
International Journal of Advanced Research in Computer and Communication Engineering
International Journal of Advanced Research in Computer and Communication Engineering A monthly Peer-reviewed & Refereed journal
ISSN Online 2278-1021ISSN Print 2319-5940Since 2012
IJARCCE adheres to the suggestive parameters outlined by the University Grants Commission (UGC) for peer-reviewed journals, upholding high standards of research quality, ethical publishing, and academic excellence.
← Back to VOLUME 15, ISSUE 11, NOVEMBER 2026

SignAI: Intelligent Bidirectional Indian Sign Language Translation Using Skeleton Keypoints

Anand S. Balapure, Vedant Y. Badgujar, Netra A. Jayaswal, Tejaswini B. Sharma, Sheetal P. Patil

πŸ‘ 13 viewsπŸ“₯ 6 downloads
Share: 𝕏 f in ✈ βœ‰
Abstract: Communication between Deaf and hearing individuals remains difficult because interpreters and accessible translation tools are scarce. This paper presents SignAI, a bidirectional Indian Sign Language (ISL) translation prototype that combines Sign-to-Text (S2T) and Text-to-Sign (T2S) translation in a single web application. The S2T module classifies isolated signs from MediaPipe Holistic keypoints using a Conv1D–BiGRU–attention network, supported by motion-based segmentation and confidence gating; recognised glosses are turned into English sentences with a rule-based generator or few-shot prompting of FLAN-T5-base. The T2S module maps text to validated glosses and renders the matching sign clips as a skeleton video, with optional PoseTransformer and fingerspelling support. On a custom 60-class ISL adjective dataset of 1,022 clips, the classifier reaches 74.29% top-1 and 88.57% top-5 accuracy on the test set (n = 140; 95% CI: 66.47–80.81%). At a confidence threshold of 0.65, 89.16% of accepted predictions are correct at 59.29% coverage. A data and code audit and its corrective measures are also reported.

Keywords: Sign language recognition, Indian Sign Language, MediaPipe, skeleton keypoints, bidirectional GRU, sign language production, confidence gating.

How to Cite:

[1] Anand S. Balapure, Vedant Y. Badgujar, Netra A. Jayaswal, Tejaswini B. Sharma, Sheetal P. Patil, β€œSignAI: Intelligent Bidirectional Indian Sign Language Translation Using Skeleton Keypoints,” International Journal of Advanced Research in Computer and Communication Engineering (IJARCCE), DOI: 10.17148/IJARCCE.2026.151116

Creative Commons License This work is licensed under a Creative Commons Attribution 4.0 International License.