πŸ“ž +91-7667918914 | βœ‰οΈ ijarcce@gmail.com
International Journal of Advanced Research in Computer and Communication Engineering
International Journal of Advanced Research in Computer and Communication Engineering A monthly Peer-reviewed & Refereed journal
ISSN Online 2278-1021ISSN Print 2319-5940Since 2012
IJARCCE adheres to the suggestive parameters outlined by the University Grants Commission (UGC) for peer-reviewed journals, upholding high standards of research quality, ethical publishing, and academic excellence.
← Back to VOLUME 15, ISSUE 11, NOVEMBER 2026

ISL-HandNet: A Real-Time Indian Sign Language Recognition System Using MediaPipe Landmarks and a Random Forest Classifier

Jaithraa Madhav M, Deepak K, Prataparao Charith, Dr. G. Paavai Anand

πŸ‘ 4 viewsπŸ“₯ 0 downloads
Share: 𝕏 f in ✈ βœ‰
Abstract: Sign language is the primary means of communication for millions of deaf and hard-of-hearing people in India, yet very few hearing people are fluent in Indian Sign Language (ISL). Vision-based translators that classify raw RGB frames with deep convolutional networks are sensitive to background clutter, lighting changes and skin-tone variation, and usually need GPU hardware. This paper presents ISL-HandNet, a lightweight, real-time recognition pipeline for the 26-letter ISL finger-spelling alphabet that replaces pixel-level input with normalized skeletal landmarks. MediaPipe Hands extracts 21 three-dimensional hand keypoints per frame, producing a 63-dimensional feature vector. Translation invariance is obtained by expressing every landmark relative to the wrist, and scale invariance by dividing by the wrist- to-middle-finger-MCP distance. An ensemble Random Forest of 100 decision trees is trained on 17,589 valid landmark vectors extracted from 38,612 raw frames. On a held-out set of 3,226 frames the model reaches an overall accuracy of 87.10% (macro F1 of 0.86) with sub-millisecond classifier inference on a standard CPU. The system is verified with an automated test script and deployed as a live OpenCV webcam application. The results show that landmark-based feature engineering is a practical, low-cost basis for assistive ISL communication tools.

Keywords: Indian Sign Language; Hand Landmarks; MediaPipe Hands; Random Forest; Gesture Recognition; Computer Vision; Assistive Technology

How to Cite:

[1] Jaithraa Madhav M, Deepak K, Prataparao Charith, Dr. G. Paavai Anand, β€œISL-HandNet: A Real-Time Indian Sign Language Recognition System Using MediaPipe Landmarks and a Random Forest Classifier,” International Journal of Advanced Research in Computer and Communication Engineering (IJARCCE), DOI: 10.17148/IJARCCE.2026.151156

Creative Commons License This work is licensed under a Creative Commons Attribution 4.0 International License.