← Back to VOLUME 15, ISSUE 11, NOVEMBER 2026
This work is licensed under a Creative Commons Attribution 4.0 International License.
ISL-HandNet: A Real-Time Indian Sign Language Recognition System Using MediaPipe Landmarks and a Random Forest Classifier
Jaithraa Madhav M, Deepak K, Prataparao Charith, Dr. G. Paavai Anand
π 4 viewsπ₯ 0 downloads
Abstract: Sign language is the primary means of communication for millions of deaf and hard-of-hearing people in India, yet very few hearing people are fluent in Indian Sign Language (ISL). Vision-based translators that classify raw RGB frames with deep convolutional networks are sensitive to background clutter, lighting changes and skin-tone variation, and usually need GPU hardware. This paper presents ISL-HandNet, a lightweight, real-time recognition pipeline for the 26-letter ISL finger-spelling alphabet that replaces pixel-level input with normalized skeletal landmarks. MediaPipe Hands extracts 21 three-dimensional hand keypoints per frame, producing a 63-dimensional feature vector. Translation invariance is obtained by expressing every landmark relative to the wrist, and scale invariance by dividing by the wrist- to-middle-finger-MCP distance. An ensemble Random Forest of 100 decision trees is trained on 17,589 valid landmark vectors extracted from 38,612 raw frames. On a held-out set of 3,226 frames the model reaches an overall accuracy of 87.10% (macro F1 of 0.86) with sub-millisecond classifier inference on a standard CPU. The system is verified with an automated test script and deployed as a live OpenCV webcam application. The results show that landmark-based feature engineering is a practical, low-cost basis for assistive ISL communication tools.
Keywords: Indian Sign Language; Hand Landmarks; MediaPipe Hands; Random Forest; Gesture Recognition; Computer Vision; Assistive Technology
Keywords: Indian Sign Language; Hand Landmarks; MediaPipe Hands; Random Forest; Gesture Recognition; Computer Vision; Assistive Technology
How to Cite:
[1] Jaithraa Madhav M, Deepak K, Prataparao Charith, Dr. G. Paavai Anand, βISL-HandNet: A Real-Time Indian Sign Language Recognition System Using MediaPipe Landmarks and a Random Forest Classifier,β International Journal of Advanced Research in Computer and Communication Engineering (IJARCCE), DOI: 10.17148/IJARCCE.2026.151156
