← Back to VOLUME 15, ISSUE 11, NOVEMBER 2026
This work is licensed under a Creative Commons Attribution 4.0 International License.
Sign Language Translation Using Machine Learning and Artificial Intelligence
Srinidhi K S, Nayan Kumar J S, Nikhil S, Nikhil M, Mohith S Gowda
👁 12 views📥 8 downloads
Abstract: Communication between sign language speakers and non-sign language speakers relies on human interpretation and/or sensors, both restricting frequent usage. In this paper, we describe the design of a webcam-based application capable of recognizing signs in sign language through a Convolutional Neural Network (CNN) and showing them as text and also speech as a planned feature. The architecture consists of dataset formatting and labeling, pre- processing of images, training of CNNs with the help of the Adam optimizer and categorical cross-entropy loss function and recognition process with OpenCV, TensorFlow and Keras running on regular Windows laptop. Signs or gestures are to be put together into simple sentences with planned features such as suggesting the next character and conversion into speech. The project is in an intermediate phase where 5 Kaggle datasets are examined for appropriateness and around half of the training process is complete. There are no performance measurements yet: only the evaluation procedure with accuracy, precision, recall, F1 score and confusion matrices is stated and the other limitations are discussed.
Keywords: Sign Language Recognition, Computer Vision, Convolutional Neural Network, Deep Learning, Gesture Recognition, Text to Speech.
Keywords: Sign Language Recognition, Computer Vision, Convolutional Neural Network, Deep Learning, Gesture Recognition, Text to Speech.
How to Cite:
[1] Srinidhi K S, Nayan Kumar J S, Nikhil S, Nikhil M, Mohith S Gowda, “Sign Language Translation Using Machine Learning and Artificial Intelligence,” International Journal of Advanced Research in Computer and Communication Engineering (IJARCCE), DOI: 10.17148/IJARCCE.2026.151178
