Abstract: The mouse is one of the useful hardware inventions of Human-Computer Interaction (HCI) technology. Currently, Bluetooth mouse or a wireless mouse these devices are used but the main disadvantage of these devices is it consumes a battery for power and it requires dongle/ adaptor to connect it to the PC. In the proposed Hand Gesture Controller (Virtual Mouse) and Voice Assistant using OpenCV, ML, Python. This limitations will be overcome by introducing webcam or a built-in camera for capturing of hand gestures and hand tip detection using computer vision. The algorithm used in the system makes use of the machine learning algorithm is Based on the hand gestures, the computer can be controlled virtually and can perform right click, left click, scroll-up, scroll-down and computer cursor function without any physical interaction. The algorithm is based on deep learning for detecting the hand gesture. Hence, the proposed system will avoid full physical interaction with voice assistant for controlling all computer functions. which is helpful for COVID-19 spread by eliminating the human intervention and dependency of devices to control the computer.
Keywords: Hand Gesture, Virtual, OpenCV, Machine Learning, MediaPipe, mouse cursor
|
DOI:
10.17148/IJARCCE.2022.111114
