Abstract: GesturaX introduces a novel approach to touch-free computing by combining two interactive technologies— GestureSense and AirMouse—to redefine how users engage with digital systems. The GestureSense component employs advanced image processing techniques and machine learning algorithms, powered by the MediaPipe framework, to detect and interpret hand gestures in real time. This allows users to perform everyday tasks like moving cursors, clicking, scrolling, adjusting volume/brightness, and controlling media playback through intuitive hand motions.
The AirMouse module complements this by blending hardware innovation with motion sensing. Built around an ESP32-WROOM microcontroller and Bluetooth technology, it uses an MPU6050 inertial sensor for precise cursor control, alongside physical buttons and a rotary dial for clicks and scrolling. A compact 3.7V battery paired with a tp5100 charging unit and integrated safety systems ensures reliable, cord-free operation.
By merging visual gesture recognition with motion-based hardware controls, GesturaX offers a flexible solution for scenarios where traditional keyboards/mice fall short—from accessibility tools to gaming interfaces and smart home systems. This dual-modality design prioritizes both precision and ease of use, paving the way for more natural human- device interactions.
Keywords: Human-Computer Interaction, Gesture Recognition, Computer Vision, MediaPipe, ESP32, MPU6050, Bluetooth Connectivity, Touchless Interface, Sensor Fusion, Real-Time Control
|
DOI:
10.17148/IJARCCE.2025.14326
