Touchless OS is a suite of standalone Python utilities that allow for zero-touch control of your Windows environment using advanced Computer Vision. By leveraging MediaPipe's Hand Landmark Model and PyAutoGUI, this project translates real-time hand gestures into system commands like cursor movement, scrolling, zooming, and volume adjustment.
Each script is designed to run independently. Simply launch the script and use the corresponding gestures:
- Movement: Point with your index finger to move the cursor.
- Left Click: Raise your pinky while keeping other fingers in a fist.
- Right Click: Raise your index while keeping other fingers in a fist.
- Scrolling: Pinch your index and thumb together and move your wrist vertically to scroll.
- Zoom In: Pinch both hands and move them away from each other.
- Zoom Out: Pinch both hands and move them toward each other.
- Drawing: Pinch index and middle fingers to "write" in the air.
- Smoothing: Utilizes a custom Kalman Filter to eliminate hand jitters for smooth digital ink.
- Volume/Brightness: A virtual slider appears on screen. Pinch and drag the yellow knob to adjust levels.
- Capture: Form two tight fists simultaneously to save a screenshot with a timestamp.
- Clone the Repository
git clone [https://github.com/SamXavii902/Touchless-Interface-HCI.git](https://github.com/SamXavii902/Touchless-Interface-HCI.git) cd Touchless-Interface-HCI
Install Dependencies
Bash
pip install -r requirements.txt Run a Script
Bash
python VirtualMouse.py
Kalman Smoothing: Implemented state estimation to filter raw landmark data, providing a jitter-free user experience.
State Machines: Each module manages its own cooldowns and gesture confirmation frames to prevent accidental triggers.
Windows Integration: Leverages PowerShell and PyCaw for deep system-level hardware control.