Employee Information System Integrated With Gesture Virtual Mouse, Keyboard, Personal Assistant

Employee Information System Integrated With Gesture Virtual Mouse, Keyboard, Personal Assistant

Human-computer interaction is evolving beyond the physical mouse and keyboard, and workplaces are embracing touchless, accessible interfaces. This project combines an enterprise-grade HR management system with futuristic gesture-based computer control — creating one of the most innovative project concepts in the HCI domain. The Employee Information System core manages complete employee records: personal details, educational background, work history, department, salary, leave status, and performance data — with role-based access for HR administrators, managers, and employees, plus reporting and analytics modules. The innovation layer adds a computer vision-powered virtual mouse and keyboard that lets users control the entire interface through hand gestures captured by a standard webcam: index-finger tracking moves the cursor, pinch gestures perform clicks, and hand-posture changes enable scrolling, dragging, and typing on a virtual keyboard. An integrated voice assistant further enables hands-free navigation using speech recognition. Built with Python, OpenCV, MediaPipe, PyAutoGUI, and Django, this project serves accessibility technology goals and hybrid offices — a standout computer vision HCI project combining CV, NLP, and full-stack web development.

Components

Python 3.8+
OpenCV
MediaPipe
PyAutoGUI
Django
SQLite / MySQL

Key Features

• Complete employee records — personal, education, work history, salary, leave and performance
• Virtual mouse via index-finger tracking and pinch-gesture clicks from a webcam
• Virtual keyboard with scrolling, dragging and typing through hand postures
• Voice assistant for hands-free navigation commands
• Role-based access for HR, managers and employees with analytics modules

Applications

Accessibility technology initiatives, hybrid offices, HCI students and developers building unique computer vision interfaces.