Vision-based Gesture Controlled Automation
Keywords:
AC appliances, Arduino UNO, DC motor/fan, Home automation, L298N motor driver, Relay module, Power, Smart homeAbstract
Automation has become a necessity in the modern world, influencing diverse fields such as industrial processing, artificial intelligence, healthcare, and building management systems. Among these advancements, home automation the remote or automatic control of household appliances has gained rapid popularity due to its convenience, efficiency, and safety. It plays a significant role in bridging the gap between human interaction and machine execution. This technology is especially beneficial for elderly and physically challenged individuals, enabling them to control appliances effortlessly and live more independently. In recent years, hand gesture recognition has gained remarkable importance as a natural and user-friendly control interface. The proposed system utilizes an object-detection-based gesture recognition technique to interpret human hand movements. The process begins with a camera capturing real-time images of a user’s hand gestures. These images are analyzed and compared with preloaded gesture templates stored in the system. When a match is detected, a corresponding control signal is transmitted to a microcontroller to activate appliances, which then activate specific home appliances such as fans, lights, or other electrical devices. The hardware architecture of the system includes a camera module, Arduino Uno microcontroller, relay module, L298N motor driver, regulated power supply and output devices like LEDs and fans. The entire hardware setup is interfaced with simulation software using a USB-to-serial converter for proper communication and testing. Beyond home automation, this gesture-based control system has vast potential applications in media player control, robotic systems, gaming devices, and virtual object manipulation. The proposed approach offers a reliable, touchless, and intelligent solution for next-generation smart automation systems.
References
M. Oudah, A. Al-Naji, and J. Chahl, “Hand gesture recognition based on computer vision: A review of techniques,” J. Imaging, vol. 6, no. 8, Art. no. 73, 2020, doi: https://doi.org/10.3390/
jimaging6080073
M. Muneeb, H. Rustam, and A. Jalal, “Automate appliances via gesture recognition for elderly living assistance,” Proc. 2023 4th Int. Conf. Advancements in Computational Sciences (ICACS), 2023, pp. 1–6, doi: https://doi.org/10.1109/ICACS55311.2023.10089778
M. Hussain, “Home automation for disabled persons using gesture control and artificial intelligence,” J. Artif. Intell. Comput., vol. 1, no. 2, pp. 1–5, 2023, doi: https://doi.org/10.57041/
czdnq93
S. Kshirsagar, S. Sachdev, N. Singh, A. Tiwari, and S. Sahu, “IoT enabled gesture-controlled home automation for disabled and elderly,” Proc. 4th Int. Conf. Computing Methodologies and Communication (ICCMC), Mar. 2020 doi: https://doi.org/10.1109/iccmc48092.2020.iccmc-000152
P. M., R. K., and V. K., “Voice and gesture based home automation system,” Int. J. Electron. Eng. Appl., vol. 9, no. 1, 2021, doi: https://doi.org/10.30696/ijeea.ix.i.2021.08-18
L. M. Keselman, J. I. Woodfill, A. Grunnet-Jepsen, and A. K. Bhowmik, “Intel® RealSense™ stereoscopic depth cameras,” Proc. IEEE Conf. Comput. Vis. Pattern Recognit. Workshops (CVPRW), July 2017, doi: https://doi.org/10.1109/CVPRW.2017.167
P. N. Arathi, S. Arthika, S. Ponmithra, K. Srinivasan, and V. Rukkumani, “Gesture-based home automation system,” 2017 International Conference on Nextgen Electronic Technologies: Silicon to Software (ICNETS2), Chennai, India, Mar. 23–25, 2017, doi: https://doi.org/10.1109/icnets2.
8067929
G. G. Mwangi, J. M. Kerosi, and B. A. Moywaywa, “Gesture-driven home automation system,” IOSR J. Electr. Electron. Eng., vol. 19, no. 6, doi: https://doi.org/10.9790/0853-1906011015
S. Farooq, M. N. Ali, S. Yousaf, and S. U. Deen, “Literature review on home automation system for physically disabled people,” in Proc. 2018 Int. Conf. Computing, Mathematics and Engineering Technologies (iCoMET), Sukkur, Pakistan, 03–04 March 2018.doi: https://doi.org/10.1109/ICOMET.2018.8346397
B. Alabdullah et al., “Smart home automation-based hand gesture recognition using feature fusion and recurrent neural network,” Sensors, vol. 23, no. 17, pp. 7523–7523, Aug. 2023, doi: https://doi.org/10.3390/s23177523
H. Rustam et al., “Home automation-based health assessment along gesture recognition via inertial sensors,” Computers, Materials & Continua, vol. 75, no. 1, pp. 2331–2346, 2023, doi: https://doi.org/10.32604/cmc.2023.028712
N. Kheratkar, S. Bhavani, A. Jarali, A. Pathak, and S. Kumbhar, “Gesture controlled home automation using CNN,” Proc. 4th Int. Conf. Intelligent Computing and Control Systems (ICICCS), Madurai, India, 2020, pp. 620–626, doi: https://doi.org/10.1109/iciccs48265.
9121058
C. Zimmermann and T. Brox, “Learning to estimate 3D hand pose from single RGB images,” in Proc. IEEE Int. Conf. Comput. Vis. (ICCV), 2017, pp. 4913–4921, doi: https://doi.org/10.1109/ICCV.2017.525 1
C. Qian, X. Sun, Y. Wei, X. Tang, and J. Sun, “Realtime and robust hand tracking from depth,” in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), 2014, pp. 1106–1113, doi: https://doi.org/10.1109/CVPR.2014.145
P. Harmo, T. Taipalus, J. Knuuttila, J. Vallet, and A. Halme, “Needs and solutions—home automation and service robots for the elderly and disabled,” Proc. IEEE/RSJ Int. Conf. Intelligent Robots and Systems (IROS), Edmonton, AB, Canada, 2005, pp. 3201–3206,doi: https://doi.org/10.1109/IROS.2005.1545387
Y. Zhou, M. Habermann, W. Xu, I. Habibie, C. Theobalt, and F. Xu, “Monocular real-time hand shape and motion capture using multi-modal data,” in Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit. (CVPR), 2020, pp. 5345–5354, doi: https://doi.org/10.1109/CVPR42600.
00539
