A Study on Real-time Monitoring of a Hand Gesture-controlled Robot Car
Keywords:
Accelerometer (MPU6050), Arduino Uno, Embedded system, Hand gesture control, Motor driver (L293D), RF modules (transmitter & receiver), Wireless communicationAbstract
In the present era, technological innovations have made the interaction between humans and machines more efficient, intuitive, and user-friendly. Now, people can communicate with machines not only through the traditional mechanical control but also by tapping, talking, or gesturing. In comparison with other novel interaction methods, the use of hand gestures for communication with devices has been extremely successful because it is the most natural, logical, and infection-free way of interaction without any physical contact. Hand gestures do away with the necessity of physical switches or complicated interfaces, thus enabling users to operate electronic systems merely through body movements, which, in turn, makes the use of devices more convenient, accessible, and efficient. The incorporation of gesture-based control technologies is the main reason behind a massive leap in the field of robotics. Robots are used in a variety of areas such as automation, construction, defense, healthcare, industrial manufacturing, surveillance, and service sectors. With the use of gesture-controlled robots, one can efficiently and easily transfer the directions to the robotic movement in real time without the help of a wired remote controller. This not only increases the freedom of movement, lessens the effort put in by humans, and makes the control faster and more responsive, but also, in particular, it is of great importance in situations such as bomb disposal, rescue operations, hazardous-area inspection, and assistive technologies for differently-abled individuals.
References
S. Mitra and T. Acharya, “Gesture recognition: A survey,” IEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews), vol. 37, no. 3, pp. 311–324, May 2007, doi: https://doi.org/10.1109/tsmcc.2007.893280
S. S. Rautaray and A. Agrawal, “Vision-based hand gesture recognition for human computer interaction: a survey,” Artificial Intelligence Review, vol. 43, no. 1, pp. 1–54, Nov. 2012, doi: https://doi.org/10.1007/s10462-012-9356-9
M. Shoaib, M. Y. Yang, B. Rosenhahn, and J. Ostermann, “Estimating layout of cluttered indoor scenes using trajectory-based priors,” Image and Vision Computing, vol. 32, no. 11, pp. 870–883, Nov. 2014, doi: https://doi.org/10.1016/j.imavis.2014.07.003
R. Poppe, “A survey on vision-based human action recognition,” Image and Vision Computing, vol. 28, no. 6, pp. 976–990, Jun. 2010, doi: https://doi.org/10.1016/j.imavis.2009.11.014
S. Marcel, O. Bernier, J. -E. Viallet and D. Collobert, “Hand gesture recognition using input-output hidden Markov models,” Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580), Grenoble, France, 2000, pp. 456–461, doi: https://doi.org/10.1109/AFGR.2000.840674
Atmel, “ATmega328P 8-bit AVR Microcontroller with 32K Bytes in-System Programmable Flash DATASHEET,” 2015. Available: https://ww1.microchip.com/downloads/en/DeviceDoc/
Atmel-7810-Automotive-Microcontrollers-ATmega328P_Datasheet.pdf
Z. Ren, J. Yuan, J. Meng and Z. Zhang, “Robust part-based hand gesture recognition using Kinect sensor,” IEEE Transactions on Multimedia, vol. 15, no. 5, pp. 1110–1120, Aug. 2013, doi: https://doi.org/10.1109/TMM.2013.2246148
J. Shotton et al., “Real-time human pose recognition in parts from single depth images,” CVPR 2011, Colorado Springs, CO, USA, 2011, pp. 1297–1304, doi: https://doi.org/10.1109/CVPR.
5995316
P. Molchanov, S. Gupta, K. Kim and J. Kautz, “Hand gesture recognition with 3D convolutional neural networks,” 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Boston, MA, USA, 2015, pp. 1–7, doi: https://doi.org/10.1109/CVPRW.
7301342
G. Plouffe and A. -M. Cretu, “Static and dynamic hand gesture recognition in depth data using dynamic time warping,” IEEE Transactions on Instrumentation and Measurement, vol. 65, no. 2, pp. 305–316, Feb. 2016, doi: https://doi.org/10.1109/TIM.2015.2498560
C. Keskin, F. Kıraç, Y. E. Kara and L. Akarun, “Real-time hand pose estimation using depth sensors,” 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops), Barcelona, Spain, 2011, pp. 1228–1234, doi: https://doi.org/10.1109/ICCVW.
6130391
J. Zhou, S. Cadavid and M. Abdel-Mottaleb, “A computationally efficient approach to 3D ear recognition employing local and holistic features,” CVPR 2011 WORKSHOPS, Colorado Springs, CO, USA, 2011, pp. 98–105, doi: https://doi.org/10.1109/CVPRW.2011.5981815
Agarwal and B. Triggs, “Recovering 3D human pose from monocular images,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 28, no. 1, pp. 44–58, Jan. 2006, doi: https://doi.org/10.1109/TPAMI.2006.21
T. B. Moeslund, A. Hilton, and V. Krüger, “A survey of advances in vision-based human motion capture and analysis,” Computer Vision and Image Understanding, vol. 104, no. 2–3, pp. 90–126, Nov. 2006, doi: https://doi.org/10.1016/j.cviu.2006.08.002
J. Wang, Y. Chen, S. Hao, X. Peng, and L. Hu, “Deep learning for sensor-based activity recognition: A survey,” Pattern Recognition Letters, vol. 119, pp. 3–11, Mar. 2019, doi: https://doi.org/10.1016/j.patrec.2018.02.010
F. Dominio, M. Donadeo, and P. Zanuttigh, “Combining multiple depth-based descriptors for hand gesture recognition,” Pattern Recognition Letters, vol. 50, pp. 101–111, Dec. 2014, doi: https://doi.org/10.1016/j.patrec.2013.10.010
X. Li, W. Lu, D. Tao and Xinbo Gao, “Frequency structure analysis for IQA,” 2008 IEEE International Conference on Systems, Man and Cybernetics, Singapore, 2008, pp. 2246–2251, doi: https://doi.org/10.1109/ICSMC.2008.4811627
T. Mizuno, M. Takasaki and Y. Ishino, “Application of phase-locked loop to mass measurement using damped dynamic vibration absorber,” 2017 11th Asian Control Conference (ASCC), Gold Coast, QLD, Australia, 2017, pp. 1134–1139, doi: https://doi.org/10.1109/ASCC.2017.8287330
