Mouse Cursor Control using Eye Movements for Physically Challenged Individuals
Keywords:
Cursor control, Eye movements, OpenCV (Open-Source Computer Vision Library), Python, WebcamAbstract
It might be very difficult for someone with physical disabilities to control the mouse. I've suggested this eye movement-based mouse cursor control to address a problem for those who are unable to physically use a mouse. Another way to use a computer is by eye aspect, which uses eye movements to control the mouse. Eye gazing provides a different way to communicate with a computer using just eye movements for people who find touchscreens or a mouse difficult. For users with physical limitations, in particular, eye tracking is an essential real-time input channel for human-computer interaction. In order to improve eye tracking's dependability, portability, and usefulness in these kinds of interactions, this system presents a novel eye control approach that just requires a webcam and no extra hardware. With just the user's eyes, the system is intended to provide a straightforward and easy way to engage. It is simple and comfortable to use because of its operating flow, which is in line with human nature. In order to manipulate the cursor on the screen, the solution uses Python to follow the motions of the iris and eye.
References
Q. Sun, J. Xia, N. Nadarajah, T. Falkmer, J. Foster, and H. Lee, “Assessing drivers’ visual-motor coordination using eye tracking, GNSS and GIS: a spatial turn in driving psychology,” Journal of Spatial Science, vol. 61, no. 2, pp. 299–316, Jul. 2016, doi: https://doi.org/10.1080/14498596.2016.1149116
L. Sun, Z. Liu, and M. T. Sun, “Real-time gaze estimation with a consumer depth camera,” Information Sciences, vol. 320, pp. 346–360, Nov. 2015. doi: https://doi.org/10.1016/j.ins.2015.02.004
R. Bednarik and M. Tukiainen, “An eye-tracking methodology for characterizing program comprehension processes,” in Proceedings of the 2006 Symposium on Eye Tracking Research & Applications, Mar. 2006, pp. 125–132. doi: https://doi.org/10.1145/1117309.1117356
M. A. Eid, N. Giakoumidis, and A. El Saddik, "A novel eye-gaze-controlled wheelchair system for navigating unknown environments: A case study with a person with ALS," IEEE Access, vol. 4, pp. 558–573, Jan. 2016. doi: http://doi.org/10.1109/ACCESS.2016.2520093
Y. M. Cheung and Q. Peng, “Eye gaze tracking with a web camera in a desktop environment,” IEEE Transactions on Human-Machine Systems, vol. 45, no. 4, pp. 419–430, Mar. 2015. doi: http://doi.org/10.1109/THMS.2015.2400442
C. A. Chin, A. Barreto, J. G. Cremades, and M. Adjouadi, “Integrated electromyogram and eye-gaze tracking cursor control system for computer users with motor disabilities,” Journal of Rehabilitation Research & Development, vol. 45, no. 1, pp. 161–174, 2008. Available: https://pubmed.ncbi.nlm.nih.gov/18566935/
O. Ferhat and F. Vilariño, “Low-cost eye tracking: The current panorama,” Computational intelligence and neuroscience, vol. 2016, Art. no. 8680541, 2016. doi: https://doi.org/10.1155/2016/8680541
B. Noris, J. B. Keller, and A. Billard, “A wearable gaze tracking system for children in unconstrained environments,” Computer Vision and Image Understanding, vol. 115, no. 4, pp. 476–486, Apr. 2011. doi: https://doi.org/10.1016/j.cviu.2010.11.013
R. J. K. Jacob and K. S. Karn, “Eye Tracking in Human-Computer Interaction and Usability Research,” The Mind’s Eye, vol. 2, no. 3, pp. 573–605, 2003, doi: https://doi.org/10.1016/b978-044451020-4/50031-1
K. Takemura, K. Takahashi, J. Takamatsu, and T. Ogasawara, “Estimating 3-D point-of-regard in a real environment using a head-mounted eye-tracking system,” IEEE Transactions on Human-Machine Systems, vol. 44, no. 4, pp. 531–536, May 2014. doi: https://doi.org/10.1109/THMS.2014.2318324
P. S. Holzman, L. R. Proctor, and D. W. Hughes, “Eye-tracking patterns in schizophrenia,” Science, vol. 181, no. 4095, pp. 179–181, Jul. 1973. doi: http://doi.org/10.1126/science.181.4095.179
N. Scott, C. Green, and S. Fairley, “Investigation of the use of eye tracking to examine tourism advertising effectiveness,” Current Issues in Tourism, vol. 19, no. 7, pp. 634–642, Jun. 2016. doi: https://doi.org/10.1080/13683500.2014.1003797
