Smart Specs for Visually Impaired People Using ESP32
Keywords:
Accessibility, Assistive device, ESP32 microcontroller, Navigation assistance, Smart specs, Versatile hardware, Visually impairedAbstract
The continuous development of technology has resulted in unprecedented advancements in many fields with assistive technology for the visually impaired being a key area that has seen accelerated development. Of these, object detection technologies have seen a tremendous shift from rudimentary systems relying on human-engineered features and simplistic algorithms to sophisticated, real-time systems based on microcontrollers and computer vision. This development has facilitated more precise and reactive environmental perception aids, which have a direct influence on the autonomy and safety of the visually impaired. As a reaction to this development, the current project proposes “Smart Specs”, a new, compact, and affordable wearable aid designed to enhance daily mobility for the visually impaired. Designed for simplicity and upgraded situational awareness, the smart specs incorporates the ESP32 microcontroller, which is the mind of the gadget, and facilitates both real-time computation and wireless connectivity. The ultrasonic sensors, camera module, and audio output elements join the ESP32 in conjunction to scan the surroundings of the user and provide timely responses.
One of the unique aspects of the system is its integration of OpenCV with Python to enable object and face detection based on image processing and computer vision. The detections are analysed onboard and translated into sound-based alerts or vibration signals, literally converting visual information into readable formats by visually impaired users. The dual-feedback mechanism thus builds user confidence and encourages independent navigation, even in new environments.
Smart specs provides a realistic and scalable solution that reconciles cost, precision, and usability, demonstrating how embedded systems and computer vision with AI can be used to create powerful, real-world assistive technology.
References
T. Annapurna et al., “An IoT-based vision alert for the blind using interdisciplinary approaches,” E3S Web of Conferences, International Conference on Futuristic Trends in Engineering, Science & Technology (ICFTEST-2024), vol. 507, Mar. 2024, doi: https://doi.org/10.1051/e3sconf/202450701047
S. M. Joans, A. R., M. Sam, S. C. Ranjane, and S. Subiksha, “Artificial intelligence based smart navigation system for blind people,” International Research Journal of Engineering and Technology (IRJET), vol. 9, no. 7, pp. 2295–2302, Jul. 2022, Available: https://www.irjet.net/archives/V9/i7/IRJET-V9I7422.pdf
P. Kharat, T. Kumar, R. Sirsikar, R. Sawant, and V. Avhad, “Obstacle detection for visually impaired using computer vision,” International Research Journal of Engineering and Technology (IRJET), vol. 10, no. 3, pp. 817–3820, Mar. 2023, Available: https://www.irjet.net/archives/V10/i3/IRJET-V10I3128.pdf
B. S. S. V. R. Babu, S. D. Basha, M. Chandrakanth, R. T. Teja and P. Hemanth, “Smart blind glasses using OpenCV Python,” 2024 IEEE Wireless Antenna and Microwave Symposium (WAMS), Visakhapatnam, India, 2024, pp. 01-04, doi: https://doi.org/10.1109/WAMS59642.2024.10527868
P. Rajesh, R. Sairam, M. D. Kumar, P. K. Eswar and Y. Keerthi, “Arduino based smart blind stick for people with vision loss,” 2023 7th International Conference on Computing Methodologies and Communication (ICCMC), Erode, India, 2023, pp. 1501-1508, doi: https://doi.org/10.1109/ICCMC56507.2023.10083752
P. S. Ranaweera, S. H. R. Madhuranga, H. F. A. S. Fonseka and D. M. L. D. Karunathilaka, “Electronic travel aid system for visually impaired people,” 2017 5th International Conference on Information and Communication Technology (ICoIC7), Melaka, Malaysia, 2017, pp. 1-6, doi: https://doi.org/10.1109/ICoICT.2017.8074700
B. Das and K. K. Halder, “Face recognition using ESP32-Cam for real-time tracking and monitoring,” 2024 International Conference on Advances in Computing, Communication, Electrical, and Smart Systems (iCACCESS), Dhaka, Bangladesh, 2024, pp. 01-06, doi: https://doi.org/10.1109/iCACCESS61735.2024.10499606
N. Tyagi, D. Sharma, J. Singh, B. Sharma, and S. Narang, “Assistive navigation system for visually impaired and blind people: A review,” 2021 International Conference on Artificial Intelligence and Machine Vision (AIMV), Gandhinagar, India, 2021, pp. 1-5, doi: https://doi.org/10.1109/AIMV53313.2021.9670951
C. Prathima, G. N. Babu, B. R. Reddy, M. S. Kumar, S. Thousif and P. Vamsi, “Smart Specs: Real-time object detection through embedded vision,” 2025 International Conference on Data Science, Agents & Artificial Intelligence (ICDSAAI), Chennai, India, 2025, pp. 1-6, doi: https://doi.org/10.1109/ICDSAAI65575.2025.11011858
D. Workshop, “ESP32-CAM object detection with edge impulse,” DroneBot Workshop, Jun. 25, 2023. https://dronebotworkshop.com/esp32-object-detect/
“ESP32-CAM AI-Thinker Pinout Guide: GPIOs Usage Explained | Random Nerd Tutorials,” Mar. 10, 2020. https://randomnerdtutorials.com/esp32-cam-ai-thinker-pinout/
Arduino, “Arduino Documentation,” docs.arduino.cc. https://docs.arduino.cc/
