Design and Development of Emotionally Intelligent Personal Assistant Robot
Keywords:
Artificial emotional intelligence, Emotion recognition, Emotional support system, Facial expression analysis, Human–robot interaction, Multimodal interaction, Personal assistant robot, Portable robotics, Real-time response, Voice sentiment detectionAbstract
Emotional intelligence in robots is becoming increasingly important as users seek more natural and supportive interactions from personal assistant systems. This work presents an emotionally intelligent personal assistant robot capable of recognizing user emotions through facial expressions and voice cues, and responding with appropriate dialogue. The system uses a lightweight multimodal approach that combines vision-based emotion detection with basic audio sentiment analysis, enabling real-time and reliable emotional understanding without requiring complex hardware. The robot provides motivational and supportive responses designed to reduce stress and improve user engagement. Experimental testing with different users showed consistent emotion recognition and positive interaction feedback. Compared to existing emotional-support robots, the proposed design offers improved portability, lower cost, and simplicity, making it suitable for everyday personal use by students, elderly individuals, and general users.
References
G. Laban, “Social robots as communication partners to support emotional health and well-being,” 2022 10th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW), Nara, Japan, 2022, pp. 1-5, doi: https://doi.org/10.1109/ACIIW57231.2022.10086018
S. Ismail and H. Vasudev, “EIROB: An emotionally intelligent robot for empathetic support,” 2024 IEEE International Conference on Signal Processing, Informatics, Communication and Energy Systems (SPICES), Kottayam, India, 2024, pp. 1–6, doi: https://doi.org/10.1109/SPICES62143.2024.10779758
Q. Zhang and C. Huang, “Development of a portable psychological support robot system,” 2023 IEEE International Conference on Mechatronics and Automation (ICMA), vol. 1, pp. 687–692, Aug. 2023, doi: https://doi.org/10.1109/icma57826.2023.10215570
Q. Ni, Z. Gao, and J. Lin, “Research on the design of emotional intelligent robot for empty nesters,” 2020 3rd International Conference on Advanced Electronic Materials, Computers and Software Engineering (AEMCSE), pp. 226–229, Apr. 2020, doi: https://doi.org/10.1109/aemcse50948.2020.00055
D. Ziouzios, A. Chatzisavvas, N. Baras, G. Kapris and M. Dasygenis, “An emotional intelligent robot for primary education: The software development,” 2021 6th South-East Europe Design Automation, Computer Engineering, Computer Networks and Social Media Conference (SEEDA-CECNSM), Preveza, Greece, 2021, pp. 1-4, doi: https://doi.org/10.1109/SEEDA-CECNSM53056.2021.9566268
N. Jain, V. Kulshreshtha and V. Vivek, “Assistant robot with emotion detection and display abilities survey,” 2022 4th International Conference on Advances in Computing, Communication Control and Networking (ICAC3N), Greater Noida, India, 2022, pp. 1413–1418, doi: https://doi.org/10.1109/ICAC3N56670.2022.10074162
T. Achtenberg and D. B. O. Boesl, “Defining emotional intelligence for robots based on a coaching approach” IEEE 21st World Symposium on Applied Machine Intelligence and Informatics (SAMI), Herl'any, Slovakia, 2023. doi: https://doi.org/10.1109/SAMI58000.2023.10044520
T. Obo and Y. Nakamura, “Intelligent robot navigation based on human emotional model in human-aware environment,” 2019 International Conference on Machine Learning and Cybernetics (ICMLC), Kobe, Japan, 2019, pp. 1–6, doi: https://doi.org/10.1109/ICMLC48188.2019.8949247
S. Alhouli, N. Almania, M. I. Ahmad, M. Hyde and D. Sahoo, “Older adults’ emotional challenges and co-design preferences for a social robot after the COVID-19 pandemic,” 2023 32nd IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), Busan, Korea, Republic of, 2023, pp. 2245–2252, doi: https://doi.org/10.1109/RO-MAN57019.2023.10309490
