An Integrated AI Mock Interview System
Keywords:
Automated interviewing, Computer vision, Edge computing, Human-computer interaction (HCI), Large language models (LLMs), Llama 3.3, Low-latency inference, MediaPipe, Multi-modal proctoring, Sentiment analysisAbstract
In the rapidly evolving digital recruitment landscape, the traditional methodologies of candidate assessment are being challenged by the need for scalable, objective, and high-integrity interview preparation systems. This study presents an integrated AI-driven mock interview framework that harmonizes large language models (LLMs) with real-time computer vision (CV) to simulate rigorous professional environments. The proposed architecture utilizes a PHP-based backend coupled with a MySQL relational database for structured data persistence of candidate profiles and performance metrics. To ensure session integrity without compromising user privacy, the framework incorporates a sophisticated multi-modal proctoring mechanism. This module employs MediaPipe Face Mesh for client-side, edge-based inference of 468 3D facial landmarks, enabling real-time gaze tracking and head-pose estimation without requiring server-side video storage. For dynamic conversational interaction, the system leverages the Llama 3.3 model, optimized via the Groq LPU (language processing unit) inference infrastructure. This integration maintains sub-500 ms response latencies, thereby preserving the natural cadence of human dialogue and mitigating the “uncanny valley” effect often found in high-latency AI agents. Furthermore, the system implements a dual-layered evaluation engine: a semantic NLP parser for technical accuracy and a multi-modal sentiment analyzer that correlates vocal pitch, textual intent, and behavioral cues. Experimental results, derived from a pilot study of 50 diverse professional resumes and 100 simulated sessions, indicate a 94% accuracy rate in distraction detection and a strong statistical correlation ($r > 0.85$) between AI-generated scoring and human expert assessments. The framework provides a privacy-conscious, low-latency, and scalable solution for mitigating interview anxiety while establishing a standardized benchmark for modern performance evaluation.
References
Y. -C. Chou, F. R. Wongso, C. -Y. Chao and H. -Y. Yu, "An AI Mock-interview Platform for Interview Performance Analysis," 2022 10th International Conference on Information and Education Technology (ICIET), Matsue, Japan, 2022, pp. 37-41.
R. Mandal, P. Lohar, D. Patil, A. Patil and S. Wagh, "AI -Based mock interview evaluator: An emotion and confidence classifier model," 2023 International Conference on Intelligent Systems for Communication, IoT and Security (ICISCoIS), Coimbatore, India, 2023, pp. 521-526.
D. Y. Dissanayake et al., "AI-based Behavioural Analyser for Interviews/Viva," 2021 IEEE 16th International Conference on Industrial and Information Systems (ICIIS), Kandy, Sri Lanka, 2021, pp. 277-282.
M. S. P, D. Hepsi Priya, P. Malavika and L. A, "Automated Analysis and Behavioural Prediction of Interview Performance using Computer Vision," 2022 IEEE 19th India Council International Conference (INDICON), Kochi, India, 2022, pp. 1-6.
J. G. L. K, A. P, J. Shabu, J. Refonaa and M. P. Selvan, "Automated Interview through Online Video Interface," 2023 International Conference on Circuit Power and Computing Technologies (ICCPCT), Kollam, India, 2023, pp. 1315-1321.
I. Naim, M. I. Tanveer, D. Gildea and M. E. Hoque, "Automated Analysis and Prediction of Job Interview Performance," in IEEE Transactions on Affective Computing, vol. 9, no. 2, pp. 191-204, 1 April-June 2018.
I. Naim et al., "Automated prediction and analysis of job interview performance: The role of what you say and how you say it," in Proc. IEEE Int. Conf. Autom. Face Gesture Recognit. (FG), 2015. Ljubljana, Slovenia, pp. 1-6.
L. Hemamou, G. Felhi, J. -C. Martin and C. Clavel, "Slices of Attention in Asynchronous Video Job Interviews," 2019 8th International Conference on Affective Computing and Intelligent Interaction (ACII), Cambridge, UK, 2019, pp. 1-7.
N. Takeuchi and T. Koda, "Job Interview Training System using Multimodal Behavior Analysis," 2021 9th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW), Nara, Japan, 2021, pp. 1-3.
P. Singla, J. Kaur, Anju, A. Soni, A. Tuteja and S. Sharma, "Streamlining Talent Acquisition: A Machine Learning Approach to Automated Resume Screening," 2024 Second International Conference on Advanced Computing & Communication Technologies (ICACCTech), Sonipat, India, 2024, pp. 69-75.
T. M. Harsha, G. S. Moukthika, D. S. Sai, M. N. R. Pravallika, S. Anamalamudi and M. Enduri, "Automated Resume Screener using Natural Language Processing (NLP)," 2022 6th International Conference on Trends in Electronics and Informatics (ICOEI), Tirunelveli, India, 2022, pp. 1772-1777.
A. Kadirov, Y. Shakirova, G. Ismoilova and N. Makhmudova, "AI in Human Resource Management: Reimagining Talent Acquisition, Development, and Retention," 2024 International Conference on Knowledge Engineering and Communication Systems (ICKECS), Chikkaballapur, India, 2024, pp. 1-8.
D. F. Mujtaba and N. R. Mahapatra, "Ethical Considerations in AI-Based Recruitment," 2019 IEEE International Symposium on Technology and Society (ISTAS), Medford, MA, USA, 2019, pp. 1-7.
S. Sen, S. Kadam and V. V. Ravi Kumar, "Role of Artificial Intelligence-Enabled Recruitment Processes in Sourcing Talent," 2023 6th International Conference on Information Systems and Computer Networks (ISCON), Mathura, India, 2023, pp. 1-5.
K. Yadav, S. Yuvaraj, S. Jugran, R. AlFatlawy, G. Sharma and T. Koilraj, "AI-Powered Recruitment: Enhancing Hiring Efficiency and Candidate Experience in Modern HR," 2025 International Conference on Technology Enabled Economic Changes (InTech), Tashkent, Uzbekistan, 2025, pp. 141-14.
D. Sam, M. Ganesan, S. Ilavarasan and T. J. Victor, "Hiring and Recruitment Process Using Machine Learning," 2023 International Conference on Artificial Intelligence and Knowledge Discovery in Concurrent Engineering (ICECONF), Chennai, India, 2023, pp. 1-4.
C. Nagesh, C. N. Anuradha, K. S. Bharathi, N. Nalini, D. Vidhyasagari and K. M. A. Juber, "Next-Gen Recruitment: An AI Powered Hiring Ecosystem using NLP," 2025 6th International Conference on Inventive Research in Computing Applications (ICIRCA), Coimbatore, India, 2025, pp. 1598-1603.
A. Vaswani et al., "Attention is all you need," in Adv. Neural Inf. Process. Syst. (NeurIPS), vol. 30, 2017.
A. Grattafiori et al. (Meta AI), "The Llama 3 herd of models," arXiv:2407.21783, 2024.
A. F. Mohammad, B. Clark and R. Hegde, "Large Language Model (LLM) & GPT, A Monolithic Study in Generative AI," 2023 Congress in Computer Science, Computer Engineering, & Applied Computing (CSCE), Las Vegas, NV, USA, 2023, pp. 383-388.
N. Anderson, A. McGowan, L. Galway, P. Hanna, M. Collins and D. Cutting, "Implementing Generative AI and Large Language Models in Education," 2023 7th International Symposium on Innovative Approaches in Smart Technologies (ISAS), Istanbul, Turkiye, 2023, pp. 1-6.
H. Zhou et al., "Large Language Models for Wireless Networks: An Overview from the Prompt Engineering Perspective," in IEEE Wireless Communications, vol. 32, no. 4, pp. 98-106, August 2025.
M. Munikar, S. Shakya and A. Shrestha, "Fine-grained Sentiment Classification using BERT," 2019 Artificial Intelligence for Transforming Business and Society (AITB), Kathmandu, Nepal, 2019, pp. 1-5.
T. Bikku, J. Jarugula, L. Kongala, N. D. Tummala and N. Vardhani Donthiboina, "Exploring the Effectiveness of BERT for Sentiment Analysis on Large-Scale Social Media Data," 2023 3rd International Conference on Intelligent Technologies (CONIT), Hubli, India, 2023, pp. 1-4.
N. Kanodia, K. Ahmed and Y. Miao, "Question Answering Model Based Conversational Chatbot using BERT Model and Google Dialogflow," 2021 31st International Telecommunication Networks and Applications Conference (ITNAC), Sydney, Australia, 2021, pp. 19-22.
A. Thakur, L. Ahuja, R. Vashisth and R. Simon, "NLP & AI Speech Recognition: An Analytical Review," 2023 10th International Conference on Computing for Sustainable Global Development (INDIACom), New Delhi, India, 2023, pp. 1390-1396.
S. Alharbi et al., "Automatic Speech Recognition: Systematic Literature Review," in IEEE Access, vol. 9, pp. 131858-131876, 2021.
S. A. Jakhete and N. Kulkarni, "A Comprehensive Survey and Evaluation of MediaPipe Face Mesh for Human Emotion Recognition," 2024 8th International Conference on Computing, Communication, Control and Automation (ICCUBEA), Pune, India, 2024, pp. 1-8.
YW. Wang, X. Chen, S. Zheng and H. Li, "Fast Head Pose Estimation via Rotation-Adaptive Facial Landmark Detection for Video Edge Computation," in IEEE Access, vol. 8, pp. 45023-45032, 2020.
S. K. LokeshNaik et al., "Real Time Facial Emotion Recognition using Deep Learning and CNN," 2023 International Conference on Computer Communication and Informatics (ICCCI), Coimbatore, India, 2023, pp. 1-5.
U. Chindiyababy, P. Kakkar, J. Vedula, J. Yunus, A. Umidbek and S. Sharma, "Deep Learning-Based Facial Emotion Recognition for Advanced Human-Computer Interaction," 2025 First International Conference on Advances in Computer Science, Electrical, Electronics, and Communication Technologies (CE2CT), Bhimtal, Nainital, India, 2025, pp. 1247-1252.
R. S. Biradarpatil, C. BL, S. Hegde, K. Mallibhat and U. Mudenagudi, "Eye Gaze Tracking Towards User Attention Analysis," 2024 5th International Conference for Emerging Technology (INCET), Belgaum, India, 2024.
S. Shilaskar, S. Bhatlawande, T. Gadad, S. Ghulaxe and R. Gaikwad, "Student Eye Gaze Tracking and Attention Analysis System using Computer Vision," 2023 7th International Conference on Computing Methodologies and Communication (ICCMC), Erode, India, 2023, pp. 889-895.
T. Jain, S. Bhatia, C. Sarkar, P. Jain and N. K. Jain, "Real-Time Webcam-Based Eye Tracking for Gaze Estimation: Applications and Innovations," 2024 15th International Conference on Computing Communication and Networking Technologies (ICCCNT), Kamand, India, 2024, pp. 1-7.
V. Nguyen et al., "A review of multimodal sentiment analysis: Modal fusion and representation," in Proc. IEEE Int. Conf. Inf. Commun. Technol. (ICICT), 2024. [Online]. Available: https://ieeexplore.ieee.org/document/10592484/
S. Jayanthi and S. S. Arumugam, "Multimodal Sentiment Analysis Integrating Text, Audio, and Video for Emotion Detection," 2024 International Conference on Sustainable Communication Networks and Application (ICSCNA), Theni, India, 2024, pp. 1736-1741.
T. Voloshina and O. Makhnytkina, "Multimodal Emotion Recognition and Sentiment Analysis Using Masked Attention and Multimodal Interaction," 2023 33rd Conference of Open Innovations Association (FRUCT), Zilina, Slovakia, 2023, pp. 309-317.
S. Moon et al., "A Latency Processing Unit: A Latency-Optimized and Highly Scalable Processor for Large Language Model Inference," in IEEE Micro, vol. 44, no. 6, pp. 17-33, Nov.-Dec. 2024.
X. Zhang, J. Liu, Z. Xiong, Y. Huang, G. Xie and R. Zhang, "Edge Intelligence Optimization for Large Language Model Inference with Batching and Quantization," 2024 IEEE Wireless Communications and Networking Conference (WCNC), Dubai, United Arab Emirates, 2024, pp. 1-6.
N. Whiskerd, J. Dittmann and C. Vielhauer, "A Requirement Analysis for Privacy Preserving Biometrics in View of Universal Human Rights and Data Protection Regulation," 2018 26th European Signal Processing Conference (EUSIPCO), Rome, Italy, 2018, pp. 548-552.