Have a personal or library account? Click to login
Bridging the gap between AI and human emotion: a multimodal recognition system Cover

Bridging the gap between AI and human emotion: a multimodal recognition system

Open Access
|Aug 2025

Abstract

This study introduces a novel system that integrates voice and facial recognition technologies to enhance human-computer interaction by accurately interpreting and responding to user emotions. Unlike conventional approaches that analyze either voice or facial expressions in isolation, this system combines both modalities, o ering a more comprehensive understanding of emotional states. By evaluating facial expressions, vocal tones, and contextual conversation history, the system generates personalized, context-aware responses, fostering more natural and empathetic AI interactions. This advancement significantly improves user engagement and satisfaction, paving the way for emotionally intelligent AI applications across diverse fields.

DOI: https://doi.org/10.2478/candc-2024-0024 | Journal eISSN: 2720-4278 | Journal ISSN: 0324-8569
Language: English
Page range: 619 - 638
Submitted on: Sep 1, 2024
Accepted on: Mar 1, 2025
Published on: Aug 26, 2025
Published by: Systems Research Institute Polish Academy of Sciences
In partnership with: Paradigm Publishing Services
Publication frequency: 4 issues per year

© 2025 Ganta Neeraja, Jakkula Sai Surya Teja, M. Ravi Kumar, J. Lakshmi Prasanna, Parvez M. Muzammil, Chella Santhosh, published by Systems Research Institute Polish Academy of Sciences
This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License.