Optimal Attention Deep Learning-Based Multi-Class Emotion Detection and Classification Model on fMRI Images
By: L. Dinesh and G. Indirani
References
- S. Gu, F. Wang, C. Cao, E. Wu, Y.Y. Tang and J.H. Huang, “An integrative way for studying neural basis of basic emotions with fMRI,” Frontiers in Neuroscience, vol. 13, 2019, p. 628.
- C. Candemir, A.S. Gonul and M.A. Selver, “Automatic detection of emotional changes induced by social support loss using fMRI,” IEEE Transactions on Affective Computing, vol. 14, no. 1, 2021, pp. 706–717.
- Y. Li, S. Li, W. Hu, L. Yang and W. Luo, “Spatial representation of multidimensional information in emotional faces revealed by fMRI,” NeuroImage, vol. 290, 2024, p. 120578.
- T. Nguyen, T. Zhou, T. Potter, L. Zou and Y. Zhang, “The cortical network of emotion regulation: Insights from advanced EEG-fMRI integration analysis,” IEEE Transactions on Medical Imaging, vol. 38, no. 10, 2019, pp. 2423–2433.
- A.N. Khan, A.A. Ihalage, Y. Ma, B. Liu, Y. Liu and Y. Hao, “Deep learning framework for subject-in-dependent emotion detection using wireless signals,” PLOS ONE, vol. 16, no. 2, 2021, p. e0242946.
- N.V. Kimmatkar and B.V. Babu, “Novel approach for emotion detection and stabilizing mental state by using machine learning techniques,” Computers, vol. 10, no. 3, 2021, p. 37.
- K. Wang, “Exploring neural network architectures for fMRI pattern recognition using modern machine learning and deep learning techniques,” 2023.
- D. Panda, D.D. Chakladar and T. Dasgupta, “Multimodal system for emotion recognition using EEG and customer review,” in Proceedings of the Global AI Congress 2019, Springer, Singapore, April 2020, pp. 399–410
- F.M. Alamgir and M.S. Alam, “Hybrid multi-modal emotion recognition framework based on InceptionV3DenseNet,” Multimedia Tools and Applications, vol. 82, no. 26, 2023, pp. 40375–40402.
- Z. He, Z. Li, F. Yang, L. Wang, J. Li, C. Zhou and J. Pan, “Advances in multimodal emotion recognition based on brain–computer interfaces,” Brain Sciences, vol. 10, no. 10, 2020, p. 687.
- J. Marín-Morales, C. Llinares, J. Guixeres and M. Alcañiz, “Emotion recognition in immersive virtual reality: From statistics to affective computing,” Sensors, vol. 20, no. 18, 2020, p. 5163.
- C. Zich, N. Johnstone, M. Lührs, S. Lisk, S.P. Haller, A. Lipp, J.Y. Lau and K.C. Kadosh, “Modulatory effects of dynamic fMRI-based neurofeedback on emotion regulation networks in adolescent females,” NeuroImage, vol. 220, 2020, p. 117053.
- Y. Zhang, Z. Wang, J. Du, J. Liu, T. Xu, X. Wang, M. Sun, Y. Wen, D. Li, H. Liao and Y. Zhao, “Regulatory effects of acupuncture on emotional disorders in patients with menstrual migraine without aura: A resting-state fMRI study,” Frontiers in Neuroscience, vol. 15, 2021, p. 726505.
- A.D. Dahlen, A. Schofield, H.B. Schiöth and S.J. Brooks, “Subliminal emotional faces elicit pre-dominantly right-lateralized amygdala activation: A systematic meta-analysis of fMRI studies,” Frontiers in Neuroscience, vol. 16, 2022, p. 868366.
- E. Szabó, A. Galambos, N. Kocsel, A.E. Édes, D. Pap, T. Zsombók, L.R. Kozák, G. Bagdy, G. Kökönyei and G. Juhász, “Association between migraine frequency and neural response to emotional faces: An fMRI study,” NeuroImage: Clinical, vol. 22, 2019, p. 101790.
- Y. Yaddaden, “Efficient dynamic emotion recognition from facial expressions using statistical spatio-temporal geometric features,” Big Data and Cognitive Computing, vol. 9, no. 8, 2025, p. 213.
- A. Atchogou and C. Tepe, “Robust emotion recognition in thermal imaging with convolutional neural networks and gray wolf optimization,” Signal Processing: Image Communication, 2025, p. 117363.
- N. Bhavana, A.S. Guthur, K.S. Reddy, S.T. Ahmed and A. Ahmed, “Cognizance through convolution: A deep learning approach for emotion recognition via convolutional neural networks,” Procedia Computer Science, vol. 259, 2025, pp. 1336–1345.
- R. Zhang, Z. Liang, H. Li, X. Liu and G. Wen, “ViDMNet: Vision transformer-based dual-polarity memory network for image emotion recognition,” The Visual Computer, vol. 41, no. 13, 2025, pp. 11069–11082.
- H. Yang, Y. Fan, G. Lv, S. Liu and Z. Guo, “Concept-guided multi-level attention network for image emotion recognition,” Signal, Image and Video Processing, vol. 18, no. 5, 2024, pp. 4313–4326.
- G. Shi, S. Deng, B. Wang, C. Feng, Y. Zhuang and X. Wang, “One for all: A unified generative framework for image emotion classification,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 34, no. 8, 2023, pp. 7057–7068.
- H. Zhang and M. Xu, “Multiscale emotion representation learning for affective image recognition,” IEEE Transactions on Multimedia, vol. 25, 2022, pp. 2203–2212.
- S. Sharvesh, M. Kaileshwar, B. Arthi and C. Jothikumar, “EmoSense: Deep analysis of real-time facial expression for multi-class emotions,” in Proceedings of the Second International Conference on Networks, Multimedia and Information Technology (NMITCON), IEEE, August 2024, pp. 1–6.
- R. Manikandan, M. Balasubramanian and S. Palanivel, “Machine vision based missing fastener detection in rail track images using SVM classifier,” International Journal on Smart Sensing and Intelligent Systems, vol. 10, no. 5, 2017, pp. 574–589.
- M. F. Ishrak, M. M. Rahman, M. I. K. Joy, A. Tamuly, S. Akter, D. M. Tanim and M. S. Rahman, “Vision transformer embedded feature fusion model with pre-trained transformers for keratoconus disease classification,” Emerging Science Journal, vol. 9, no. 2, 2025, pp. 1037–1075.
- M. M. Otoom and A. M. Etoom, “Leveraging image analysis and deep convolutional neural networks for cutting-edge malware detection and mitigation,” HighTech Innov J, vol. 6, no. 2, 2025, pp. 662–686.
- M. A. Hossain, T. A. Asa, M. Z. Mahmud, A. K. M. Azad, M. Z. Rahman, M. A. Moni and A. Moustafa, “Genetic links between common lung diseases and lung cancer progression: bioinformatics and machine learning insights,” Emerging Science Journal, vol. 9, no. 2, 2025, pp. 916–937.
- D.B. Parker and Q.R. Razlighi, “The benefit of slice timing correction in common fMRI preprocessing pipelines,” Frontiers in Neuroscience, vol. 13, 2019, p. 821.
- M. Khodadadzadeh, X. Ding, P. Chaurasia and D. Coyle, “A hybrid capsule network for hyperspectral image classification,” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, vol. 14, 2021, pp. 11824–11839.
- Z. Li, “Predicting amyloid proteins using attention-based long short-term memory,” PeerJ Computer Science, vol. 11, 2025, p. e2660.
- Q. Aini, Z. Zulfiandri, R. Firmansyah and Y.M. Arif, “Applying convolutional neural network and Nadam optimization in flower classification,” Bulletin of Electrical Engineering and Informatics, vol. 13, no. 4, 2024, pp. 2865–2877.
- I. Ahangari, “fMRI dataset for emotion recognition,” Kaggle, 2023.
- M. Tchibozo, D. Kim, Z. Wang and X. He, “Emotional brain state classification on fMRI data using deep residual and convolutional networks,” arXiv preprint, arXiv:2210.17015, 2022.
- R. Mahrukh, S. Shakil and A.S. Malik, “Sentiments analysis of fMRI using automatically generated stimuli labels under naturalistic paradigm,” Scientific Reports, vol. 13, no. 1, 2023, p. 7267.
DOI: https://doi.org/10.2478/ijssis-2026-0053 | Journal eISSN: 1178-5608
Language: English
Submitted on: Jan 31, 2026
Published on: Aug 12, 2026
Published by: International Journal on Smart Sensing and Intelligent Systems
In partnership with: Paradigm Publishing Services
Publication frequency: 1 issue per year
Keywords:
Related subjects:
© 2026 L. Dinesh, G. Indirani, published by International Journal on Smart Sensing and Intelligent Systems
This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License.