Multimodal Emotion Detection for Education and Work Environment by Using Improved Artificial Intelligence Machine Vision System
References
- M. Cui, J. Fang, and Y. Zhao, “Emotion Recognition Of Human Body’s Posture In Open Environment, ” Proc. 2020. Chinese Control and Decision Conference (CCDC), 2020, pp. 3294–3299.
- F. Ahmed, A. S. M. H. Bari, and M. L. Gavrilova, “Emotion Recognition From Body Movement, ” IEEE Access, vol. 8, 20210 pp. 11761–11781, 2020.
- T. Kusunose, X. Kang, K. Kiuchi, R. Nishimura, M. Sasayama, and K. Matsumoto, “Facial Expression Emotion Recognition Based on Transfer Learning and Generative Model, ” Proc. 8th International Conference on Systems and Informatics (ICSAI), 2022, pp. 1–6.
- D. Shehada, A. Turky, W. Khan, B. Khan, and A. Hussain, “A Lightweight Facial Emotion Recognition System Using Partial Transfer Learning for Visually Impaired People, ” IEEE Access, vol. 11, 2023, pp. 36961–36969,
- A. S. Utane and S. L. Nalbalwar, “Emotion Recognition Through Speech, ” Proc. 2nd National Conference on Innovative Paradigms in Engineering and Technology (NCIPET), 2013.
- J. Chen, “Speech Emotion Recognition Based On Convolutional Neural Network, ” Proc. International Conference on Networking, Communications and Information Technology (NetCIT), 2021, pp. 106–109.
- X. Li, R. Yue, W. Jia, H. Wang, and Y. Zheng, “Recognizing Students’ Emotions based on Facial Expression Analysis, ” Proc. 11th International Conference on Information Technology in Medicine and Education (ITME), 2021, pp. 96–100.
- G. Assunçao, B. Patrao, M. Castelo-Branco, and P. Menezes, “An Overview of Emotion in Artificial Intelligence, ” IEEE Transactions on Artificial Intelligence, vol. 3, no. 6, 2022.
- J. M. Foo, S. S. Anhum, S. Islam, and K. H. Keoy, “Facial Emotion Recognition System for Mental Stress Detection among University Students, ” Proc. 3rd International Conference on Electrical, Computer, Communications and Mechatronics Engineering (ICECCME), 2023, pp. 1–6.
- G. Shi, “Technical Analysis of Machine Learning Algorithms in Artificial Intelligence Image Recognition, ” Proc. 3rd Asian Conference on Innovation in Technology (ASIANCON), 2023, pp. 1–5.
- S. Ashrita and T. Padmass Machine Learning for Automation Software Testing: Challenges, Use Cases Advantages & Disadvantages, ” International Journal of Innovative Science and Research Technology, vol. 5, no. 9, 2020, pp. 1301–1307.
- K. Vinutha, M. K. Niranjan, J. Makhijani, B. Natarajan, V. Nirmala, and T. R. Vijaya Lakshmi, “A Machine Learning based Facial Expression and Emotion Recognition for Human Computer Interaction through Fuzzy Logic System, ” Proc. International Conference on Inventive Computation Technologies (ICICT), 2023, pp. 166–173.
- I. Goodfellow, D. Erhan, P. L. Carrier, A. Courville, “Challenges in Representation Learning: A Report on Three Machine Learning Contests, ” Neural Networks, vol. 64, 2013, doi: 10.1016/j.neunet.2014.09.005.
- T. Ergin, M. A. Ozdemir, and A. Akan, “Emotion Recognition with Multi-Channel EEG Signals Using Visual Stimulus, ” Proc. Medical Technologies Congress (TIPTEKNO), 2019, pp. 1–4.
- L. Huang, K. Yu, T. Song, H. Wang, F. Yuan, Y Zhang, and H. Yang, “Research on Emotion Recognition Based on Multisource Signals, ” Proc. IEEE Statistical Signal Processing Workshop (SSP), 2023, pp. 280–284.
- Itai Gat, Hagai Aronowitz, Weizhong Zhu, Edmilson Morais, Ron Hoory, “Speaker Normalization for Self-Supervised Speech Emotion Recognition”, Proc. International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2022, pp. 7342–7346.
- R. Sato, R. Sasaki, N. Suga, and T. Furukawa, “Creation and Analysis of Emotional Speech Database for Multiple Emotions Recognition, ” Proc. 23rd Conference of the Oriental COCOSDA International Committee for the Co-ordination and Standardisation of Speech Databases and Assessment Techniques (O-COCOSDA), 2020, pp. 33–37.
- P. Yue, L. Qu, S. Zheng, and T. Li, “Multi-task Learning for Speech Emotion and Emotion Intensity Recognition, ” Proc. Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC), 2022, pp. 1232–1237.
- M. U. Khan, M. A. Abbasi, Z. Saeed, M. Asif, A. Raza, and U. Urooj, “Deep Learning Based Intelligent Emotion Recognition and Classification System, ” Proc. International Conference on Frontiers of Information Technology (FIT), 2021, pp. 25–30.
- R. Zhan, J. Lu, Y. Jiang, T. Li, G. Zhong, and W. Lv, “A Multimodal Deep Learning Approach for Typhoon Track Forecast by Fusing CNN and Transformer Structures, ” Proc. 4th International Conference on Computer Vision, Image and Deep Learning (CVIDL), pp. 391–394.
- L. Alzubaidi, J. Zhang, A. J. Humaidi, A. Al-Dujaili, Y. Duan, O. Al-Shamma, J. Santamaria, M. A. Fadhel, M. Al-Amidie, and L. Farhan, “Review Of Deep Learning: Concepts, CNN Architectures, Challenges, Applications, Future Directions, ” Journal of Big Data, vol. 8, 53.
- H. Liu, M. Cocea, and W. Ding, “Decision Tree Learning Based Feature Evaluation and Selection for Image Classification, ” Proc. International Conference on Machine Learning and Cybernetics (ICMLC), 2017, pp. 569–574.
- F. Aaboub, H. Chamlal, and T. Ouaderhman, “Analysis of the Prediction Performance of Decision Tree-Based Algorithms, ” Proc. International Conference on Decision Aid Sciences and Applications (DASA), 2023, pp. 7–11.
- E. Alpaydin, Introduction to Machine Learning, MIT Press, 2014.
- T. Ghirmai, “Generating Laplace process with desired autocorrelation from Gaussian AR processes, ” Proc. IEEE Signal Processing and Signal Processing Education Workshop (SP/SPE), 2015, pp. 113–117.
- L. Yang, C. Heiselman, J. G. Quirk, and P. M. Djuric, “Class-Imbalanced Classifiers Using Ensembles of Gaussian Processes and Gaussian Process Latent Variable Models, ” in IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2021, pp. 3775–3779.
- Y. Li, S. Rao, A. Hassaïne, R. Ramakrishnan et al., “Deep Bayesian Gaussian Processes For Uncertainty Estimation in Electronic Health Records, ” Scientific Reports, vol. 11, no. 1, 20685, 2021.
- L. Shu, J. Xie, M. Yang, Z. Li, Z. Li, D. Liao, X. Xu, and X. Yang, ‘A Review of Emotion Recognition Using Physiological Signals, ” Sensors, vol. 18, no. 2018, 2074, doi: 10.3390/s18072074.
Language: English
Page range: 53 - 62
Submitted on: Jul 1, 2024
Accepted on: Sep 6, 2024
Published on: Jun 22, 2026
In partnership with: Paradigm Publishing Services
Publication frequency: 4 issues per year
Keywords:
Related subjects:
© 2026 Wan Mohd Bukhari Wan Daud, Adnan Kiral, Mohamed Osman Tokhi, Lee Chung Yee, Muhammad Muzhafar Mohammad Zawawi, published by Łukasiewicz Research Network – Industrial Research Institute for Automation and Measurements PIAP
This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License.