Attention-Based Fusion of EEG Spectrograms and Scalograms for Schizophrenia Detection Using Vision Transformers
By: Farah Shan and Shalini Z. Ninoria
References
- Khan, Farah Shan, and Shalini Z. Ninoria. "Predicting Cognitive Disorder Progression Using EEG Signals and Convolutional Neural Networks", In 2024 International Conference on Artificial Intelligence and Emerging Technology (Global AI Summit), pp. 102–107, 2024.
- Khan, Farah Shan, and Shalini Z. Ninoria. "Predicting Schizophrenia Using EEG Signals and Convolutional Long Short-Term Memory", In 2025 2nd International Conference on Research Methodologies in Knowledge Management, Artificial Intelligence and Telecommunication Engineering (RMKMATE), pp. 1-6, 2025.
- Griffin, Daniel, and Jae Lim. "Signal estimation from modified short-time Fourier transform", IEEE Transactions on acoustics, speech, and signal processing 32(2), pp. 236–243, 1984.
- Rioul, Olivier, and Pierre Duhamel. "Fast algorithms for discrete and continuous wavelet transforms", IEEE transactions on information theory 38(2), pp. 569–586, 2002.
- Hosseini, Mohammad-Parsa, Amin Hosseini, and Kiarash Ahi. "A review on machine learning for EEG signal processing in bioengineering." IEEE reviews in biomedical engineering 14, pp. 204–218, 2020.
- Wu, Youpeng, Lun Lu, Ao Xu, Yinan Wang, Zhiwei Li, Zhuanyi Yang, Lingli Zeng, and Qingjiang Li. "Neural networks for epilepsy detection and prediction with EEG signals: a systematic review." Artificial Intelligence Review 59(1), p. 30, 2026.
- Khan, Farah Shan, and Shalini Ninoria. "Predictive Modelling of Mental Disorders Using EEG Signal Analysis: A Review of DNN Approaches", Int. J. Intell. Commun. Comput. Sci. 1(2), pp. 37–53, 2023.
- Han, Kai, Yunhe Wang, Hanting Chen, Xinghao Chen, Jianyuan Guo, Zhenhua Liu, Yehui Tang et al. "A survey on vision transformer", IEEE transactions on pattern analysis and machine intelligence 45(1), pp. 87–110,2022.
- Dakka, Jumana, Pouya Bashivan, Mina Gheiratmand, Irina Rish, Shantenu Jha, and Russell Greiner. "Learning neural markers of schizophrenia disorder using recurrent neural networks", arXiv preprint arXiv:1712.00512 (2017).
- Phang, Chun-Ren, Fuad Noman, Hadri Hussain, Chee-Ming Ting, and Hernando Ombao. "A multi-domain connectome convolutional neural network for identifying schizophrenia from EEG connectivity patterns", IEEE journal of biomedical and health informatics 24(5), pp. 1333–1343, 2019.
- Palaniyappan, Lena, Gopikrishna Deshpande, Pradyumna Lanka, D. Rangaprakash, Sarina Iwabuchi, Susan Francis, and Peter F. Liddle. "Effective connectivity within a triple network brain system discriminates schizophrenia spectrum disorders from psychotic bipolar disorder at the single-subject level", Schizophrenia research 214, pp. 24-33, 2019.
- A. Nikhil Chandran, K. Sreekumar, and D. Subha, "EEG-based automated detection of schizophrenia using long short-term memory (LSTM) network", in Advances in Machine Learning and Computational Intelligence: Proceedings of ICMLCI 2019, pp. 229–236, 2021.
- J. Sun et al., "A hybrid deep neural network for classification of schizophrenia using EEG Data", Scientific Reports, 11(1), pp. 1–16, 2021.
- A. Shoeibi et al., "Automatic diagnosis of schizophrenia in EEG signals using CNN-LSTM models", Frontiers in neuroinformatics, p. 58, 2021.
- Z. Aslan and M. Akin, "A deep learning approach in automated detection of schizophrenia using scalogram images of EEG signals", Physical and Engineering Sciences in Medicine, 45(1), pp. 83–96, 2022.
- B. Gosala, P. D. Kapgate, P. Jain, R. N. Chaurasia, and M. Gupta, "Wavelet transforms for feature engineering in EEG data processing: An application on Schizophrenia", Biomedical Signal Processing and Control, 85, p. 104811, 2023.
- S. Siuly, Y. Guo, O. F. Alcin, Y. Li, P. Wen, and H. Wang, "Exploring deep residual network based features for automatic schizophrenia detection from EEG", Physical and Engineering Sciences in Medicine, 46(2), pp. 561–574, 2023.
- He, Kaiming, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. "Deep residual learning for image recognition", In Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 770–778. 2016.
- J. Gou, B. Yu, S. J. Maybank, and D. Tao, "Knowledge distillation: A survey", International Journal of Computer Vision, 129, pp. 1789-1819, 2021.
- Shim, Miseon, Han-Jeong Hwang, Do-Won Kim, Seung-Hwan Lee, and Chang-Hwan Im. "Machine-learning-based diagnosis of schizophrenia using combined sensor-level and source-level EEG features", Schizophrenia research 176(2-3), pp.314-319, 2016.
- V. Jahmunah et al., "Automated detection of schizophrenia using nonlinear signal processing methods", Artificial intelligence in medicine, 100, p. 101698, 2019.
- S. Bagherzadeh, M. S. Shahabi, and A. Shalbaf, "Detection of schizophrenia using hybrid of deep learning and brain effective connectivity image from electroencephalogram signal", Computers in Biology and Medicine, 146, p. 105570, 2022.
- M. Sharma and U. R. Acharya, "Automated detection of schizophrenia using optimal wavelet-based l 1 norm features extracted from single-channel EEG", Cognitive Neurodynamics, 15(4), pp. 661–674, 2021.
- Shoeibi, Afshin, Mahboobeh Jafari, Delaram Sadeghi, Roohallah Alizadehsani, Hamid Alinejad-Rokny, Amin Beheshti, and Juan M. Gorriz. "Early diagnosis of schizophrenia in EEG signals using one-dimensional transformer model", In International work-conference on the interplay between natural and artificial computation, pp. 139–149. Cham: Springer Nature Switzerland, 2024.
- Li, Beilin, Jiao Wang, Zhifen Guo, and Yue Li. "Automatic detection of schizophrenia based on spatial–temporal feature mapping and LeViT with EEG signals", Expert Systems with Applications, 224, p.119969,2023.
- Liu, Chang, Wanzhong Chen, and Mingyang Li. "A hybrid EEG classification model using layered cascade deep learning architecture", Medical & Biological Engineering & Computing 62(7), pp. 2213–2229, 2024.
- Wang, Yiping, Yanfeng Yang, Gongpeng Cao, Jinjie Guo, Penghu Wei, Tao Feng, Yang Dai, Jinguo Huang, Guixia Kang, and Guoguang Zhao. "SEEG-Net: An explainable and deep learning-based cross-subject pathological activity detection method for drug-resistant epilepsy", Computers in Biology and Medicine, 148, p.105703, 2022.
- "EEG in schizophrenia - IBIB PAN", Available at: https://repod.icm.edu.pl/dataset.xhtml?persistentId=doi:10.18150/repod.0107441 (Accessed on date: 20 Feb 2020).
- Olejarczyk, Elzbieta; Jernajczyk, Wojciech, 2017, "EEG in schizophrenia", Available at: https://doi.org/10.18150/repod.0107441, RepOD, V1. (Accessed on date: 20 Feb 2020).
- Hsu, Henry, and Peter A. Lachenbruch. "Paired t test." Wiley StatsRef: statistics reference online (2014).
- Woolson, Robert F. "Wilcoxon signed-rank test." Wiley encyclopedia of clinical trials, pp.1–3, 2007.
Language: English
Page range: 274 - 293
Published on: Jul 30, 2026
Published by: Cerebration Science Publishing Co., Limited
In partnership with: Paradigm Publishing Services
Publication frequency: Volume open
Keywords:
Related subjects:
© 2026 Farah Shan, Shalini Z. Ninoria, published by Cerebration Science Publishing Co., Limited
This work is licensed under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 License.