Neural Network Architecture for EEG Based Speech Activity Detection

Koctúrová, Marianna; Juhár, Jozef

doi:10.2478/aei-2021-0002

Abstract

In this paper, research focused on speech activity detection using brain EEG signals is presented. In addition to speech stimulation of brain activity, an innovative approach based on the simultaneous stimulation of the brain by visual stimuli such as reading and color naming has been used. Designing the solution, classification using two types of artificial neural networks were proposed: shallow Feed-forward Neural Network and deep Convolutional Neural Network. Experimental results of classification demonstrated F1 score 79.50% speech detection using shallow neural network and 84.39% speech detection using deep neural network based on cross-evaluated classification models.

References

[1] O.-O. S. B. Tools, “Openbci.com. retrieved 24 february 2018”, 2018. http://openbci.com
Search in Google Scholar Back to article
[2] JURCAK, V. – TSUZUKI, D. – DAN, I.: “10/20, 10/10, and 10/5 systems revisited: their validity as relative head-surface-based positioning systems”, Neuroimage, 2007, 34.4: 1600-1611.10.1016/j.neuroimage.2006.09.02417207640
Search in Google Scholar Back to article
[3] BHAKTA, K., et al.: “Fault diagnosis of induction motor bearing using cepstrum-based preprocessing and ensemble learning algorithm”, In: 2019 International Conference on Electrical, Computer and Communication Engineering (ECCE). IEEE, 2019. p. 1-6.10.1109/ECACE.2019.8679223
Search in Google Scholar Back to article
[4] SANEI, S. – CHAMBERS, J. A.: “EEG signal processing”, John Wiley & Sons, 2013.10.1002/9780470511923.ch2
Search in Google Scholar Back to article
[5] ALAS, F. – SOCOR, J. C. – SEVILLANO, X.: “A review of physical and perceptual feature extraction techniques for speech, music and environmental sounds”, Applied Sciences, 2016, 6.5: 143.10.3390/app6050143
Search in Google Scholar Back to article
[6] WOLPAW, J. – WOLPAW, E. (ed.): “Brain-computer interfaces: principles and practice”, OUP USA, 2012.10.1093/acprof:oso/9780195388855.001.0001
Search in Google Scholar Back to article
[7] BOUBCHIR, L. – DAACHI, B. – PANGRACIOUS, V.: “A review of feature extraction for EEG epileptic seizure detection and classification”, In: 2017 40th International Conference on Telecommunications and Signal Processing (TSP). IEEE, 2017. p. 456-460.10.1109/TSP.2017.8076027
Search in Google Scholar Back to article
[8] BOASHASH, B. – BARKI, H. – OUELHA, S.: “Performance evaluation of time-frequency image feature sets for improved classification and analysis of non-stationary signals: Application to newborn EEG seizure detection”, Knowledge-Based Systems, 2017, 132: 188-203.10.1016/j.knosys.2017.06.015
Search in Google Scholar Back to article
[9] DAS, B. B. et al.: “A spatio-temporal model for EEG-based person identification”, Multimedia Tools and Applications, 2019, 78.19: 28157-28177.10.1007/s11042-019-07905-6
Search in Google Scholar Back to article
[10] EL-FIQI, H. – WANG, M. – SALIMI, N. – KASMARIK, K. – BARLOW, M. – ABBASS, H.: “Convolution neural networks for person identification and verification using steady state visual evoked potential”, In: 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC). IEEE, 2018. p. 1062-1069.10.1109/SMC.2018.00188
Search in Google Scholar Back to article
[11] SCHIRRMEISTER, R. T. – SPRINGENBERG, J. T. – FIEDERER, L. – GLASSTETTER, M. – EGGENSPERGER, K. – TANGERMANN, M. – HUTTER, F. – BURGARD, W. – BALL, T.: “Deep learning with convolutional neural networks for EEG decoding and visualization”, Human brain mapping, 2017, 38.11: 5391-5420.10.1002/hbm.23730565578128782865
Search in Google Scholar Back to article
[12] KOCTUROVA, M. – JUHAR, J.: “A Novel Approach to EEG Speech Activity Detection with Visual Stimuli and Mobile BCI”, Applied Sciences, 2021, 11, 674. https://doi.org/10.3390/app11020674.10.3390/app11020674
Search in Google Scholar Back to article

Neural Network Architecture for EEG Based Speech Activity Detection

Abstract

Paradigm

My account