Abstract

It has been reported that the construction of emotion profiling models using supervised machine learning involves data acquisition, signal pre-processing, feature extraction and classification. However, almost all papers do not address the issue of profiling emotion using supervised machine learning on the interrupted encephalogram (EEG) signals. Based on a preliminary study, emotion profiling on interrupted EEG signals produces low classification accuracy, using multilayer perceptron (MLP). Furthermore, lower emotion classification accuracy is produced from interrupted EEG signals with higher number of segments. Thus, the objective of this paper is to propose a technique and present the outcomes of handling interrupted EEG signals for emotion profiling. This is done by the suppression and interpolation of originally interrupted EEG signals at pre-process stage. As a result, emotion classification using MLP on interpolated data improves from 80.1% to 95%.

Keyword

Interrupted EEG, Interpolation, Emotion classification, Power spectral density.

Cite this article

Yaacob H, Omar H, Handayani D, Hassan R

Refference

[1][1]Yuen CT, San San W, Ho JH, Rizon M. Effectiveness of statistical features for human emotions classification using EEG biosensors. Research Journal of Applied Sciences, Engineering and Technology. 2013; 5(21):5083-9.

[2][2]Mampusti ET, Ng JS, Quinto JJ, Teng GL, Suarez MT, Trogo RS. Measuring academic affective states of students via brainwave signals. In third international conference on knowledge and systems engineering 2011 (pp. 226-31). IEEE.

[3][3]Othman M, Wahab A, Karim I, Dzulkifli MA, Alshaikli IF. EEG emotion recognition based on the dimensional models of emotions. Procedia-Social and Behavioral Sciences. 2013; 97:30-7.

[4][4]Rahnuma KS, Wahab A, Kamaruddin N, Majid H. EEG analysis for understanding stress based on affective model basis function. In 15th international symposium on consumer electronics (ISCE) 2011 (pp. 592-7). IEEE.

[5][5]Zhang Q, Lee M. Emotion development system by interacting with human EEG and natural scene understanding. Cognitive Systems Research. 2012; 14(1):37-49.

[6][6]Yaacob H, Wahab A. Affective state classification through CMAC-based model of affects (CCMA) using SVM. Advanced Science Letters. 2017; 23(11):11369-73.

[7][7]Mert A, Akan A. Emotion recognition from EEG signals by using multivariate empirical mode decomposition. Pattern Analysis and Applications. 2018; 21(1):81-9.

[8][8]Liu S, Tong J, Meng J, Yang J, Zhao X, He F, et al. Study on an effective cross-stimulus emotion recognition model using EEGs based on feature selection and support vector machine. International Journal of Machine Learning and Cybernetics. 2018; 9(5):721-6.

[9][9]Soleymani M, Pantic M, Pun T. Multimodal emotion recognition in response to videos. IEEE Transactions on Affective Computing. 2012; 3(2):211-23.

[10][10]Yoon HJ, Chung SY. EEG-based emotion estimation using Bayesian weighted-log-posterior function and perceptron convergence algorithm. Computers in Biology and Medicine. 2013; 43(12):2230-7.

[11][11]Nie D, Wang XW, Shi LC, Lu BL. EEG-based emotion recognition during watching movies. In 5th international IEEE/EMBS conference on neural engineering 2011 (pp. 667-70). IEEE.

[12][12]Nor NM, Salleh SH, Zubaidi A. Understanding teacher stress when teaching the developed technology by using electroencephalogram (EEG) signals. Journal of Applied and Physical Sciences. 2016; 2(3):65-76.

[13][13]Bhatti AM, Majid M, Anwar SM, Khan B. Human emotion recognition and analysis in response to audio music using brain signals. Computers in Human Behavior. 2016; 65:267-75.

[14][14]Murugappan M, Juhari MR, Nagarajan R, Yaacob S. An investigation on visual and audiovisual stimulus based emotion recognition using EEG. International Journal of Medical Engineering and Informatics. 2009; 1(3):342-56.

[15][15]Liu YJ, Yu M, Zhao G, Song J, Ge Y, Shi Y. Real-time movie-induced discrete emotion recognition from EEG signals. IEEE Transactions on Affective Computing. 2018; 9(4):550-62.

[16][16]Bastos-Filho TF, Ferreira A, Atencio AC, Arjunan S, Kumar D. Evaluation of feature extraction techniques in emotional state recognition. In 4th international conference on intelligent human computer interaction (IHCI) 2012 (pp. 1-6). IEEE.

[17][17]Mutasim AK, Tipu RS, Bashar MR, Amin MA. Video category classification using wireless EEG. In international conference on brain informatics 2017 (pp. 39-48). Springer, Cham.

[18][18]Song T, Zheng W, Song P, Cui Z. EEG emotion recognition using dynamical graph convolutional neural networks. IEEE Transactions on Affective Computing. 2018.

[19][19]Alarcao SM, Fonseca MJ. Emotions recognition using EEG signals: a survey. IEEE Transactions on Affective Computing. 2017.

[20][20]Lang PJ. International affective picture system (IAPS): affective ratings of pictures and instruction manual. Technical Report. 2005.

[21][21]Liu YH, Wu CT, Kao YH, Chen YT. Single-trial EEG-based emotion recognition using kernel Eigen-emotion pattern and adaptive support vector machine. In annual international conference of the engineering in medicine and biology society (EMBC) 2013 (pp. 4306-9). IEEE.

[22][22]Khalili Z, Moradi MH. Emotion detection using brain and peripheral signals. In cairo international biomedical engineering conference 2008 (pp. 1-4). IEEE.

[23][23]Hosseini SA, Khalilzadeh MA. Emotional stress recognition system using EEG and psychophysiological signals: using new labelling process of EEG signals in emotional stress state. In international conference on biomedical engineering and computer science 2010 (pp. 1-6). IEEE.

[24][24]Hosseini SA, Naghibi-Sistani MB. Emotion recognition method using entropy analysis of EEG signals. International Journal of Image, Graphics and Signal Processing. 2011; 3(5):30-6.

[25][25]Chanel G, Kronegg J, Grandjean D, Pun T. Emotion assessment: Arousal evaluation using EEG’s and peripheral physiological signals. In international workshop on multimedia content representation, classification and security 2006 (pp. 530-7). Springer, Berlin, Heidelberg.

[26][26]Lee YY, Hsieh S. Classifying different emotional states by means of EEG-based functional connectivity patterns. PloS one. 2014; 9(4):e95415.

[27][27]Handayani D, Wahab A, Yaacob H. Evaluation of feature extraction and classification techniques for EEG-based subject identification. Jurnal Teknologi. 2016; 78(9-3):41-8.

[28][28]Nakisa B, Rastgoo MN, Tjondronegoro D, Chandran V. Evolutionary computation algorithms for feature selection of EEG-based emotion recognition using mobile sensors. Expert Systems with Applications. 2018; 93:143-55.

[29][29]Semmlow J. Signals and systems for bioengineers: a MATLAB-based introduction. Academic Press; 2011.

[30][30]Niedermeyer E, da Silva FL. Electroencephalography: basic principles, clinical applications, and related fields. Lippincott Williams & Wilkins; 2005.

[31][31]Russell JA. A circumplex model of affect. Journal of Personality and Social Psychology. 1980; 39(6):1161-78.