Skip to main content
Top

2021 | OriginalPaper | Chapter

Consumer Emotional State Evaluation Using EEG Based Emotion Recognition Using Deep Learning Approach

Authors : Rupali Gill, Jaiteg Singh

Published in: Advanced Computing

Publisher: Springer Singapore

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The standard methodologies for marketing (e.g., newspaper ads and tv commercials) are not effective in selling products as they do not excite the customers to buy any specific item. These methods of advertising try to ascertain their consumers’ attitude towards any product, which might not represent the actual behavior. So, the customer behavior is misunderstood by the advertisers and start-ups because the mindsets do not represent the buying behaviors of the consumers. Previous studies reflect that there is lack of experimental work done on classification and the prediction of their consumer emotional states. In this research, a strategy has been adopted to discover the customer emotional states by simply thinking about attributes and the power spectral density using EEG-based signals. The results revealed that, though the deep neural network (DNN) higher recall, greater precision, and accuracy compared with support vector machine (SVM) and k-nearest neighbor (k-NN), but random forest(RF) reaches values that were like deep learning on precisely the similar dataset.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
go back to reference Abdulkader, S.N.: Brain computer interfacing: applications and challenges. Egypt. Inform. J. 16(2), 213–230 (2015)CrossRef Abdulkader, S.N.: Brain computer interfacing: applications and challenges. Egypt. Inform. J. 16(2), 213–230 (2015)CrossRef
go back to reference Agarwal, S.: Neuromarketing and consumer neuroscience: current understanding and the way forward. Decision 457–462 (2015) Agarwal, S.: Neuromarketing and consumer neuroscience: current understanding and the way forward. Decision 457–462 (2015)
go back to reference Aldayel, M., Ykhlef, M., Al-Nafjan, A.: Deep learning for EEG-based preference classification in neuromarketing. Appl. Sci. 10(4), 1525–1548 (2020)CrossRef Aldayel, M., Ykhlef, M., Al-Nafjan, A.: Deep learning for EEG-based preference classification in neuromarketing. Appl. Sci. 10(4), 1525–1548 (2020)CrossRef
go back to reference Al-Nafjan, A., Hosny, M., Al-Ohali, Y., Al-Wabil, A.: Review and classification of emotion recognition based on EEG brain-computer interface system research: a systematic review. Appl. Sci. 7(12), 1239 (2017a)CrossRef Al-Nafjan, A., Hosny, M., Al-Ohali, Y., Al-Wabil, A.: Review and classification of emotion recognition based on EEG brain-computer interface system research: a systematic review. Appl. Sci. 7(12), 1239 (2017a)CrossRef
go back to reference Al-Nafjan, A., Hosny, M., Al-Wabil, A., Al-Ohali, Y.: Classification of human emotions from electroencephalogram (EEG) signal using deep neural network. Int. J. Adv. Comput. Sci. Appl. 8(9), 419–425 (2017b) Al-Nafjan, A., Hosny, M., Al-Wabil, A., Al-Ohali, Y.: Classification of human emotions from electroencephalogram (EEG) signal using deep neural network. Int. J. Adv. Comput. Sci. Appl. 8(9), 419–425 (2017b)
go back to reference Alvino, L.C.: Towards a better understanding of consumer behavior: marginal utility as a parameter in neuromarketing research. Int. J. Mark. Stud. 10(1), 90–106 (2018)CrossRef Alvino, L.C.: Towards a better understanding of consumer behavior: marginal utility as a parameter in neuromarketing research. Int. J. Mark. Stud. 10(1), 90–106 (2018)CrossRef
go back to reference Ameera, A., Saidatul, A., Ibrahim, Z.: Analysis of EEG spectrum bands using power spectral density for pleasure and displeasure state. In: IOP Conference Series: Materials Science and Engineering, vol. 557, no. 1, pp. 012030–01203. IOP Publishing (2019) Ameera, A., Saidatul, A., Ibrahim, Z.: Analysis of EEG spectrum bands using power spectral density for pleasure and displeasure state. In: IOP Conference Series: Materials Science and Engineering, vol. 557, no. 1, pp. 012030–01203. IOP Publishing (2019)
go back to reference Boksem, M.A.: Brain responses to movie trailers predict individual preferences for movies and their population-wide commercial success. J. Mark. Res. 52(4), 482–492 (2015)CrossRef Boksem, M.A.: Brain responses to movie trailers predict individual preferences for movies and their population-wide commercial success. J. Mark. Res. 52(4), 482–492 (2015)CrossRef
go back to reference Chew, L., Teo, J., Mountstephens, J.: Aesthetic preference recognition of 3D shapes using EEG. Cogn. Neurodyn. 10(2), 165–173 (2016)CrossRef Chew, L., Teo, J., Mountstephens, J.: Aesthetic preference recognition of 3D shapes using EEG. Cogn. Neurodyn. 10(2), 165–173 (2016)CrossRef
go back to reference Cherubino, P., et al.: Consumer behaviour through the eyes of neurophysiological measures: state-of-the-art and future trends. Comput. Intell. Neurosci. 1–41 (2019) Cherubino, P., et al.: Consumer behaviour through the eyes of neurophysiological measures: state-of-the-art and future trends. Comput. Intell. Neurosci. 1–41 (2019)
go back to reference Hadjidimitriou, S.K.: Toward an EEG-based recognition of music liking using time-frequency analysis. IEEE Trans. Biomed. Eng. 59(12), 3498–3510 (2012)CrossRef Hadjidimitriou, S.K.: Toward an EEG-based recognition of music liking using time-frequency analysis. IEEE Trans. Biomed. Eng. 59(12), 3498–3510 (2012)CrossRef
go back to reference Hakim, A.: A gateway to consumers’ minds: achievements, caveats, and prospects of electroencephalography-based prediction in neuromarketing. Wiley Interdisc. Rev. Cogn. Sci. 10(2), e1485 (2019)CrossRef Hakim, A.: A gateway to consumers’ minds: achievements, caveats, and prospects of electroencephalography-based prediction in neuromarketing. Wiley Interdisc. Rev. Cogn. Sci. 10(2), e1485 (2019)CrossRef
go back to reference Hammou, K.A.: The contributions of neuromarketing in marketing research. J. Manag. Res. 5(4), 20 (2013)CrossRef Hammou, K.A.: The contributions of neuromarketing in marketing research. J. Manag. Res. 5(4), 20 (2013)CrossRef
go back to reference Harris, J.M.: Consumer neuroscience for marketing researchers. J. Consum. Behav. 17(3), 239–252 (2018)CrossRef Harris, J.M.: Consumer neuroscience for marketing researchers. J. Consum. Behav. 17(3), 239–252 (2018)CrossRef
go back to reference Hwang, H.J.: EEG-based brain-computer ınterfaces: a thorough literature survey. Int. J. Hum.-Comput. Interact. 29(12), 814–826 (2013)CrossRef Hwang, H.J.: EEG-based brain-computer ınterfaces: a thorough literature survey. Int. J. Hum.-Comput. Interact. 29(12), 814–826 (2013)CrossRef
go back to reference Jenke, R., Peer, A., Buss, M.: Feature extraction and selection for emotion recognition from EEG. IEEE Trans. Affect. Comput. 5(3), 327–339 (2014)CrossRef Jenke, R., Peer, A., Buss, M.: Feature extraction and selection for emotion recognition from EEG. IEEE Trans. Affect. Comput. 5(3), 327–339 (2014)CrossRef
go back to reference Khushaba, R.N.: Consumer neuroscience: assessing the brain response to marketing stimuli using electroencephalogram (EEG) and eye tracking. Expert Syst. Appl. 40(9) (2013) Khushaba, R.N.: Consumer neuroscience: assessing the brain response to marketing stimuli using electroencephalogram (EEG) and eye tracking. Expert Syst. Appl. 40(9) (2013)
go back to reference Koelstra, S.M.: Deap: a database for emotion analysis; using physiological signals. IEEE Trans. Affect. Comput. 3(1), 18–31 (2011)CrossRef Koelstra, S.M.: Deap: a database for emotion analysis; using physiological signals. IEEE Trans. Affect. Comput. 3(1), 18–31 (2011)CrossRef
go back to reference Koelstra, S.P.: Fusion of facial expressions and EEG for implicit affective tagging. Image Vis. Comput. 31(2), 164–174 (2013)CrossRef Koelstra, S.P.: Fusion of facial expressions and EEG for implicit affective tagging. Image Vis. Comput. 31(2), 164–174 (2013)CrossRef
go back to reference Krampe, C.G.: The application of mobile fNIRS in marketing research—detecting the “first-choice-brand” effect. Front. Hum. Neurosci. 12, 433 (2018)CrossRef Krampe, C.G.: The application of mobile fNIRS in marketing research—detecting the “first-choice-brand” effect. Front. Hum. Neurosci. 12, 433 (2018)CrossRef
go back to reference Lin, M.H.: Applying EEG in consumer neuroscience. Eur. J. Mark. 52, 66–91 (2018)CrossRef Lin, M.H.: Applying EEG in consumer neuroscience. Eur. J. Mark. 52, 66–91 (2018)CrossRef
go back to reference Loke, K.S.: Object contour completion by combining object recognition and local edge cues. J. Inf. Commun. Technol. 16(2), 224–242 (2017)MathSciNet Loke, K.S.: Object contour completion by combining object recognition and local edge cues. J. Inf. Commun. Technol. 16(2), 224–242 (2017)MathSciNet
go back to reference Lotte, F., Bougrain, L.: A review of classification algorithms for EEG-based brain–computer interfaces: a 10 year update. J. Neural Eng. 15, 031005 (2018) Lotte, F., Bougrain, L.: A review of classification algorithms for EEG-based brain–computer interfaces: a 10 year update. J. Neural Eng. 15, 031005 (2018)
go back to reference Morin, C.: Neuromarketing: the new science of consumer behavior. Society 48(2), 131–136 (2011) Morin, C.: Neuromarketing: the new science of consumer behavior. Society 48(2), 131–136 (2011)
go back to reference Murugappan, M.M.: Wireless EEG signals based neuromarketing system using Fast Fourier Transform (FFT). In: 2014 IEEE 10th International Colloquium on Signal Processing and its Applications, pp. 25–30. IEEE (2014) Murugappan, M.M.: Wireless EEG signals based neuromarketing system using Fast Fourier Transform (FFT). In: 2014 IEEE 10th International Colloquium on Signal Processing and its Applications, pp. 25–30. IEEE (2014)
go back to reference Nezamfar, H.F.: A context-aware code-VEP based brain computer ınterface for daily life using EEG signals. Ph.D. Thesis, Northeastern University, Boston, MA, USA (2016) Nezamfar, H.F.: A context-aware code-VEP based brain computer ınterface for daily life using EEG signals. Ph.D. Thesis, Northeastern University, Boston, MA, USA (2016)
go back to reference Ohme, R.R.: Analysis of neurophysiological reactions to advertising stimuli by means of EEG and galvanic skin response measures. J. Neurosci. Psychol. Econ. 2, 21–31 (2009)CrossRef Ohme, R.R.: Analysis of neurophysiological reactions to advertising stimuli by means of EEG and galvanic skin response measures. J. Neurosci. Psychol. Econ. 2, 21–31 (2009)CrossRef
go back to reference Ohme, R.R.: Application of frontal EEG asymmetry to advertising research. J. Econ. Psychol. 31(5), 785–793 (2010)CrossRef Ohme, R.R.: Application of frontal EEG asymmetry to advertising research. J. Econ. Psychol. 31(5), 785–793 (2010)CrossRef
go back to reference Ramadan, R.A.: Brain computer interface: control signals review. Neurocomputing 223, 26–44 (2017)CrossRef Ramadan, R.A.: Brain computer interface: control signals review. Neurocomputing 223, 26–44 (2017)CrossRef
go back to reference Ramsøy, T.Z.-O.: Effects of perceptual uncertainty on arousal and preference across different visual domains. J. Neurosci. Psychol. Econ. 5(4), 212 (2012)CrossRef Ramsøy, T.Z.-O.: Effects of perceptual uncertainty on arousal and preference across different visual domains. J. Neurosci. Psychol. Econ. 5(4), 212 (2012)CrossRef
go back to reference Roy, Y.B.: Deep learning-based electroencephalography analysis: a systematic review. J. Neural Eng. 16(5), 051001 (2019)CrossRef Roy, Y.B.: Deep learning-based electroencephalography analysis: a systematic review. J. Neural Eng. 16(5), 051001 (2019)CrossRef
go back to reference Telpaz, A., Webb, R., Levy, D.: Using EEG to predict consumers’ future choices. J. Mark. Res. 52, 511–529 (2015)CrossRef Telpaz, A., Webb, R., Levy, D.: Using EEG to predict consumers’ future choices. J. Mark. Res. 52, 511–529 (2015)CrossRef
go back to reference Teo, J.C.: Classification of affective states via EEG and deep learning. Int. J. Adv. Comput. Sci. Appl. 9(5), 132–142 (2018a) Teo, J.C.: Classification of affective states via EEG and deep learning. Int. J. Adv. Comput. Sci. Appl. 9(5), 132–142 (2018a)
go back to reference Teo, J.H.: Deep learning for EEG-based preference classification. In: AIP Conference Proceedings, vol. 1891, p. 020141. AIP Publishing LLC (2017) Teo, J.H.: Deep learning for EEG-based preference classification. In: AIP Conference Proceedings, vol. 1891, p. 020141. AIP Publishing LLC (2017)
go back to reference Teo, J.H.: Preference classification using electroencephalography (EEG) and deep learning. J. Telecommun. Electron. Comput. Eng. (JTEC), 10(1–11), 87–91 (2018b) Teo, J.H.: Preference classification using electroencephalography (EEG) and deep learning. J. Telecommun. Electron. Comput. Eng. (JTEC), 10(1–11), 87–91 (2018b)
go back to reference Qin, X., Zheng, Y., Chen, B.: Extract EEG features by combining power spectral density and correntropy spectral density. In: 2019 Chinese Automation Congress (CAC), pp. 2455–2459. IEEE (2019) Qin, X., Zheng, Y., Chen, B.: Extract EEG features by combining power spectral density and correntropy spectral density. In: 2019 Chinese Automation Congress (CAC), pp. 2455–2459. IEEE (2019)
go back to reference Yadava, M.K.: Analysis of EEG signals and its application to neuromarketing. Multimed. Tools Appl. 76(18), 19087–19111 (2017)CrossRef Yadava, M.K.: Analysis of EEG signals and its application to neuromarketing. Multimed. Tools Appl. 76(18), 19087–19111 (2017)CrossRef
Metadata
Title
Consumer Emotional State Evaluation Using EEG Based Emotion Recognition Using Deep Learning Approach
Authors
Rupali Gill
Jaiteg Singh
Copyright Year
2021
Publisher
Springer Singapore
DOI
https://doi.org/10.1007/978-981-16-0401-0_9

Premium Partner