Skip to main content
Erschienen in: International Journal of Machine Learning and Cybernetics 3/2021

14.10.2020 | Original Article

A knowledge discovery and visualisation method for unearthing emotional states from physiological data

verfasst von: Nectarios Costadopoulos, Md Zahidul Islam, David Tien

Erschienen in: International Journal of Machine Learning and Cybernetics | Ausgabe 3/2021

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this paper we propose a knowledge discovery and visualisation method for unearthing emotional states from physiological data typically available from wearable devices. In addition we investigate the viability of using a limited set of wearable sensors to extract decision tree rules which are representative of physiological changes taking place during emotional changes. Our method utilised a fusion of pre-processing and classification techniques using decision trees to discover logic rules relating to the valence and arousal emotional dimensions. This approach normalised the signal data in a manner that enabled accurate classification and generated logic rules for knowledge discovery. Furthermore, the use of three target classes for the emotional dimensions was effective at denoising the data and further enhancing classification and useful rule extraction. There are three key contributions in this work, firstly an exploration and validation of our knowledge discovery methodology, secondly successful extraction of high accuracy rules derived from physiological data and thirdly knowledge discovery and visualisation of relationships within-participant physiological data that can be inferred relating to emotions. Additionally, this work may be utilised in areas such as the medical sciences where interpretable rules are required for knowledge discovery.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Weitere Produktempfehlungen anzeigen
Literatur
1.
Zurück zum Zitat Adnan MN, Islam MZ (2016) Knowledge discovery from a data set on dementia through decision forest. In: The 14th Australasian Data Mining Conference: AusDM 2016. CRPIT, pp 1–8 Adnan MN, Islam MZ (2016) Knowledge discovery from a data set on dementia through decision forest. In: The 14th Australasian Data Mining Conference: AusDM 2016. CRPIT, pp 1–8
2.
Zurück zum Zitat Adnan MN, Islam MZ (2017) ForEx++: a new framework for knowledge discovery from decision forests. Aust J Inform Syst 21:1–20 Adnan MN, Islam MZ (2017) ForEx++: a new framework for knowledge discovery from decision forests. Aust J Inform Syst 21:1–20
4.
Zurück zum Zitat Aydin SG, Kaya T, Guler H (2016) Wavelet-based study of valence–arousal model of emotions on EEG signals with LabVIEW. Brain Inform 3:109–117CrossRef Aydin SG, Kaya T, Guler H (2016) Wavelet-based study of valence–arousal model of emotions on EEG signals with LabVIEW. Brain Inform 3:109–117CrossRef
5.
Zurück zum Zitat Banaee H, Ahmed MU, Loutfi A (2013) Data mining for wearable sensors in health monitoring systems: a review of recent trends and challenges. Sensors 13:17472–17500CrossRef Banaee H, Ahmed MU, Loutfi A (2013) Data mining for wearable sensors in health monitoring systems: a review of recent trends and challenges. Sensors 13:17472–17500CrossRef
8.
Zurück zum Zitat Calvo RA, D'Mello S (2010) Affect detection: an interdisciplinary review of models, methods, and their applications. IEEE Trans Affect Comput 1:18–37CrossRef Calvo RA, D'Mello S (2010) Affect detection: an interdisciplinary review of models, methods, and their applications. IEEE Trans Affect Comput 1:18–37CrossRef
11.
Zurück zum Zitat Costadopoulos N, Islam MZ, Tien D (2019a) Data mining and knowledge discovery from physiological sensors. In: Paper presented at the pervasive technologies related to assistive environments (PETRA), Rhodes, Greece, June 5–7, 2019 Costadopoulos N, Islam MZ, Tien D (2019a) Data mining and knowledge discovery from physiological sensors. In: Paper presented at the pervasive technologies related to assistive environments (PETRA), Rhodes, Greece, June 5–7, 2019
12.
Zurück zum Zitat Costadopoulos N, Islam MZ, Tien D (2019b) Discovering emotional logic rules from physiological data of individuals. In: Paper presented at the international conference on machine learning and cybernetics (ICMLC), Kobe, Japan, July 7–10, 2019 Costadopoulos N, Islam MZ, Tien D (2019b) Discovering emotional logic rules from physiological data of individuals. In: Paper presented at the international conference on machine learning and cybernetics (ICMLC), Kobe, Japan, July 7–10, 2019
13.
Zurück zum Zitat Costadopoulos N, Islam MZ, Tien D (2019c) Using Z-score to Extract Human Readable Logic Rules from Physiological Data. In: Paper presented at the (Accepted/In press) 11th IEEE international conference on knowledge and systems engineering (KSE) Da Nang, Vietnam, October 24–26, 2019 Costadopoulos N, Islam MZ, Tien D (2019c) Using Z-score to Extract Human Readable Logic Rules from Physiological Data. In: Paper presented at the (Accepted/In press) 11th IEEE international conference on knowledge and systems engineering (KSE) Da Nang, Vietnam, October 24–26, 2019
17.
Zurück zum Zitat Fallen E (2000) Hidden rhythms in the heart rate record: a primer on neurocardiology. Clin Invest Med 23:339–394 Fallen E (2000) Hidden rhythms in the heart rate record: a primer on neurocardiology. Clin Invest Med 23:339–394
18.
Zurück zum Zitat Fang Y, Zhou D, Li K, Ju Z, Liu H (2019) Attribute-driven granular model for EMG-based pinch and fingertip force grand recognition. IEEE Trans Cybern Fang Y, Zhou D, Li K, Ju Z, Liu H (2019) Attribute-driven granular model for EMG-based pinch and fingertip force grand recognition. IEEE Trans Cybern
20.
Zurück zum Zitat Fletcher S, Islam MZ (2017) Measuring rule retention in anonymized data-when one measure is not enough. Trans Data Priv 10:175–201 Fletcher S, Islam MZ (2017) Measuring rule retention in anonymized data-when one measure is not enough. Trans Data Priv 10:175–201
21.
Zurück zum Zitat Geng L, Hamilton HJ (2006) Interestingness measures for data mining: a survey. ACM Comput Surv (CSUR) 38:9CrossRef Geng L, Hamilton HJ (2006) Interestingness measures for data mining: a survey. ACM Comput Surv (CSUR) 38:9CrossRef
24.
Zurück zum Zitat Holmes G, Donkin A, Witten IH (1994) Weka: a machine learning workbench. Paper presented at the proceedings of ANZIIS'94-Australian New Zealand intelligent information systems conference Holmes G, Donkin A, Witten IH (1994) Weka: a machine learning workbench. Paper presented at the proceedings of ANZIIS'94-Australian New Zealand intelligent information systems conference
25.
Zurück zum Zitat Hong L, Cai J (2010) The application guide of mixed programming between MATLAB and other programming languages. 2010 Hong L, Cai J (2010) The application guide of mixed programming between MATLAB and other programming languages. 2010
26.
Zurück zum Zitat Hui T, Sherratt R (2018) Coverage of emotion recognition for common wearable biosensors. Biosensors 8:30CrossRef Hui T, Sherratt R (2018) Coverage of emotion recognition for common wearable biosensors. Biosensors 8:30CrossRef
27.
Zurück zum Zitat IDC (2020) Earwear and wristbands drive first quarter growth in the worldwide wearables market says IDC. IDC, Melbourne IDC (2020) Earwear and wristbands drive first quarter growth in the worldwide wearables market says IDC. IDC, Melbourne
28.
Zurück zum Zitat Jain A, Nandakumar K, Ross A (2005) Score normalization in multimodal biometric systems. Pattern Recogn 38:2270–2285CrossRef Jain A, Nandakumar K, Ross A (2005) Score normalization in multimodal biometric systems. Pattern Recogn 38:2270–2285CrossRef
29.
Zurück zum Zitat Jenke R, Peer A, Buss M (2014) Feature extraction and selection for emotion recognition from EEG. IEEE Trans Affect Comput 5:327–339CrossRef Jenke R, Peer A, Buss M (2014) Feature extraction and selection for emotion recognition from EEG. IEEE Trans Affect Comput 5:327–339CrossRef
30.
Zurück zum Zitat Jirayucharoensak S, Pan-Ngum S, Israsena P (2014) EEG-based emotion recognition using deep learning network with principal component based covariate shift adaptation. Sci World J 2014 Jirayucharoensak S, Pan-Ngum S, Israsena P (2014) EEG-based emotion recognition using deep learning network with principal component based covariate shift adaptation. Sci World J 2014
36.
Zurück zum Zitat Mavadati SM, Mahoor MH, Bartlett K, Trinh P, Cohn JF (2013) Disfa: a spontaneous facial action intensity database. IEEE Trans Affect Comput 4:151–160CrossRef Mavadati SM, Mahoor MH, Bartlett K, Trinh P, Cohn JF (2013) Disfa: a spontaneous facial action intensity database. IEEE Trans Affect Comput 4:151–160CrossRef
37.
Zurück zum Zitat McGarry K (2005) A survey of interestingness measures for knowledge discovery. Knowl Eng Rev 20:39–61CrossRef McGarry K (2005) A survey of interestingness measures for knowledge discovery. Knowl Eng Rev 20:39–61CrossRef
43.
Zurück zum Zitat Picard RW (1995) Affective computing. In: Paper presented at the MIT Media Laboratory Perceptual Computing Section Technical Report Picard RW (1995) Affective computing. In: Paper presented at the MIT Media Laboratory Perceptual Computing Section Technical Report
44.
Zurück zum Zitat Quinlan JR (1993) C4.5: programs for machine learning. Morgan Kaufmann Publishers Inc, San Francisco Quinlan JR (1993) C4.5: programs for machine learning. Morgan Kaufmann Publishers Inc, San Francisco
45.
Zurück zum Zitat Rhodes BJ, Minar N, Weaver J (1999) Wearable computing meets ubiquitous computing reaping the best of both worlds. In: The Third International Symposium on Wearable Computers (ISWC '99), San Francisco, CA, October 18–19 1999 1999. San Francisco, CA, pp pp. 141–149 Rhodes BJ, Minar N, Weaver J (1999) Wearable computing meets ubiquitous computing reaping the best of both worlds. In: The Third International Symposium on Wearable Computers (ISWC '99), San Francisco, CA, October 18–19 1999 1999. San Francisco, CA, pp pp. 141–149
46.
Zurück zum Zitat Ruiz-Rodríguez J (2013) Innovative continuous non-invasive cuffless blood pressure monitoring based on photoplethysmography technology. Intensive Care Med 1618–1625 Ruiz-Rodríguez J (2013) Innovative continuous non-invasive cuffless blood pressure monitoring based on photoplethysmography technology. Intensive Care Med 1618–1625
47.
Zurück zum Zitat Salzberg SL (1994) C4.5: Programs for machine learning by j. ross quinlan. Morgan Kaufmann Publishers, Inc., 1993 Machine Learning 16:235–240 Salzberg SL (1994) C4.5: Programs for machine learning by j. ross quinlan. Morgan Kaufmann Publishers, Inc., 1993 Machine Learning 16:235–240
48.
Zurück zum Zitat Sarkar S, Bhoi AK, Savita G (2012) Fingertip pulse wave (PPG signal) analysis and heart rate detection. Int J Emerg Technol Adv Eng 2:404–408 Sarkar S, Bhoi AK, Savita G (2012) Fingertip pulse wave (PPG signal) analysis and heart rate detection. Int J Emerg Technol Adv Eng 2:404–408
49.
Zurück zum Zitat Sarker R, Abbass H, Newton C (2002) Introducing data mining and knowledge discovery. Heuristic and optimization for knowledge discovery. IGI Global, Pennsylvania, pp 1–12 Sarker R, Abbass H, Newton C (2002) Introducing data mining and knowledge discovery. Heuristic and optimization for knowledge discovery. IGI Global, Pennsylvania, pp 1–12
50.
Zurück zum Zitat Smets E et al (2018) Large-scale wearable data reveal digital phenotypes for daily-life stress detection. NPJ Digital Med 1:67CrossRef Smets E et al (2018) Large-scale wearable data reveal digital phenotypes for daily-life stress detection. NPJ Digital Med 1:67CrossRef
51.
Zurück zum Zitat Soleymani M, Koelstra S, Patras I, Pun T (2011) Continuous emotion detection in response to music videos. In: Paper presented at the Face and Gesture Soleymani M, Koelstra S, Patras I, Pun T (2011) Continuous emotion detection in response to music videos. In: Paper presented at the Face and Gesture
52.
Zurück zum Zitat Soleymani M, Lichtenauer J, Pun T, Pantic M (2012) A multimodal database for affect recognition and implicit tagging. IEEE Trans Affect Comput 3:42–55CrossRef Soleymani M, Lichtenauer J, Pun T, Pantic M (2012) A multimodal database for affect recognition and implicit tagging. IEEE Trans Affect Comput 3:42–55CrossRef
53.
Zurück zum Zitat Wang D, Shang Y (2013) Modeling physiological data with deep belief networks. Int J Inform Edu Technol (IJIET) 3:505 Wang D, Shang Y (2013) Modeling physiological data with deep belief networks. Int J Inform Edu Technol (IJIET) 3:505
Metadaten
Titel
A knowledge discovery and visualisation method for unearthing emotional states from physiological data
verfasst von
Nectarios Costadopoulos
Md Zahidul Islam
David Tien
Publikationsdatum
14.10.2020
Verlag
Springer Berlin Heidelberg
Erschienen in
International Journal of Machine Learning and Cybernetics / Ausgabe 3/2021
Print ISSN: 1868-8071
Elektronische ISSN: 1868-808X
DOI
https://doi.org/10.1007/s13042-020-01205-4

Weitere Artikel der Ausgabe 3/2021

International Journal of Machine Learning and Cybernetics 3/2021 Zur Ausgabe

Neuer Inhalt