Skip to main content
Top

2017 | OriginalPaper | Chapter

Toward an Open Data Repository and Meta-Analysis of Cognitive Data Using fNIRS Studies of Emotion

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

HCI research has increasingly incorporated the use of neurophysiological sensors to identify users’ cognitive and affective states. However, a persistent problem in machine learning on cognitive data is generalizability across participants. A proposed solution has been aggregating cognitive and survey data across studies to generate higher sample populations for machine learning and statistical analyses to converge in stable, generalizable results. In this paper, I argue that large data-sharing projects can facilitate the aggregation of results of brain imaging studies to address these issues, by smoothing noise in high-dimensional datasets. This paper contributes a small step towards large cognitive data sharing systems-design by proposing methods that facilitate the merging of currently incompatible fNIRS and FMRI datasets through term-based metadata analysis. To that end, I analyze 20 fNIRS studies of emotion using content analysis for: (1) synonym terms and definitions for ‘emotion,’ (2) the experimental stimuli, and (3) the use or non-use of self-report surveys. Results suggest that fNIRS studies of emotion have stable synonymy, using technical and folk conceptualizations of affective terms within and between publications to refer to emotion. The studies use different stimuli to elicit emotion but also show commonalities between shared use of standardized stimuli materials and self-report surveys. These similarities in conceptual synonymy and standardized experiment materials indicate promise for neuroimaging communities to establish open-data repositories based on metadata term-based analyses. This work contributes to efforts toward merging datasets across studies and between labs, unifying new modalities in neuroimaging such as fNIRS with fMRI datasets, increasing generalizability of machine learning models, and promoting the acceleration of science through open data-sharing infrastructure.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
go back to reference Abdul Serwadda, V.P.: fNIRS: A New Modality for Brain Activity-Based Biometric Authentication (2015) Abdul Serwadda, V.P.: fNIRS: A New Modality for Brain Activity-Based Biometric Authentication (2015)
go back to reference Adolphs, R., Damasio, H., Tranel, D., Damasio, A.R.: Cortical systems for the recognition of emotion in facial expressions. J. Neurosci. 16(23), 7678–7687 (1996) Adolphs, R., Damasio, H., Tranel, D., Damasio, A.R.: Cortical systems for the recognition of emotion in facial expressions. J. Neurosci. 16(23), 7678–7687 (1996)
go back to reference Association, W.M., et al.: World medical association declaration of Helsinki. Ethical principles for medical research involving human subjects. Nurs. Ethics 9(1), 105 (2002)CrossRef Association, W.M., et al.: World medical association declaration of Helsinki. Ethical principles for medical research involving human subjects. Nurs. Ethics 9(1), 105 (2002)CrossRef
go back to reference Bigliassi, M., Barreto-Silva, V., Altimari, L.R., Vandoni, M., Codrons, E., Buzzachera, C.F.: How motivational and calm music may affect the prefrontal cortex area and emotional responses: a functional near-infrared spectroscopy (fNIRS) study. Percept. Mot. Skills 120(1), 202–218 (2015). doi:https://doi.org/10.2466/27.24.PMS.120v12x5 Bigliassi, M., Barreto-Silva, V., Altimari, L.R., Vandoni, M., Codrons, E., Buzzachera, C.F.: How motivational and calm music may affect the prefrontal cortex area and emotional responses: a functional near-infrared spectroscopy (fNIRS) study. Percept. Mot. Skills 120(1), 202–218 (2015). doi:https://​doi.​org/​10.​2466/​27.​24.​PMS.​120v12x5
go back to reference Blair, R.J.R., Morris, J.S., Frith, C.D., Perrett, D.I., Dolan, R.J.: Dissociable neural responses to facial expressions of sadness and anger. Brain 122(5), 883–893 (1999)CrossRef Blair, R.J.R., Morris, J.S., Frith, C.D., Perrett, D.I., Dolan, R.J.: Dissociable neural responses to facial expressions of sadness and anger. Brain 122(5), 883–893 (1999)CrossRef
go back to reference Blood, A.J., Zatorre, R.J., Bermudez, P., Evans, A.C.: Emotional responses to pleasant and unpleasant music correlate with activity in paralimbic brain regions. Nat. Neurosci. 2(4), 382–387 (1999). doi:https://doi.org/10.1038/7299 Blood, A.J., Zatorre, R.J., Bermudez, P., Evans, A.C.: Emotional responses to pleasant and unpleasant music correlate with activity in paralimbic brain regions. Nat. Neurosci. 2(4), 382–387 (1999). doi:https://​doi.​org/​10.​1038/​7299
go back to reference Bradley, M., Lang, P.J.: Measuring emotion: the self-assessment manikin and the semantic differential. J. Behav. Ther. Exp. Psychiatry 25(1), 49–59 (1994)CrossRef Bradley, M., Lang, P.J.: Measuring emotion: the self-assessment manikin and the semantic differential. J. Behav. Ther. Exp. Psychiatry 25(1), 49–59 (1994)CrossRef
go back to reference Breiter, H.C., Etcoff, N.L., Whalen, P.J., Kennedy, W.A., Rauch, S.L., Buckner, R.L., Rosen, B.R.: Response and habituation of the human amygdala during visual processing of facial expression. Neuron 17(5), 875–887 (1996)CrossRef Breiter, H.C., Etcoff, N.L., Whalen, P.J., Kennedy, W.A., Rauch, S.L., Buckner, R.L., Rosen, B.R.: Response and habituation of the human amygdala during visual processing of facial expression. Neuron 17(5), 875–887 (1996)CrossRef
go back to reference Bunce, S., Izzetoglu, M., Izzetoglu, K., Onaral, B., Pourrezaei, K.: Functional near infrared spectroscopy: an emerging neuroimaging modality. IEEE Eng. Med. Biol. Mag. Special Issue Clin. Neuroeng. 25(4), 54–62 (2006)CrossRef Bunce, S., Izzetoglu, M., Izzetoglu, K., Onaral, B., Pourrezaei, K.: Functional near infrared spectroscopy: an emerging neuroimaging modality. IEEE Eng. Med. Biol. Mag. Special Issue Clin. Neuroeng. 25(4), 54–62 (2006)CrossRef
go back to reference Costa, M., Bratt, S.: Truthiness: challenges associated with employing machine learning on neurophysiological sensor data. In: Schmorrow, D.D., Fidopiastis, C.M. (eds.) AC 2016. LNCS (LNAI), vol. 9743, pp. 159–164. Springer, Cham (2016). doi:10.1007/978-3-319-39955-3_15 Costa, M., Bratt, S.: Truthiness: challenges associated with employing machine learning on neurophysiological sensor data. In: Schmorrow, D.D., Fidopiastis, C.M. (eds.) AC 2016. LNCS (LNAI), vol. 9743, pp. 159–164. Springer, Cham (2016). doi:10.​1007/​978-3-319-39955-3_​15
go back to reference Edwards, A.: The relationship between the judged desirability of a trait and the probability that the trait will be endorsed. J. Appl. Psychol. 37, 90–93 (1953)CrossRef Edwards, A.: The relationship between the judged desirability of a trait and the probability that the trait will be endorsed. J. Appl. Psychol. 37, 90–93 (1953)CrossRef
go back to reference Elo, S., Kyngäs, H.: The qualitative content analysis process. J. Adv. Nurs. 62(1), 107–115 (2008)CrossRef Elo, S., Kyngäs, H.: The qualitative content analysis process. J. Adv. Nurs. 62(1), 107–115 (2008)CrossRef
go back to reference Ernst, L.H., Plichta, M.M., Lutz, E., Zesewitz, A.K., Tupak, S.V., Dresler, T., Fallgatter, A.J.: Prefrontal activation patterns of automatic and regulated approach-avoidance reactions - a functional near-infrared spectroscopy (fNIRS) study. Cortex; J. Devoted Study Nerv. Syst. Behav. 49(1), 131–142 (2013). doi:https://doi.org/10.1016/j.cortex.2011.09.013 Ernst, L.H., Plichta, M.M., Lutz, E., Zesewitz, A.K., Tupak, S.V., Dresler, T., Fallgatter, A.J.: Prefrontal activation patterns of automatic and regulated approach-avoidance reactions - a functional near-infrared spectroscopy (fNIRS) study. Cortex; J. Devoted Study Nerv. Syst. Behav. 49(1), 131–142 (2013). doi:https://​doi.​org/​10.​1016/​j.​cortex.​2011.​09.​013
go back to reference Glotzbach, E., Mühlberger, A., Gschwendtner, K., Fallgatter, A.J., Pauli, P., Herrmann, M.J.: Prefrontal brain activation during emotional processing: a functional near infrared spectroscopy study (fNIRS). Open Neuroimaging J. 5, 33–39 (2011). doi:https://doi.org/10.2174/1874440001105010033 Glotzbach, E., Mühlberger, A., Gschwendtner, K., Fallgatter, A.J., Pauli, P., Herrmann, M.J.: Prefrontal brain activation during emotional processing: a functional near infrared spectroscopy study (fNIRS). Open Neuroimaging J. 5, 33–39 (2011). doi:https://​doi.​org/​10.​2174/​1874440001105010​033
go back to reference Gorini, A., Mosso, J.L., Mosso, D., Pineda, E., Ruíz, N.L., Ramíez, M., Riva, G.: Emotional response to virtual reality exposure across different cultures: the role of the attribution process. Cyberpsychol. Behav.: Impact Internet, Multimedia Virtual Real. Behav. Soc. 12(6), 699–705 (2009). doi:https://doi.org/10.1089/cpb.2009.0192 Gorini, A., Mosso, J.L., Mosso, D., Pineda, E., Ruíz, N.L., Ramíez, M., Riva, G.: Emotional response to virtual reality exposure across different cultures: the role of the attribution process. Cyberpsychol. Behav.: Impact Internet, Multimedia Virtual Real. Behav. Soc. 12(6), 699–705 (2009). doi:https://​doi.​org/​10.​1089/​cpb.​2009.​0192
go back to reference Grimes, D., Tan, D.S., Hudson, S.E., Shenoy, P., Rao, R.P.N.: Feasibility and pragmatics of classifying working memory load with an electroencephalograph. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 835–844. ACM, New York (2008). doi:https://doi.org/10.1145/1357054.1357187 Grimes, D., Tan, D.S., Hudson, S.E., Shenoy, P., Rao, R.P.N.: Feasibility and pragmatics of classifying working memory load with an electroencephalograph. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 835–844. ACM, New York (2008). doi:https://​doi.​org/​10.​1145/​1357054.​1357187
go back to reference Hengehold, L.: “My body, this paper, this fire”: the fate of emotion in Foucault’s Kantian legacy. Philos. Today 47, 45–55 (2003)CrossRef Hengehold, L.: “My body, this paper, this fire”: the fate of emotion in Foucault’s Kantian legacy. Philos. Today 47, 45–55 (2003)CrossRef
go back to reference Kassam, K.S., Markey, A.R., Cherkassky, V.L., Loewenstein, G., Just, M.A.: Identifying emotions on the basis of neural activation. PLoS ONE 8(6), e66032 (2013)CrossRef Kassam, K.S., Markey, A.R., Cherkassky, V.L., Loewenstein, G., Just, M.A.: Identifying emotions on the basis of neural activation. PLoS ONE 8(6), e66032 (2013)CrossRef
go back to reference Leon-Carrion, J., Damas, J., Izzetoglu, K., Pourrezai, K., Martín-Rodríguez, J.F., Barroso y Martin, J.M., Dominguez-Morales, M.R.: Differential time course and intensity of PFC activation for men and women in response to emotional stimuli: a functional near-infrared spectroscopy (fNIRS) study. Neurosci. Lett. 403(1–2), 90–95 (2006). doi:https://doi.org/10.1016/j.neulet.2006.04.050 Leon-Carrion, J., Damas, J., Izzetoglu, K., Pourrezai, K., Martín-Rodríguez, J.F., Barroso y Martin, J.M., Dominguez-Morales, M.R.: Differential time course and intensity of PFC activation for men and women in response to emotional stimuli: a functional near-infrared spectroscopy (fNIRS) study. Neurosci. Lett. 403(1–2), 90–95 (2006). doi:https://​doi.​org/​10.​1016/​j.​neulet.​2006.​04.​050
go back to reference León-Carrión, J., Martín-Rodríguez, J.F., Damas-López, J., Pourrezai, K., Izzetoglu, K., y Martin, J.M.B., Domínguez-Morales, M.R.: A lasting post-stimulus activation on dorsolateral prefrontal cortex is produced when processing valence and arousal in visual affective stimuli. Neurosci. Lett. 422(3), 147–152 (2007). doi:https://doi.org/10.1016/j.neulet.2007.04.087 León-Carrión, J., Martín-Rodríguez, J.F., Damas-López, J., Pourrezai, K., Izzetoglu, K., y Martin, J.M.B., Domínguez-Morales, M.R.: A lasting post-stimulus activation on dorsolateral prefrontal cortex is produced when processing valence and arousal in visual affective stimuli. Neurosci. Lett. 422(3), 147–152 (2007). doi:https://​doi.​org/​10.​1016/​j.​neulet.​2007.​04.​087
go back to reference Link, G.J., Germonprez, M., Goggins, S., Hemsley, J., Rand, B., Squire, M.: The open community data exchange: advancing data sharing and discovery in open online community science. In: Proceedings of the 12th International Symposium on Open Collaboration Companion, p. 7. ACM (2016). http://dl.acm.org/citation.cfm?id=2962142 Link, G.J., Germonprez, M., Goggins, S., Hemsley, J., Rand, B., Squire, M.: The open community data exchange: advancing data sharing and discovery in open online community science. In: Proceedings of the 12th International Symposium on Open Collaboration Companion, p. 7. ACM (2016). http://​dl.​acm.​org/​citation.​cfm?​id=​2962142
go back to reference Nicholson, A.A., Rabellino, D., Densmore, M., Frewen, P.A., Paret, C., Kluetsch, R., et al.: The neurobiology of emotion regulation in posttraumatic stress disorder: amygdala downregulation via real-time fMRI neurofeedback. Hum. Brain Mapp. 38(1), 541–560 (2017)CrossRef Nicholson, A.A., Rabellino, D., Densmore, M., Frewen, P.A., Paret, C., Kluetsch, R., et al.: The neurobiology of emotion regulation in posttraumatic stress disorder: amygdala downregulation via real-time fMRI neurofeedback. Hum. Brain Mapp. 38(1), 541–560 (2017)CrossRef
go back to reference Phan, K.L., Wager, T., Taylor, S.F., Liberzon, I.: Functional neuroanatomy of emotion: a meta-analysis of emotion activation studies in PET and fMRI. Neuroimage 16(2), 331–348 (2002)CrossRef Phan, K.L., Wager, T., Taylor, S.F., Liberzon, I.: Functional neuroanatomy of emotion: a meta-analysis of emotion activation studies in PET and fMRI. Neuroimage 16(2), 331–348 (2002)CrossRef
go back to reference Rothbart, M.K., Ahadi, S.A., Hershey, K.L., Fisher, P.: Investigations of temperament at three to seven years: the children’s behavior questionnaire. Child Dev. 72(5), 1394–1408 (2001)CrossRef Rothbart, M.K., Ahadi, S.A., Hershey, K.L., Fisher, P.: Investigations of temperament at three to seven years: the children’s behavior questionnaire. Child Dev. 72(5), 1394–1408 (2001)CrossRef
go back to reference Russell, J.A., Mehrabian, A.: Evidence for a three-factor theory of emotions. J. Res. Pers. 11(3), 273–294 (1977)CrossRef Russell, J.A., Mehrabian, A.: Evidence for a three-factor theory of emotions. J. Res. Pers. 11(3), 273–294 (1977)CrossRef
go back to reference Rutkowski, T.M., Tanaka, T., Cichocki, A., Erickson, D., Cao, J., Mandic, D.P.: Interactive component extraction from fEEG, fNIRS and peripheral biosignals for affective brain–machine interfacing paradigms. Comput. Hum. Behav. 27(5), 1512–1518 (2011)CrossRef Rutkowski, T.M., Tanaka, T., Cichocki, A., Erickson, D., Cao, J., Mandic, D.P.: Interactive component extraction from fEEG, fNIRS and peripheral biosignals for affective brain–machine interfacing paradigms. Comput. Hum. Behav. 27(5), 1512–1518 (2011)CrossRef
go back to reference Sevick, E.M., Chance, B., Leigh, J., Nioka, S., Maris, M.: Quantitation of time-and frequency-resolved optical spectra for the determination of tissue oxygenation. Anal. Biochem. 195(2), 330–351 (1991)CrossRef Sevick, E.M., Chance, B., Leigh, J., Nioka, S., Maris, M.: Quantitation of time-and frequency-resolved optical spectra for the determination of tissue oxygenation. Anal. Biochem. 195(2), 330–351 (1991)CrossRef
go back to reference Soleymani, M., Asghari-Esfeden, S., Fu, Y., Pantic, M.: Analysis of EEG signals and facial expressions for continuous emotion detection. IEEE Trans. Affect. Comput. 7(1), 17–28 (2016)CrossRef Soleymani, M., Asghari-Esfeden, S., Fu, Y., Pantic, M.: Analysis of EEG signals and facial expressions for continuous emotion detection. IEEE Trans. Affect. Comput. 7(1), 17–28 (2016)CrossRef
go back to reference Thayer, J.F., Lane, R.D.: Claude Bernard and the heart–brain connection: further elaboration of a model of neurovisceral integration. Neurosci. Biobehav. Rev. 33(2), 81–88 (2009)CrossRef Thayer, J.F., Lane, R.D.: Claude Bernard and the heart–brain connection: further elaboration of a model of neurovisceral integration. Neurosci. Biobehav. Rev. 33(2), 81–88 (2009)CrossRef
go back to reference Thomas, C., Altenmüller, E., Marckmann, G., Kahrs, J., Dichgans, J.: Language processing in aphasia: changes in lateralization patterns during recovery reflect cerebral plasticity in adults. Electroencephalogr. Clin. Neurophysiol. 102(2), 86–97 (1997). doi:https://doi.org/10.1016/S0921-884X(96)95653-2 Thomas, C., Altenmüller, E., Marckmann, G., Kahrs, J., Dichgans, J.: Language processing in aphasia: changes in lateralization patterns during recovery reflect cerebral plasticity in adults. Electroencephalogr. Clin. Neurophysiol. 102(2), 86–97 (1997). doi:https://​doi.​org/​10.​1016/​S0921-884X(96)95653-2
go back to reference Tupak, S.V., Dresler, T., Badewien, M., Hahn, T., Ernst, L.H., Herrmann, M.J., Fallgatter, A.J.: Inhibitory transcranial magnetic theta burst stimulation attenuates prefrontal cortex oxygenation. Hum. Brain Mapp. 34(1), 150–157 (2013). doi:https://doi.org/10.1002/hbm.21421 Tupak, S.V., Dresler, T., Badewien, M., Hahn, T., Ernst, L.H., Herrmann, M.J., Fallgatter, A.J.: Inhibitory transcranial magnetic theta burst stimulation attenuates prefrontal cortex oxygenation. Hum. Brain Mapp. 34(1), 150–157 (2013). doi:https://​doi.​org/​10.​1002/​hbm.​21421
go back to reference Võ, M.L., Conrad, M., Kuchinke, L., Urton, K., Hofmann, M.J., Jacobs, A.M.: The Berlin affective word list reloaded (BAWL-R). Behav. Res. Methods 41(2), 534–538 (2009)CrossRef Võ, M.L., Conrad, M., Kuchinke, L., Urton, K., Hofmann, M.J., Jacobs, A.M.: The Berlin affective word list reloaded (BAWL-R). Behav. Res. Methods 41(2), 534–538 (2009)CrossRef
go back to reference Watson, D., Clark, L.A., Tellegen, A.: Development and validation of brief measures of positive and negative affect: the PANAS scales. J. Pers. Soc. Psychol. 54(6), 1063–1070 (1988)CrossRef Watson, D., Clark, L.A., Tellegen, A.: Development and validation of brief measures of positive and negative affect: the PANAS scales. J. Pers. Soc. Psychol. 54(6), 1063–1070 (1988)CrossRef
go back to reference Wiebking, C., de Greck, M., Duncan, N.W., Heinzel, A., Tempelmann, C., Northoff, G.: Are emotions associated with activity during rest or interoception? An exploratory fMRI study in healthy subjects. Neurosci. Lett. 491(1), 87–92 (2011)CrossRef Wiebking, C., de Greck, M., Duncan, N.W., Heinzel, A., Tempelmann, C., Northoff, G.: Are emotions associated with activity during rest or interoception? An exploratory fMRI study in healthy subjects. Neurosci. Lett. 491(1), 87–92 (2011)CrossRef
go back to reference Williams, J.B.: A structured interview guide for the Hamilton depression rating scale. Arch. Gen. Psychiatry 45(8), 742–747 (1988)CrossRef Williams, J.B.: A structured interview guide for the Hamilton depression rating scale. Arch. Gen. Psychiatry 45(8), 742–747 (1988)CrossRef
go back to reference Young, R.C., Biggs, J.T., Ziegler, V.E., Meyer, D.A.: A rating scale for mania: reliability, validity and sensitivity. Br. J. Psychiatry 133(5), 429–435 (1978)CrossRef Young, R.C., Biggs, J.T., Ziegler, V.E., Meyer, D.A.: A rating scale for mania: reliability, validity and sensitivity. Br. J. Psychiatry 133(5), 429–435 (1978)CrossRef
Metadata
Title
Toward an Open Data Repository and Meta-Analysis of Cognitive Data Using fNIRS Studies of Emotion
Author
Sarah Bratt
Copyright Year
2017
DOI
https://doi.org/10.1007/978-3-319-58628-1_34