Skip to main content
Top

2010 | OriginalPaper | Chapter

11. Enhancing Human-Computer Interaction with Input from Active and Passive Brain-Computer Interfaces

Authors : Thorsten O. Zander, Christian Kothe, Sabine Jatzev, Matti Gaertner

Published in: Brain-Computer Interfaces

Publisher: Springer London

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This chapter introduces a formal categorization of BCIs, according to their key characteristics within HCI scenarios. This comprises classical approaches, which we group into active and reactive BCIs, and the new group of passive BCIs. Passive BCIs provide easily applicable and yet efficient interaction channels carrying information on covert aspects of user state, while adding little further usage cost. All of these systems can also be set up as hybrid BCIs, by incorporating information from outside the brain to make predictions, allowing for enhanced robustness over conventional approaches. With these properties, passive and hybrid BCIs are particularly useful in HCI. When any BCI is transferred from the laboratory to real-world situations, one faces new types of problems resulting from uncontrolled environmental factors—mostly leading to artifacts contaminating data and results. The handling of these situations is treated in a brief review of training and calibration strategies. The presented theory is then underpinned by two concrete examples. First, a combination of Event Related Desynchronization (ERD)-based active BCI with gaze control, defining a hybrid BCI as solution for the midas touch problem. And second, a passive BCI based on human error processing, leading to new forms of automated adaptation in HCI. This is in line with the results from other recent studies of passive BCI technology and shows the broad potential of this approach.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
go back to reference Asteriadis S, Tzouveli P, Karpouzis K, Kollias S (2009) Estimation of behavioral user state based on eye gaze and head pose—application in an e-learning environment. Multimed Tools Appl 41:469–493 CrossRef Asteriadis S, Tzouveli P, Karpouzis K, Kollias S (2009) Estimation of behavioral user state based on eye gaze and head pose—application in an e-learning environment. Multimed Tools Appl 41:469–493 CrossRef
go back to reference Becker H, Meek C, Chickering DM (2007) Modeling contextual factors of click rates. In: Proceedings of the Twenty-Second AAAI Conference on Artificial Intelligence, Vancouver Becker H, Meek C, Chickering DM (2007) Modeling contextual factors of click rates. In: Proceedings of the Twenty-Second AAAI Conference on Artificial Intelligence, Vancouver
go back to reference Blankertz B, Schäfer C, Dornhege G, Curio G (2002) Single trial detection of EEG error potentials: A tool for increasing BCI transmission rates. In: Artificial Neural Networks—ICANN 2002, pp 1137–1143 Blankertz B, Schäfer C, Dornhege G, Curio G (2002) Single trial detection of EEG error potentials: A tool for increasing BCI transmission rates. In: Artificial Neural Networks—ICANN 2002, pp 1137–1143
go back to reference Blankertz B, Dornhege G, Krauledat M, Müller K, Curio G (2007) The non-invasive Berlin Brain–Computer Interface: Fast acquisition of effective performance in untrained subjects. NeuroImage 37(2):539–550 CrossRef Blankertz B, Dornhege G, Krauledat M, Müller K, Curio G (2007) The non-invasive Berlin Brain–Computer Interface: Fast acquisition of effective performance in untrained subjects. NeuroImage 37(2):539–550 CrossRef
go back to reference Bolt RA (1982) Eyes at the Interface. In: Proceedings of the 1982 Conference on Human Factors in Computing Systems. ACM Press, New York, pp 360–362 CrossRef Bolt RA (1982) Eyes at the Interface. In: Proceedings of the 1982 Conference on Human Factors in Computing Systems. ACM Press, New York, pp 360–362 CrossRef
go back to reference Cajochen C, Kräuchi K, von Arx M, Möri D, Graw P, Wirz-Justice A (1996) Daytime melatonin administration enhances sleepiness and theta/alpha activity in the waking EEG. Neurosci Lett 207(3):209–213 CrossRef Cajochen C, Kräuchi K, von Arx M, Möri D, Graw P, Wirz-Justice A (1996) Daytime melatonin administration enhances sleepiness and theta/alpha activity in the waking EEG. Neurosci Lett 207(3):209–213 CrossRef
go back to reference Chanel G, et al (2006) Emotion assessment: Arousal evaluation using EEG’s and peripheral physiological signals. Multimedia Content Representation, Classification and Security, pp 530–537 Chanel G, et al (2006) Emotion assessment: Arousal evaluation using EEG’s and peripheral physiological signals. Multimedia Content Representation, Classification and Security, pp 530–537
go back to reference Chen D, Vertegaal R (2004) Using mental load for managing interruptions in physiologically attentive user interfaces. Extended Abstracts of SIGCHI 2004 Conference on Human Factors in Computing Systems, pp 1513–1516 Chen D, Vertegaal R (2004) Using mental load for managing interruptions in physiologically attentive user interfaces. Extended Abstracts of SIGCHI 2004 Conference on Human Factors in Computing Systems, pp 1513–1516
go back to reference Engell-Nielsen T, Glenstrup AJ, Hansen JP (2003) Eye gaze interaction: A new media—not just a fast mouse. In: Itoh K, Komatsubara A, Kuwano S (eds) Handbook of Human Factors/Ergonomics. AsakuraPublishing, Tokyo, Japan, pp 445–455 Engell-Nielsen T, Glenstrup AJ, Hansen JP (2003) Eye gaze interaction: A new media—not just a fast mouse. In: Itoh K, Komatsubara A, Kuwano S (eds) Handbook of Human Factors/Ergonomics. AsakuraPublishing, Tokyo, Japan, pp 445–455
go back to reference Fang F, Liu Y, Shen Z (2003) Lie detection with contingent negative variation. Int J Psychophysiol 50(3):247–255 CrossRef Fang F, Liu Y, Shen Z (2003) Lie detection with contingent negative variation. Int J Psychophysiol 50(3):247–255 CrossRef
go back to reference Farwell LA, Donchin E (1988) Talking off the top of your head: Toward a mental prosthesis utilizing event-related brain potentials. Electroencephalogr Clin Neurophysiol 70(6):510–523 CrossRef Farwell LA, Donchin E (1988) Talking off the top of your head: Toward a mental prosthesis utilizing event-related brain potentials. Electroencephalogr Clin Neurophysiol 70(6):510–523 CrossRef
go back to reference Ferrez PW, del Millán R (2008) Error-related EEG potentials generated during simulated brain-computer interaction. IEEE Trans Biomed Eng 55(3):923–929 CrossRef Ferrez PW, del Millán R (2008) Error-related EEG potentials generated during simulated brain-computer interaction. IEEE Trans Biomed Eng 55(3):923–929 CrossRef
go back to reference Grimes D, Tan DS, Hudson SE, Shenoy P, Rao RP (2008) Feasibility and pragmatics of classifying working memory load with an electroencephalograph. In: Proceeding of the Twenty-Sixth Annual SIGCHI Conference on Human Factors in Computing Systems (Florence, Italy, 2008). ACM, New York, pp 835–844 CrossRef Grimes D, Tan DS, Hudson SE, Shenoy P, Rao RP (2008) Feasibility and pragmatics of classifying working memory load with an electroencephalograph. In: Proceeding of the Twenty-Sixth Annual SIGCHI Conference on Human Factors in Computing Systems (Florence, Italy, 2008). ACM, New York, pp 835–844 CrossRef
go back to reference Heekeren HR, Marrett S, Ungerleider LG (2008) The neural systems that mediate human perceptual decision making. Nat Rev Neurosci 9:467–479 CrossRef Heekeren HR, Marrett S, Ungerleider LG (2008) The neural systems that mediate human perceptual decision making. Nat Rev Neurosci 9:467–479 CrossRef
go back to reference Holroyd CB (2004) A note on the oddball N200 and the feedback ERN. In: Ullsperger M, Falkenstein M (eds) Errors, Conflicts, and the Brain. Current Opinions on Performance Monitoring. Max-Planck Institute for Human Cognitive and Brain Sciences, Leipzig, pp 211–218 Holroyd CB (2004) A note on the oddball N200 and the feedback ERN. In: Ullsperger M, Falkenstein M (eds) Errors, Conflicts, and the Brain. Current Opinions on Performance Monitoring. Max-Planck Institute for Human Cognitive and Brain Sciences, Leipzig, pp 211–218
go back to reference Hutchinson TF (1993) Eye gaze computer interfaces: Computers that sense eye positions on the display. Computer 26:65–67 CrossRef Hutchinson TF (1993) Eye gaze computer interfaces: Computers that sense eye positions on the display. Computer 26:65–67 CrossRef
go back to reference Jacob RJK, Legett JJ, Myers BA, Pausch R (1993) Interaction styles and input/output devices. Behav Inf Technol 12:69–79 CrossRef Jacob RJK, Legett JJ, Myers BA, Pausch R (1993) Interaction styles and input/output devices. Behav Inf Technol 12:69–79 CrossRef
go back to reference Jatzev S, Zander TO, DeFilippis M, Kothe C, Welke S, Rötting M (2008) Examining causes for non-stationarities: The loss of controllability is a factor which induces non-stationarities. In: Proceedings of the 4th Int BCI Workshop & Training Course, Graz University of Technology. Publishing House, Graz, Austria Jatzev S, Zander TO, DeFilippis M, Kothe C, Welke S, Rötting M (2008) Examining causes for non-stationarities: The loss of controllability is a factor which induces non-stationarities. In: Proceedings of the 4th Int BCI Workshop & Training Course, Graz University of Technology. Publishing House, Graz, Austria
go back to reference Kelly S, Lalor E, Reilly R, Foxe J (2005) Visual spatial attention tracking using high-density SSVEP data for independent brain–computer communication. IEEE Trans Rehabil Eng 13(2):172–178 CrossRef Kelly S, Lalor E, Reilly R, Foxe J (2005) Visual spatial attention tracking using high-density SSVEP data for independent brain–computer communication. IEEE Trans Rehabil Eng 13(2):172–178 CrossRef
go back to reference Kohlmorgen J, Dornhege G, Braun M, Blankertz B, Müller K, Curio G, Hagemann K, Bruns A, Schrauf M, Kincses W (2007) Improving human performance in a real operating environment through real-time mental workload detection. In: Toward Brain-Computer Interfacing. MIT Press, incollection 24:409–422 Kohlmorgen J, Dornhege G, Braun M, Blankertz B, Müller K, Curio G, Hagemann K, Bruns A, Schrauf M, Kincses W (2007) Improving human performance in a real operating environment through real-time mental workload detection. In: Toward Brain-Computer Interfacing. MIT Press, incollection 24:409–422
go back to reference Krauledat M (2008) Analysis of nonstationarities in EEG signals for improving brain-computer interface performance. PhD thesis, Technische Universität Berlin, Fakultät IV—Elektrotechnik und Informatik Krauledat M (2008) Analysis of nonstationarities in EEG signals for improving brain-computer interface performance. PhD thesis, Technische Universität Berlin, Fakultät IV—Elektrotechnik und Informatik
go back to reference Miller GA (1994) The magical number seven, plus or minus two: Some limits on our capacity for processing information. Psychol Rev 101(2):343–352 CrossRef Miller GA (1994) The magical number seven, plus or minus two: Some limits on our capacity for processing information. Psychol Rev 101(2):343–352 CrossRef
go back to reference Moldt D, von Scheve C (2002) Attribution and adaptation: The case of social norms and emotion in human-agent interaction. In: Proceedings of “The Philosophy and Design of Socially Adept Technologies”, Workshop Held in Conjunction with CHI’02, April 20th, Minneapolis/Minnesota, USA. National Research Council Canada, Ottawa Moldt D, von Scheve C (2002) Attribution and adaptation: The case of social norms and emotion in human-agent interaction. In: Proceedings of “The Philosophy and Design of Socially Adept Technologies”, Workshop Held in Conjunction with CHI’02, April 20th, Minneapolis/Minnesota, USA. National Research Council Canada, Ottawa
go back to reference Müller K, Tangermann M, Dornhege G, Krauledat M, Curio G, Blankertz B (2008) Machine learning for real-time single-trial EEG-analysis: From brain-computer interfacing to mental state monitoring. J Neurosci Methods 167:82–90 CrossRef Müller K, Tangermann M, Dornhege G, Krauledat M, Curio G, Blankertz B (2008) Machine learning for real-time single-trial EEG-analysis: From brain-computer interfacing to mental state monitoring. J Neurosci Methods 167:82–90 CrossRef
go back to reference Murata A (2006) Eye gaze input versus mouse: Cursor control as a function of age. Int J Hum Comput Interact 21:1–14 Murata A (2006) Eye gaze input versus mouse: Cursor control as a function of age. Int J Hum Comput Interact 21:1–14
go back to reference Nieuwenhuis S, Holroyd CB, Mol N, Coles MG (2004) Reinforcement-related brain potentials from medial frontal cortex: Origins and functional significance. Neurosci Biobehav Rev 28:441–448 CrossRef Nieuwenhuis S, Holroyd CB, Mol N, Coles MG (2004) Reinforcement-related brain potentials from medial frontal cortex: Origins and functional significance. Neurosci Biobehav Rev 28:441–448 CrossRef
go back to reference Nilsson S, Gustafsson T, Carleberg P (2007) Hands free interaction with virtual information in a real environment. In: Proceedings of COGAIN 2007, Leicester, UK, pp 53–57 Nilsson S, Gustafsson T, Carleberg P (2007) Hands free interaction with virtual information in a real environment. In: Proceedings of COGAIN 2007, Leicester, UK, pp 53–57
go back to reference Park N, Zhu W, Jung Y, McLaughlin M, Jin S (2005) Utility of haptic data in recognition of user state. In: Proceedings of HCI International 11. Lawrence Erlbaum Associates, Mahwah Park N, Zhu W, Jung Y, McLaughlin M, Jin S (2005) Utility of haptic data in recognition of user state. In: Proceedings of HCI International 11. Lawrence Erlbaum Associates, Mahwah
go back to reference Pfurtscheller G, Neuper C, Flotzinger D, Pregenzer M (1997) EEG-based discrimination between imagination of right and left hand movement. Electroencephalogr Clin Neurophysiol 103(6):642–651 CrossRef Pfurtscheller G, Neuper C, Flotzinger D, Pregenzer M (1997) EEG-based discrimination between imagination of right and left hand movement. Electroencephalogr Clin Neurophysiol 103(6):642–651 CrossRef
go back to reference Pfurtscheller G, Leeb R, Keinrath C, Friedman D, Neuper C, Guger C, Slater M (2006) Walking from thought. Brain Res 1071(1):145–152 CrossRef Pfurtscheller G, Leeb R, Keinrath C, Friedman D, Neuper C, Guger C, Slater M (2006) Walking from thought. Brain Res 1071(1):145–152 CrossRef
go back to reference Pierce J, Stearns B, Pausch R (1999) Voodoo dolls: Seamless interaction at multiple scales in virtual environments. In: Tagungsband Symposium on Interactive 3D graphics, Atlanta, GA, USA. ACM Press, New York, pp 141–145 Pierce J, Stearns B, Pausch R (1999) Voodoo dolls: Seamless interaction at multiple scales in virtual environments. In: Tagungsband Symposium on Interactive 3D graphics, Atlanta, GA, USA. ACM Press, New York, pp 141–145
go back to reference Posner MI, Cohen Y (1984) Components of visual orienting. In: Bouma H, Bouwhuis DG (eds) Attention and Performance, vol 10. Erlbaum, Hillsdale, NJ, pp 531–556 Posner MI, Cohen Y (1984) Components of visual orienting. In: Bouma H, Bouwhuis DG (eds) Attention and Performance, vol 10. Erlbaum, Hillsdale, NJ, pp 531–556
go back to reference Premack D, Woodruff G (1978) Does the chimpanzee have a “theory of mind”? Behav Brain Sci 4:515–526 CrossRef Premack D, Woodruff G (1978) Does the chimpanzee have a “theory of mind”? Behav Brain Sci 4:515–526 CrossRef
go back to reference Reissland J, Zander TO (2009) Automated detection of bluffing in a game—Revealing a complex covert user state with a passive BCI. In: Proceedings of the Human Factors and Ergonomics Society Europe Chapter Annual Meeting, Linkoeping, Sweden Reissland J, Zander TO (2009) Automated detection of bluffing in a game—Revealing a complex covert user state with a passive BCI. In: Proceedings of the Human Factors and Ergonomics Society Europe Chapter Annual Meeting, Linkoeping, Sweden
go back to reference Rötting M, Zander T, Trösterer S, Dzaack J (2009) Implicit interaction in multimodal human-machine systems. In: Schlick C (ed) Methods and Tools of Industrial Engineering and Ergonomics. Springer, Berlin Rötting M, Zander T, Trösterer S, Dzaack J (2009) Implicit interaction in multimodal human-machine systems. In: Schlick C (ed) Methods and Tools of Industrial Engineering and Ergonomics. Springer, Berlin
go back to reference Schmidt EA, Kincses WE, Schrauf M, Haufe S, Schubert R, Curio G, Ag D (2009) Assessing driver’s vigilance state during monotonous driving, June 2009 Schmidt EA, Kincses WE, Schrauf M, Haufe S, Schubert R, Curio G, Ag D (2009) Assessing driver’s vigilance state during monotonous driving, June 2009
go back to reference Shenoy P, Krauledat M, Blankertz B, Rao RPN, Müller K-R (2006) Towards adaptive classification for BCI. J Neural Eng 3(1):R13–R23 CrossRef Shenoy P, Krauledat M, Blankertz B, Rao RPN, Müller K-R (2006) Towards adaptive classification for BCI. J Neural Eng 3(1):R13–R23 CrossRef
go back to reference Shinkareva SV, Mason RA, Malave VL, Wang W, Mitchell TM, Just MA (2008) Using fMRI brain activation to identify cognitive states associated with perception of tools and dwellings. PLoS ONE 3(1):e1394 CrossRef Shinkareva SV, Mason RA, Malave VL, Wang W, Mitchell TM, Just MA (2008) Using fMRI brain activation to identify cognitive states associated with perception of tools and dwellings. PLoS ONE 3(1):e1394 CrossRef
go back to reference Sibert LE, Jacob RJK (2000) Evaluation of eye gaze interaction. CHI’00. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM Press, New York, pp 281–288 CrossRef Sibert LE, Jacob RJK (2000) Evaluation of eye gaze interaction. CHI’00. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM Press, New York, pp 281–288 CrossRef
go back to reference Toga AW, Mazziotta JC (2000) Brain Mapping. Gulf Professional Publishing, Amsterdam Toga AW, Mazziotta JC (2000) Brain Mapping. Gulf Professional Publishing, Amsterdam
go back to reference Tomioka R, Dornhege G, Nolte G, Blankertz B, Aihara K, Müller K-R (2006) Spectrally weighted common spatial pattern algorithm for single trial EEG classification.Technical Report, 21. Dept. of Mathematical Engineering. Tokyo, Japan: University of Tokyo Tomioka R, Dornhege G, Nolte G, Blankertz B, Aihara K, Müller K-R (2006) Spectrally weighted common spatial pattern algorithm for single trial EEG classification.Technical Report, 21. Dept. of Mathematical Engineering. Tokyo, Japan: University of Tokyo
go back to reference Vilimek R, Zander TO (2009) BC(eye): Combining eye-gaze input with brain-computer interaction. In: Proceedings of the HCII 2009. Springer, Heidelberg Vilimek R, Zander TO (2009) BC(eye): Combining eye-gaze input with brain-computer interaction. In: Proceedings of the HCII 2009. Springer, Heidelberg
go back to reference Wiener EL (1989) Human factors of advanced technology (“glass cockpit”) transport aircraft. NASA Contractor Report 177528, NASA Ames Research Center Wiener EL (1989) Human factors of advanced technology (“glass cockpit”) transport aircraft. NASA Contractor Report 177528, NASA Ames Research Center
go back to reference Wolpaw JR, Birbaumer N, McFarland DJ, Pfurtscheller G, Vaughan TM (2002) Brain-computer interfaces for communication and control. Clin Neurophysiol Off J Int Fed Clin Neurophysiol 113(6):767–791. PMID: 12048038 CrossRef Wolpaw JR, Birbaumer N, McFarland DJ, Pfurtscheller G, Vaughan TM (2002) Brain-computer interfaces for communication and control. Clin Neurophysiol Off J Int Fed Clin Neurophysiol 113(6):767–791. PMID: 12048038 CrossRef
go back to reference Wriessnegger S, Scherer R, Mörth K, Maier C, Pfurtscheller G (2006) CN. Heart rate-controlled EEG-Based BCI: The Graz hybrid BCI. In: Proc of the 3rd Int BCI Workshop & Training Course, Graz, Austria, 2006. Graz University of Technology Publishing House, Graz Wriessnegger S, Scherer R, Mörth K, Maier C, Pfurtscheller G (2006) CN. Heart rate-controlled EEG-Based BCI: The Graz hybrid BCI. In: Proc of the 3rd Int BCI Workshop & Training Course, Graz, Austria, 2006. Graz University of Technology Publishing House, Graz
go back to reference Zander TO, Kothe C, Welke S, Roetting M (2008) Enhancing human-machine systems with secondary input from passive brain-computer interfaces. In: Proc of the 4th Int BCI Workshop & Training Course, Graz, Austria, 2008. Graz University of Technology Publishing House, Graz Zander TO, Kothe C, Welke S, Roetting M (2008) Enhancing human-machine systems with secondary input from passive brain-computer interfaces. In: Proc of the 4th Int BCI Workshop & Training Course, Graz, Austria, 2008. Graz University of Technology Publishing House, Graz
go back to reference Zander TO, Jatzev S (2009) Detecting affective covert user states with passive brain-computer interfaces. In: Proceedings of the ACII 2009. IEEE Computer Society Press, Los Alamitos, CA Zander TO, Jatzev S (2009) Detecting affective covert user states with passive brain-computer interfaces. In: Proceedings of the ACII 2009. IEEE Computer Society Press, Los Alamitos, CA
Metadata
Title
Enhancing Human-Computer Interaction with Input from Active and Passive Brain-Computer Interfaces
Authors
Thorsten O. Zander
Christian Kothe
Sabine Jatzev
Matti Gaertner
Copyright Year
2010
Publisher
Springer London
DOI
https://doi.org/10.1007/978-1-84996-272-8_11