Skip to main content
Erschienen in:
Buchtitelbild

2012 | OriginalPaper | Buchkapitel

12. FMRI Compatible Sensing Glove for Hand Gesture Monitoring

verfasst von : Nicola Vanello, Valentina Hartwig, Enzo Pasquale Scilingo, Daniela Bonino, Emiliano Ricciardi, Alessandro Tognetti, Pietro Pietrini, Danilo De Rossi, Luigi Landini, Antonio Bicchi

Erschienen in: Immersive Multimodal Interactive Presence

Verlag: Springer London

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Here we describe and validate a fabric sensing glove for hand finger movement monitoring. After a quick calibration procedure, and by suitably processing of the outputs of the glove, it is possible to estimate hand joint angles in real time. Moreover, we tested the fMRI compatibility of the glove and ran a pilot fMRI experiment on the neural correlates of handshaking during human-to-human and human-to-robot interactions. Here we describe how the glove can be used to monitor correct task execution and to improve modeling of the expected hemodynamic responses during fMRI experimental paradigms.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Lorussi, F., Scilingo, E.P., Tesconi, M., Tognetti, A., De Rossi, D.: Strain sensing fabric for hand posture and gesture monitoring. IEEE Trans. Inf. Technol. Biomed. 9(3), 372–381 (2005) CrossRef Lorussi, F., Scilingo, E.P., Tesconi, M., Tognetti, A., De Rossi, D.: Strain sensing fabric for hand posture and gesture monitoring. IEEE Trans. Inf. Technol. Biomed. 9(3), 372–381 (2005) CrossRef
2.
Zurück zum Zitat Hidler, J., Hodics, T., Xu, B., Dobkin, B., Cohen, L.G.: MR compatible force sensing system for real-time monitoring of wrist moments during fMRI testing. J. Neurosci. Methods 155(2), 300–307 (2006) CrossRef Hidler, J., Hodics, T., Xu, B., Dobkin, B., Cohen, L.G.: MR compatible force sensing system for real-time monitoring of wrist moments during fMRI testing. J. Neurosci. Methods 155(2), 300–307 (2006) CrossRef
3.
Zurück zum Zitat Liu, J., Dai, T., Elster, T., Sahgal, V., Brown, R., Yue, G.: Simultaneous measurement of human joint force, surface electromyograms, and functional MRI-measured brain activation. J. Neurosci. Methods 101(1), 49–57 (2000) CrossRef Liu, J., Dai, T., Elster, T., Sahgal, V., Brown, R., Yue, G.: Simultaneous measurement of human joint force, surface electromyograms, and functional MRI-measured brain activation. J. Neurosci. Methods 101(1), 49–57 (2000) CrossRef
4.
Zurück zum Zitat Reithler, J., Reithler, H., van den Boogert, E., Goebel, R., van Mier, H.: Resistance-based high resolution recording of predefined 2-dimensional pen trajectories in an fMRI setting. J. Neurosci. Methods 152(1–2), 10–17 (2006) CrossRef Reithler, J., Reithler, H., van den Boogert, E., Goebel, R., van Mier, H.: Resistance-based high resolution recording of predefined 2-dimensional pen trajectories in an fMRI setting. J. Neurosci. Methods 152(1–2), 10–17 (2006) CrossRef
5.
Zurück zum Zitat Tada, M., Kanade, T.: An MR-compatible optical force sensor for human function modeling. In: Medical Image Computing and Computer-Assisted Intervention—MICCAI 2004, pp. 129–136 (2004) CrossRef Tada, M., Kanade, T.: An MR-compatible optical force sensor for human function modeling. In: Medical Image Computing and Computer-Assisted Intervention—MICCAI 2004, pp. 129–136 (2004) CrossRef
6.
Zurück zum Zitat James, G.A., He, G., Liu, Y.: A full-size MRI-compatible keyboard response system. NeuroImage 25(1), 328–331 (2005) CrossRef James, G.A., He, G., Liu, Y.: A full-size MRI-compatible keyboard response system. NeuroImage 25(1), 328–331 (2005) CrossRef
7.
Zurück zum Zitat Gassert, R., Moser, R., Burdet, E., Bleuler, H.: MRI/fMRI-compatible robotic system with force feedback for interaction with human motion. IEEE/ASME Trans. Mechatron. 11(2), 216–224 (2006) CrossRef Gassert, R., Moser, R., Burdet, E., Bleuler, H.: MRI/fMRI-compatible robotic system with force feedback for interaction with human motion. IEEE/ASME Trans. Mechatron. 11(2), 216–224 (2006) CrossRef
8.
Zurück zum Zitat Vanello, N., Hartwig, V., Tesconi, M., Ricciardi, E., Tognetti, A., Zupone, G., Gassert, R., Chapuis, D., Sgambelluri, N., Scilingo, E.P., et al.: Sensing glove for brain studies: Design and assessment of its compatibility for fMRI with a robust test. IEEE/ASME Trans. Mechatron. 13(3), 345–354 (2008) CrossRef Vanello, N., Hartwig, V., Tesconi, M., Ricciardi, E., Tognetti, A., Zupone, G., Gassert, R., Chapuis, D., Sgambelluri, N., Scilingo, E.P., et al.: Sensing glove for brain studies: Design and assessment of its compatibility for fMRI with a robust test. IEEE/ASME Trans. Mechatron. 13(3), 345–354 (2008) CrossRef
9.
Zurück zum Zitat Vanello, N., Bonino, D., Ricciardi, E., Tesconi, M., Scilingo, E., Hartwig, V., Tognetti, A., Zupone, G., Cutolo, F., Giovannetti, G., et al.: Neural correlates of human-robot handshaking. In: RO-MAN, pp. 555–561. IEEE, New York (2010) Vanello, N., Bonino, D., Ricciardi, E., Tesconi, M., Scilingo, E., Hartwig, V., Tognetti, A., Zupone, G., Cutolo, F., Giovannetti, G., et al.: Neural correlates of human-robot handshaking. In: RO-MAN, pp. 555–561. IEEE, New York (2010)
10.
Zurück zum Zitat Skopec, M.: A primer on medical device interactions with magnetic resonance imaging systems, Feb. 4, 1997, CDRH magnetic resonance working group. US Department of Health and Human Services, Food and Drug Administration. Center for Devices and Radiological Health, Updated May 23 17 (1997) Skopec, M.: A primer on medical device interactions with magnetic resonance imaging systems, Feb. 4, 1997, CDRH magnetic resonance working group. US Department of Health and Human Services, Food and Drug Administration. Center for Devices and Radiological Health, Updated May 23 17 (1997)
11.
Zurück zum Zitat Schenck, J.F.: Safety of strong, static magnetic fields. J. Magn. Reson. Imaging 12(1), 2–19 (2000) CrossRef Schenck, J.F.: Safety of strong, static magnetic fields. J. Magn. Reson. Imaging 12(1), 2–19 (2000) CrossRef
12.
Zurück zum Zitat Lüdeke, K., Röschmann, P., Tischler, R.: Susceptibility artefacts in NMR imaging. J. Magn. Reson. Imaging 3(4), 329 (1985) CrossRef Lüdeke, K., Röschmann, P., Tischler, R.: Susceptibility artefacts in NMR imaging. J. Magn. Reson. Imaging 3(4), 329 (1985) CrossRef
13.
Zurück zum Zitat Sijbers, J., Den Dekker, A., Van Audekerke, J., Verhoye, M., Van Dyck, D.: Estimation of the noise in magnitude MR images. J. Magn. Reson. Imaging 16(1), 87–90 (1998) CrossRef Sijbers, J., Den Dekker, A., Van Audekerke, J., Verhoye, M., Van Dyck, D.: Estimation of the noise in magnitude MR images. J. Magn. Reson. Imaging 16(1), 87–90 (1998) CrossRef
14.
Zurück zum Zitat Rombouts, S., Barkhof, F., Hoogenraad, F., Sprenger, M., Valk, J., Scheltens, P.: Test-retest analysis with functional MR of the activated area in the human visual cortex. Am. J. Neuroradiol. 18(7), 1317 (1997) Rombouts, S., Barkhof, F., Hoogenraad, F., Sprenger, M., Valk, J., Scheltens, P.: Test-retest analysis with functional MR of the activated area in the human visual cortex. Am. J. Neuroradiol. 18(7), 1317 (1997)
15.
Zurück zum Zitat Machielsen, W.C.M., Rombouts, S.A.R.B., Barkhof, F., Scheltens, P., Witter, M.P.: FMRI of visual encoding: reproducibility of activation. Hum. Brain Mapp. 9(3), 156–164 (2000) CrossRef Machielsen, W.C.M., Rombouts, S.A.R.B., Barkhof, F., Scheltens, P., Witter, M.P.: FMRI of visual encoding: reproducibility of activation. Hum. Brain Mapp. 9(3), 156–164 (2000) CrossRef
16.
Zurück zum Zitat Carelli, L., Gaggioli, A., Pioggia, G., De Rossi, F., Riva, G.: Affective robot for elderly assistance. Stud. Health Technol. Inform. 144, 44 (2009) Carelli, L., Gaggioli, A., Pioggia, G., De Rossi, F., Riva, G.: Affective robot for elderly assistance. Stud. Health Technol. Inform. 144, 44 (2009)
17.
Zurück zum Zitat Pioggia, G., Igliozzi, R., Ferro, M., Ahluwalia, A., Muratori, F., De Rossi, D.: An android for enhancing social skills and emotion recognition in people with autism. IEEE Trans. Neural Syst. Rehabil. Eng. 13(4), 507–515 (2005) CrossRef Pioggia, G., Igliozzi, R., Ferro, M., Ahluwalia, A., Muratori, F., De Rossi, D.: An android for enhancing social skills and emotion recognition in people with autism. IEEE Trans. Neural Syst. Rehabil. Eng. 13(4), 507–515 (2005) CrossRef
18.
Zurück zum Zitat Bird, G., Leighton, J., Press, C., Heyes, C.: Intact automatic imitation of human and robot actions in autism spectrum disorders. Proc. R. Soc. Lond. B, Biol. Sci. 274(1628), 3027 (2007) CrossRef Bird, G., Leighton, J., Press, C., Heyes, C.: Intact automatic imitation of human and robot actions in autism spectrum disorders. Proc. R. Soc. Lond. B, Biol. Sci. 274(1628), 3027 (2007) CrossRef
19.
Zurück zum Zitat Sidner, C.L., Lee, C., Kidd, C.D., Lesh, N., Rich, C.: Explorations in engagement for humans and robots. Artif. Intell. 166(1–2), 140–164 (2005) CrossRef Sidner, C.L., Lee, C., Kidd, C.D., Lesh, N., Rich, C.: Explorations in engagement for humans and robots. Artif. Intell. 166(1–2), 140–164 (2005) CrossRef
20.
Zurück zum Zitat Nehaniv, C.L., Dautenhahn, K., Kubacki, J., Haegele, M., Parlitz, C., Alami, R.: A methodological approach relating the classification of gesture to identification of human intent in the context of human-robot interaction. In: IEEE International Workshop on Robot and Human Interactive Communication. ROMAN 2005, pp. 371–377. IEEE, New York (2005) CrossRef Nehaniv, C.L., Dautenhahn, K., Kubacki, J., Haegele, M., Parlitz, C., Alami, R.: A methodological approach relating the classification of gesture to identification of human intent in the context of human-robot interaction. In: IEEE International Workshop on Robot and Human Interactive Communication. ROMAN 2005, pp. 371–377. IEEE, New York (2005) CrossRef
21.
Zurück zum Zitat Lee, K.M., Jung, Y., Kim, J., Kim, S.R.: Are physically embodied social agents better than disembodied social agents?: The effects of physical embodiment, tactile interaction, and people’s loneliness in human-robot interaction. Int. J. Hum.-Comput. Stud. 64(10), 962–973 (2006) CrossRef Lee, K.M., Jung, Y., Kim, J., Kim, S.R.: Are physically embodied social agents better than disembodied social agents?: The effects of physical embodiment, tactile interaction, and people’s loneliness in human-robot interaction. Int. J. Hum.-Comput. Stud. 64(10), 962–973 (2006) CrossRef
22.
Zurück zum Zitat Basdogan, C., Ho, C.H., Srinivasan, M.A., Slater, M.: An experimental study on the role of touch in shared virtual environments. ACM Trans. Comput.-Hum. Interact. 7(4), 443–460 (2000) CrossRef Basdogan, C., Ho, C.H., Srinivasan, M.A., Slater, M.: An experimental study on the role of touch in shared virtual environments. ACM Trans. Comput.-Hum. Interact. 7(4), 443–460 (2000) CrossRef
23.
Zurück zum Zitat Giannopoulos, E., Eslava, V., Oyarzabal, M., Hierro, T., González, L., Ferre, M., Slater, M.: The effect of haptic feedback on basic social interaction within shared virtual environments. In: Haptics: Perception, Devices and Scenarios, pp. 301–307 (2008) CrossRef Giannopoulos, E., Eslava, V., Oyarzabal, M., Hierro, T., González, L., Ferre, M., Slater, M.: The effect of haptic feedback on basic social interaction within shared virtual environments. In: Haptics: Perception, Devices and Scenarios, pp. 301–307 (2008) CrossRef
24.
Zurück zum Zitat Ernst, M.O., Banks, M.S.: Humans integrate visual and haptic information in a statistically optimal fashion. Nature 415(6870), 429–433 (2002) CrossRef Ernst, M.O., Banks, M.S.: Humans integrate visual and haptic information in a statistically optimal fashion. Nature 415(6870), 429–433 (2002) CrossRef
25.
Zurück zum Zitat Montoya, P., Sitges, C.: Affective modulation of somatosensory-evoked potentials elicited by tactile stimulation. Brain Res. 1068(1), 205–212 (2006) CrossRef Montoya, P., Sitges, C.: Affective modulation of somatosensory-evoked potentials elicited by tactile stimulation. Brain Res. 1068(1), 205–212 (2006) CrossRef
26.
Zurück zum Zitat Chaplin, W.F., Phillips, J.B., Brown, J.D., Clanton, N.R., Stein, J.L.: Handshaking, gender, personality, and first impressions. J. Pers. Soc. Psychol. 79(1), 110 (2000) CrossRef Chaplin, W.F., Phillips, J.B., Brown, J.D., Clanton, N.R., Stein, J.L.: Handshaking, gender, personality, and first impressions. J. Pers. Soc. Psychol. 79(1), 110 (2000) CrossRef
27.
Zurück zum Zitat Åtröm, J., Thorell, L.H., Holmlund, U., d’Elia, G.: Handshaking, personality, and psychopathology in psychiatric patients: A reliability and correlational study. Perceptual and motor skills (1993) Åtröm, J., Thorell, L.H., Holmlund, U., d’Elia, G.: Handshaking, personality, and psychopathology in psychiatric patients: A reliability and correlational study. Perceptual and motor skills (1993)
28.
Zurück zum Zitat Zecca, M., Endo, N., Itoh, K., Imanishi, K., Saito, M., Nanba, N., Takanobu, H., Takanishi, A.: On the development of the bioinstrumentation system WB-1R for the evaluation of human-robot interaction-head and hands motion capture systems. In: 2007 IEEE/ASME International Conference on Advanced Intelligent Mechatronics, pp. 1–6. IEEE, New York (2007) CrossRef Zecca, M., Endo, N., Itoh, K., Imanishi, K., Saito, M., Nanba, N., Takanobu, H., Takanishi, A.: On the development of the bioinstrumentation system WB-1R for the evaluation of human-robot interaction-head and hands motion capture systems. In: 2007 IEEE/ASME International Conference on Advanced Intelligent Mechatronics, pp. 1–6. IEEE, New York (2007) CrossRef
29.
Zurück zum Zitat Wang, Z., Peer, A., Buss, M.: An HMM approach to realistic haptic human-robot interaction. In: Third Joint EuroHaptics Conference, 2009 and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics 2009, pp. 374–379. IEEE, New York (2009) CrossRef Wang, Z., Peer, A., Buss, M.: An HMM approach to realistic haptic human-robot interaction. In: Third Joint EuroHaptics Conference, 2009 and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics 2009, pp. 374–379. IEEE, New York (2009) CrossRef
30.
Zurück zum Zitat Sato, T., Hashimoto, M., Tsukahara, M.: Synchronization based control using online design of dynamics and its application to human-robot interaction. In: IEEE International Conference on Robotics and Biomimetics. ROBIO 2007, pp. 652–657. IEEE, New York (2007) Sato, T., Hashimoto, M., Tsukahara, M.: Synchronization based control using online design of dynamics and its application to human-robot interaction. In: IEEE International Conference on Robotics and Biomimetics. ROBIO 2007, pp. 652–657. IEEE, New York (2007)
31.
Zurück zum Zitat Yamato, Y., Jindai, M., Watanabe, T.: Development of a shake-motion leading model for human-robot handshaking. In: SICE Annual Conference, pp. 502–507. IEEE, New York (2008) CrossRef Yamato, Y., Jindai, M., Watanabe, T.: Development of a shake-motion leading model for human-robot handshaking. In: SICE Annual Conference, pp. 502–507. IEEE, New York (2008) CrossRef
32.
Zurück zum Zitat Cox, R.W., et al.: AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. Comput. Biomed. Res. 29(3), 162–173 (1996) CrossRef Cox, R.W., et al.: AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. Comput. Biomed. Res. 29(3), 162–173 (1996) CrossRef
Metadaten
Titel
FMRI Compatible Sensing Glove for Hand Gesture Monitoring
verfasst von
Nicola Vanello
Valentina Hartwig
Enzo Pasquale Scilingo
Daniela Bonino
Emiliano Ricciardi
Alessandro Tognetti
Pietro Pietrini
Danilo De Rossi
Luigi Landini
Antonio Bicchi
Copyright-Jahr
2012
Verlag
Springer London
DOI
https://doi.org/10.1007/978-1-4471-2754-3_12

Neuer Inhalt