Skip to main content

2017 | OriginalPaper | Buchkapitel

Geometry and Gesture-Based Features from Saccadic Eye-Movement as a Biometric in Radiology

verfasst von : Folami T. Alamudun, Tracy Hammond, Hong-Jun Yoon, Georgia D. Tourassi

Erschienen in: Augmented Cognition. Neurocognition and Machine Learning

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this study, we present a novel application of sketch gesture recognition on eye-movement for biometric identification and estimating task expertise. The study was performed for the task of mammographic screening with simultaneous viewing of four coordinated breast views as typically done in clinical practice. Eye-tracking data and diagnostic decisions collected for 100 mammographic cases (25 normal, 25 benign, 50 malignant) and 10 readers (three board certified radiologists and seven radiology residents), formed the corpus for this study. Sketch gesture recognition techniques were employed to extract geometric and gesture-based features from saccadic eye-movements. Our results show that saccadic eye-movement, characterized using sketch-based features, result in more accurate models for predicting individual identity and level of expertise than more traditional eye-tracking features.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
2.
Zurück zum Zitat Bartley, J., Forsyth, J., Pendse, P., Xin, D., Brown, G., Hagseth, P., Agrawal, A., Goldberg, D.W., Hammond, T.: World of workout: a contextual mobile RPG to encourage long term fitness. In: Proceedings of the 2nd ACM SIGSPATIAL International Workshop on the Use of GIS in Public Health, pp. 60–67. ACM (2013) Bartley, J., Forsyth, J., Pendse, P., Xin, D., Brown, G., Hagseth, P., Agrawal, A., Goldberg, D.W., Hammond, T.: World of workout: a contextual mobile RPG to encourage long term fitness. In: Proceedings of the 2nd ACM SIGSPATIAL International Workshop on the Use of GIS in Public Health, pp. 60–67. ACM (2013)
3.
Zurück zum Zitat Bednarik, R., Kinnunen, T., Mihaila, A., Fränti, P.: Eye-movements as a biometric. In: Kalviainen, H., Parkkinen, J., Kaarna, A. (eds.) SCIA 2005. LNCS, vol. 3540, pp. 780–789. Springer, Heidelberg (2005). doi:10.1007/11499145_79 CrossRef Bednarik, R., Kinnunen, T., Mihaila, A., Fränti, P.: Eye-movements as a biometric. In: Kalviainen, H., Parkkinen, J., Kaarna, A. (eds.) SCIA 2005. LNCS, vol. 3540, pp. 780–789. Springer, Heidelberg (2005). doi:10.​1007/​11499145_​79 CrossRef
5.
Zurück zum Zitat Chi, M.T., Glaser, R., Farr, M.J.: The Nature of Expertise. Psychology Press, Park Drive (2014)MATH Chi, M.T., Glaser, R., Farr, M.J.: The Nature of Expertise. Psychology Press, Park Drive (2014)MATH
7.
Zurück zum Zitat Corey, P., Hammond, T.: Gladder: combining gesture and geometric sketch recognition. In: Proceedings of the 23rd National Conference on Artificial Intelligence, vol. 3, pp. 1788–1789. AAAI Press (2008) Corey, P., Hammond, T.: Gladder: combining gesture and geometric sketch recognition. In: Proceedings of the 23rd National Conference on Artificial Intelligence, vol. 3, pp. 1788–1789. AAAI Press (2008)
8.
Zurück zum Zitat Deravi, F., Guness, S.P.: Gaze trajectory as a biometric modality. In: BIOSIGNALS, pp. 335–341 (2011) Deravi, F., Guness, S.P.: Gaze trajectory as a biometric modality. In: BIOSIGNALS, pp. 335–341 (2011)
9.
Zurück zum Zitat Dixon, D., Prasad, M., Hammond, T.: iCanDraw: using sketch recognition and corrective feedback to assist a user in drawing human faces. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 897–906. ACM (2010) Dixon, D., Prasad, M., Hammond, T.: iCanDraw: using sketch recognition and corrective feedback to assist a user in drawing human faces. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 897–906. ACM (2010)
10.
Zurück zum Zitat Eoff, B.D., Hammond, T.: Who dotted that‘i’?: context free user differentiation through pressure and tilt pen data. In: Proceedings of Graphics Interface 2009, pp. 149–156. Canadian Information Processing Society (2009) Eoff, B.D., Hammond, T.: Who dotted that‘i’?: context free user differentiation through pressure and tilt pen data. In: Proceedings of Graphics Interface 2009, pp. 149–156. Canadian Information Processing Society (2009)
11.
Zurück zum Zitat Galdi, C., Nappi, M., Riccio, D., Cantoni, V., Porta, M.: A new gaze analysis based soft-biometric. In: Carrasco-Ochoa, J.A., Martínez-Trinidad, J.F., Rodríguez, J.S., Baja, G.S. (eds.) MCPR 2013. LNCS, vol. 7914, pp. 136–144. Springer, Heidelberg (2013). doi:10.1007/978-3-642-38989-4_14 CrossRef Galdi, C., Nappi, M., Riccio, D., Cantoni, V., Porta, M.: A new gaze analysis based soft-biometric. In: Carrasco-Ochoa, J.A., Martínez-Trinidad, J.F., Rodríguez, J.S., Baja, G.S. (eds.) MCPR 2013. LNCS, vol. 7914, pp. 136–144. Springer, Heidelberg (2013). doi:10.​1007/​978-3-642-38989-4_​14 CrossRef
12.
Zurück zum Zitat Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., Witten, I.H.: The weka data mining software: an update. ACM SIGKDD Explor. Newsl. 11(1), 10–18 (2009)CrossRef Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., Witten, I.H.: The weka data mining software: an update. ACM SIGKDD Explor. Newsl. 11(1), 10–18 (2009)CrossRef
13.
Zurück zum Zitat Hammond, T., Gajos, K., Davis, R., Shrobe, H.E.: An agent-based system for capturing and indexing software design meetings. In: Proceedings of the International Workshop on Agents in Design (WAID 2002). Citeseer (2002) Hammond, T., Gajos, K., Davis, R., Shrobe, H.E.: An agent-based system for capturing and indexing software design meetings. In: Proceedings of the International Workshop on Agents in Design (WAID 2002). Citeseer (2002)
14.
Zurück zum Zitat Hammond, T., O’Sullivan, B.: Recognizing freeform hand-sketched constraint network diagrams by combining geometry and context. In: Proceedings of the Eurographics Ireland (2007) Hammond, T., O’Sullivan, B.: Recognizing freeform hand-sketched constraint network diagrams by combining geometry and context. In: Proceedings of the Eurographics Ireland (2007)
15.
Zurück zum Zitat Hammond, T., Prasad, M., Dixon, D.: Art 101: learning to draw through sketch recognition. In: Taylor, R., Boulanger, P., Krüger, A., Olivier, P. (eds.) SG 2010. LNCS, vol. 6133, pp. 277–280. Springer, Heidelberg (2010). doi:10.1007/978-3-642-13544-6_30 CrossRef Hammond, T., Prasad, M., Dixon, D.: Art 101: learning to draw through sketch recognition. In: Taylor, R., Boulanger, P., Krüger, A., Olivier, P. (eds.) SG 2010. LNCS, vol. 6133, pp. 277–280. Springer, Heidelberg (2010). doi:10.​1007/​978-3-642-13544-6_​30 CrossRef
16.
Zurück zum Zitat Hammond, T.A.: Ladder: A perceptually-based language to simplify sketch recognition user interface development. Ph.D. thesis, Massachusetts Institute of Technology (2007) Hammond, T.A.: Ladder: A perceptually-based language to simplify sketch recognition user interface development. Ph.D. thesis, Massachusetts Institute of Technology (2007)
17.
Zurück zum Zitat Heath, M., Bowyer, K., Kopans, D., Kegelmeyer Jr., P., Moore, R., Chang, K., Munishkumaran, S.: Current status of the digital database for screening mammography. In: Karssemeijer, N., Thijssen, M., Hendriks, J., van Erning, L. (eds.) Digital Mammography, vol. 13, pp. 457–460. Springer, Heidelberg (1998)CrossRef Heath, M., Bowyer, K., Kopans, D., Kegelmeyer Jr., P., Moore, R., Chang, K., Munishkumaran, S.: Current status of the digital database for screening mammography. In: Karssemeijer, N., Thijssen, M., Hendriks, J., van Erning, L. (eds.) Digital Mammography, vol. 13, pp. 457–460. Springer, Heidelberg (1998)CrossRef
18.
Zurück zum Zitat Holland, C., Komogortsev, O.: Biometric identification via eye movement scanpaths in reading. In: 2011 International Joint Conference on Biometrics (IJCB), pp. 1–8, October 2011 Holland, C., Komogortsev, O.: Biometric identification via eye movement scanpaths in reading. In: 2011 International Joint Conference on Biometrics (IJCB), pp. 1–8, October 2011
19.
Zurück zum Zitat Holmqvist, K., Nyström, M., Andersson, R., Dewhurst, R., Jarodzka, H., Van de Weijer, J.: Eye Tracking: A Comprehensive Guide to Methods and Measures. Oxford University Press, Oxford (2011) Holmqvist, K., Nyström, M., Andersson, R., Dewhurst, R., Jarodzka, H., Van de Weijer, J.: Eye Tracking: A Comprehensive Guide to Methods and Measures. Oxford University Press, Oxford (2011)
22.
Zurück zum Zitat Krupinski, E.A.: Influence of experience on scanning strategies in mammography. Proc. SPIE Med. Imaging 2712, 95–101 (1996). International Society for Optics and PhotonicsCrossRef Krupinski, E.A.: Influence of experience on scanning strategies in mammography. Proc. SPIE Med. Imaging 2712, 95–101 (1996). International Society for Optics and PhotonicsCrossRef
23.
Zurück zum Zitat Krupinski, E.A., Graham, A.R., Weinstein, R.S.: Characterizing the development of visual search expertise in pathology residents viewing whole slide images. Hum. Pathol. 44(3), 357–364 (2013)CrossRef Krupinski, E.A., Graham, A.R., Weinstein, R.S.: Characterizing the development of visual search expertise in pathology residents viewing whole slide images. Hum. Pathol. 44(3), 357–364 (2013)CrossRef
29.
Zurück zum Zitat Miller, J., Hammond, T.: Wiiolin: a virtual instrument using the wii remote. In: Proceedings of the 2010 Conference on New Interfaces for Musical Expression (NIME), pp. 497–500 (2010) Miller, J., Hammond, T.: Wiiolin: a virtual instrument using the wii remote. In: Proceedings of the 2010 Conference on New Interfaces for Musical Expression (NIME), pp. 497–500 (2010)
33.
Zurück zum Zitat Paulson, B., Cummings, D., Hammond, T.: Object interaction detection using hand posture cues in an office setting. Int. J. Hum.-Comput. Stud. 69(1), 19–29 (2011)CrossRef Paulson, B., Cummings, D., Hammond, T.: Object interaction detection using hand posture cues in an office setting. Int. J. Hum.-Comput. Stud. 69(1), 19–29 (2011)CrossRef
35.
Zurück zum Zitat Paulson, B., Rajan, P., Davalos, P., Gutierrez-Osuna, R., Hammond, T.: What!?! no rubine features?: using geometric-based features to produce normalized confidence values for sketch recognition. In: HCC Workshop: Sketch Tools for Diagramming (VL/HCC), pp. 57–63 (2008) Paulson, B., Rajan, P., Davalos, P., Gutierrez-Osuna, R., Hammond, T.: What!?! no rubine features?: using geometric-based features to produce normalized confidence values for sketch recognition. In: HCC Workshop: Sketch Tools for Diagramming (VL/HCC), pp. 57–63 (2008)
36.
Zurück zum Zitat Pramanik, S., Bhattacharjee, D.: Geometric feature based face-sketch recognition. In: 2012 International Conference on Pattern Recognition, Informatics and Medical Engineering (PRIME), pp. 409–415, March 2012 Pramanik, S., Bhattacharjee, D.: Geometric feature based face-sketch recognition. In: 2012 International Conference on Pattern Recognition, Informatics and Medical Engineering (PRIME), pp. 409–415, March 2012
37.
Zurück zum Zitat American College of Radiology: BI-RADS Committee. Breast imaging reporting and data system. American College of Radiology (1998) American College of Radiology: BI-RADS Committee. Breast imaging reporting and data system. American College of Radiology (1998)
38.
Zurück zum Zitat Rajan, P., Hammond, T.: From paper to machine: extracting strokes from images for use in sketch recognition. In: Proceedings of the 5th Eurographics Conference on Sketch-Based Interfaces and Modeling, pp. 41–48. Eurographics Association (2008) Rajan, P., Hammond, T.: From paper to machine: extracting strokes from images for use in sketch recognition. In: Proceedings of the 5th Eurographics Conference on Sketch-Based Interfaces and Modeling, pp. 41–48. Eurographics Association (2008)
39.
Zurück zum Zitat Rayner, K.: Eye movements in reading and information processing: 20 years of research. Psychol. Bull. 124(3), 372 (1998)CrossRef Rayner, K.: Eye movements in reading and information processing: 20 years of research. Psychol. Bull. 124(3), 372 (1998)CrossRef
42.
Zurück zum Zitat Smith, R.A., Cokkinides, V., von Eschenbach, A.C., Levin, B., Cohen, C., Runowicz, C.D., Sener, S., Saslow, D., Eyre, H.J.: American cancer society guidelines for the early detection of cancer. CA Cancer J. Clin. 52(1), 8–22 (2002)CrossRef Smith, R.A., Cokkinides, V., von Eschenbach, A.C., Levin, B., Cohen, C., Runowicz, C.D., Sener, S., Saslow, D., Eyre, H.J.: American cancer society guidelines for the early detection of cancer. CA Cancer J. Clin. 52(1), 8–22 (2002)CrossRef
43.
Zurück zum Zitat Taele, P., Peschel, J., Hammond, T.: A sketch interactive approach to computer-assisted biology instruction. In: Proceedings of IUI 2009 Workshop on Sketch Recognition (2009) Taele, P., Peschel, J., Hammond, T.: A sketch interactive approach to computer-assisted biology instruction. In: Proceedings of IUI 2009 Workshop on Sketch Recognition (2009)
45.
Zurück zum Zitat Valentine, S., Vides, F., Lucchese, G., Turner, D., Kim, H.H., Li, W., Linsey, J., Hammond, T.: Mechanix: a sketch-based tutoring system for statics courses. In: Proceedings of the 24th Innovative Applications of Artificial Intelligence Conference on Artificial Intelligence (IAAI), pp. 2253–2260. AAAI (2012) Valentine, S., Vides, F., Lucchese, G., Turner, D., Kim, H.H., Li, W., Linsey, J., Hammond, T.: Mechanix: a sketch-based tutoring system for statics courses. In: Proceedings of the 24th Innovative Applications of Artificial Intelligence Conference on Artificial Intelligence (IAAI), pp. 2253–2260. AAAI (2012)
46.
Zurück zum Zitat Yoon, H.J., Carmichael, T.R., Tourassi, G.: Gaze as a biometric. In: Proceedings of SPIE, pp. 903707–903707 (2014) Yoon, H.J., Carmichael, T.R., Tourassi, G.: Gaze as a biometric. In: Proceedings of SPIE, pp. 903707–903707 (2014)
Metadaten
Titel
Geometry and Gesture-Based Features from Saccadic Eye-Movement as a Biometric in Radiology
verfasst von
Folami T. Alamudun
Tracy Hammond
Hong-Jun Yoon
Georgia D. Tourassi
Copyright-Jahr
2017
DOI
https://doi.org/10.1007/978-3-319-58628-1_11

Neuer Inhalt