Top

Published in:

2017 | OriginalPaper | Chapter

Geometry and Gesture-Based Features from Saccadic Eye-Movement as a Biometric in Radiology

Authors : Folami T. Alamudun, Tracy Hammond, Hong-Jun Yoon, Georgia D. Tourassi

Published in: Augmented Cognition. Neurocognition and Machine Learning

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

In this study, we present a novel application of sketch gesture recognition on eye-movement for biometric identification and estimating task expertise. The study was performed for the task of mammographic screening with simultaneous viewing of four coordinated breast views as typically done in clinical practice. Eye-tracking data and diagnostic decisions collected for 100 mammographic cases (25 normal, 25 benign, 50 malignant) and 10 readers (three board certified radiologists and seven radiology residents), formed the corpus for this study. Sketch gesture recognition techniques were employed to extract geometric and gesture-based features from saccadic eye-movements. Our results show that saccadic eye-movement, characterized using sketch-based features, result in more accurate models for predicting individual identity and level of expertise than more traditional eye-tracking features.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

previous chapter Interactive Image Segmentation Method of Eye Movement Data and EEG Data

next chapter Assessing Workload with Low Cost Eye Tracking During a Supervisory Control Task

Alamudun, F., Yoon, H.J., Hudson, K.B., Morin-Ducote, G., Hammond, T., Tourassi, G.D.: Fractal analysis of visual search activity for mass detection during mammographic screening. Med. Phys. (2017). http://dx.doi.org/10.1002/mp.12100

Bartley, J., Forsyth, J., Pendse, P., Xin, D., Brown, G., Hagseth, P., Agrawal, A., Goldberg, D.W., Hammond, T.: World of workout: a contextual mobile RPG to encourage long term fitness. In: Proceedings of the 2nd ACM SIGSPATIAL International Workshop on the Use of GIS in Public Health, pp. 60–67. ACM (2013)

Bednarik, R., Kinnunen, T., Mihaila, A., Fränti, P.: Eye-movements as a biometric. In: Kalviainen, H., Parkkinen, J., Kaarna, A. (eds.) SCIA 2005. LNCS, vol. 3540, pp. 780–789. Springer, Heidelberg (2005). doi:10.1007/11499145_79 CrossRef

Breiman, L.: Random forests. Mach. Learn. 45(1), 5–32 (2001)CrossRefMATH

Chi, M.T., Glaser, R., Farr, M.J.: The Nature of Expertise. Psychology Press, Park Drive (2014)MATH

Çığ, Ç., Sezgin, T.M.: Gaze-based prediction of pen-based virtual interaction tasks. Int. J. Hum.-Comput. Stud. 73, 91–106 (2015). http://www.sciencedirect.com/science/article/pii/S1071581914001244 CrossRef

Corey, P., Hammond, T.: Gladder: combining gesture and geometric sketch recognition. In: Proceedings of the 23rd National Conference on Artificial Intelligence, vol. 3, pp. 1788–1789. AAAI Press (2008)

Deravi, F., Guness, S.P.: Gaze trajectory as a biometric modality. In: BIOSIGNALS, pp. 335–341 (2011)

Dixon, D., Prasad, M., Hammond, T.: iCanDraw: using sketch recognition and corrective feedback to assist a user in drawing human faces. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 897–906. ACM (2010)

10.

Eoff, B.D., Hammond, T.: Who dotted that‘i’?: context free user differentiation through pressure and tilt pen data. In: Proceedings of Graphics Interface 2009, pp. 149–156. Canadian Information Processing Society (2009)

11.

Galdi, C., Nappi, M., Riccio, D., Cantoni, V., Porta, M.: A new gaze analysis based soft-biometric. In: Carrasco-Ochoa, J.A., Martínez-Trinidad, J.F., Rodríguez, J.S., Baja, G.S. (eds.) MCPR 2013. LNCS, vol. 7914, pp. 136–144. Springer, Heidelberg (2013). doi:10.1007/978-3-642-38989-4_14 CrossRef

12.

Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., Witten, I.H.: The weka data mining software: an update. ACM SIGKDD Explor. Newsl. 11(1), 10–18 (2009)CrossRef

13.

Hammond, T., Gajos, K., Davis, R., Shrobe, H.E.: An agent-based system for capturing and indexing software design meetings. In: Proceedings of the International Workshop on Agents in Design (WAID 2002). Citeseer (2002)

14.

Hammond, T., O’Sullivan, B.: Recognizing freeform hand-sketched constraint network diagrams by combining geometry and context. In: Proceedings of the Eurographics Ireland (2007)

15.

Hammond, T., Prasad, M., Dixon, D.: Art 101: learning to draw through sketch recognition. In: Taylor, R., Boulanger, P., Krüger, A., Olivier, P. (eds.) SG 2010. LNCS, vol. 6133, pp. 277–280. Springer, Heidelberg (2010). doi:10.1007/978-3-642-13544-6_30 CrossRef

16.

Hammond, T.A.: Ladder: A perceptually-based language to simplify sketch recognition user interface development. Ph.D. thesis, Massachusetts Institute of Technology (2007)

17.

Heath, M., Bowyer, K., Kopans, D., Kegelmeyer Jr., P., Moore, R., Chang, K., Munishkumaran, S.: Current status of the digital database for screening mammography. In: Karssemeijer, N., Thijssen, M., Hendriks, J., van Erning, L. (eds.) Digital Mammography, vol. 13, pp. 457–460. Springer, Heidelberg (1998)CrossRef

18.

Holland, C., Komogortsev, O.: Biometric identification via eye movement scanpaths in reading. In: 2011 International Joint Conference on Biometrics (IJCB), pp. 1–8, October 2011

19.

Holmqvist, K., Nyström, M., Andersson, R., Dewhurst, R., Jarodzka, H., Van de Weijer, J.: Eye Tracking: A Comprehensive Guide to Methods and Measures. Oxford University Press, Oxford (2011)

20.

Kara, L.B., Stahovich, T.F.: An image-based, trainable symbol recognizer for hand-drawn sketches. Comput. Graph. 29(4), 501–517 (2005). http://www.sciencedirect.com/science/article/pii/S0097849305000853 CrossRef

21.

Kasprowski, P., Ober, J.: Eye movements in biometrics. In: Maltoni, D., Jain, A.K. (eds.) BioAW 2004. LNCS, vol. 3087, pp. 248–258. Springer, Heidelberg (2004). doi:10.1007/978-3-540-25976-3_23 CrossRef

22.

Krupinski, E.A.: Influence of experience on scanning strategies in mammography. Proc. SPIE Med. Imaging 2712, 95–101 (1996). International Society for Optics and PhotonicsCrossRef

23.

Krupinski, E.A., Graham, A.R., Weinstein, R.S.: Characterizing the development of visual search expertise in pathology residents viewing whole slide images. Hum. Pathol. 44(3), 357–364 (2013)CrossRef

24.

Krupinski, E.A., Tillack, A.A., Richter, L., Henderson, J.T., Bhattacharyya, A.K., Scott, K.M., Graham, A.R., Descour, M.R., Davis, J.R., Weinstein, R.S.: Eye-movement study and human performance using telepathology virtual slides. Implications for medical education and differences with experience. Hum. Pathol. 37(12), 1543–1556 (2006). http://www.sciencedirect.com/science/article/pii/S0046817706005302 CrossRef

25.

Kundel, H.L., Paul, S., La Follette, J.: Visual search patterns and experience with radiological images. Radiology 103(3), 523–528 (1972). pMID: 5022947. http://dx.doi.org/10.1148/103.3.523 CrossRef

26.

Li, W., Hammond, T.: Recognizing text through sound alone. In: Proceedings of the Twenty-Fifth AAAI Conference on Artificial Intelligence, AAAI 2011, pp. 1481–1486. AAAI Press (2011). http://dl.acm.org/citation.cfm?id=2900423.2900657

27.

Long Jr., A.C., Landay, J.A., Rowe, L.A., Michiels, J.: Visual similarity of pen gestures. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 2000, pp. 360–367. ACM, New York (2000). http://doi.acm.org/10.1145/332040.332458

28.

Lynch, P.J.: Eye movements abductors, December 2006. https://en.wikipedia.org/wiki/File:Eye_movements_abductors.jpg

29.

Miller, J., Hammond, T.: Wiiolin: a virtual instrument using the wii remote. In: Proceedings of the 2010 Conference on New Interfaces for Musical Expression (NIME), pp. 497–500 (2010)

30.

Nodine, C.F., Kundel, H.L., Mello-Thoms, C., Weinstein, S.P., Orel, S.G., Sullivan, D.C., Conant, E.F.: How experience and training influence mammography expertise. Acad. Radiol. 6(10), 575–585 (1999). http://www.sciencedirect.com/science/article/pii/S1076633299802529 CrossRef

31.

Noton, D., Stark, L.: Scanpaths in eye movements during pattern perception. Science 171(3968), 308–311 (1971). http://science.sciencemag.org/content/171/3968/308 CrossRef

32.

Ouyang, T.Y., Davis, R.: A visual approach to sketched symbol recognition. In: Proceedings of the 21st International Joint Conference on Artificial Intelligence, IJCAI 2009, pp. 1463–1468. Morgan Kaufmann Publishers Inc., San Francisco (2009). http://dl.acm.org/citation.cfm?id=1661445.1661680

33.

Paulson, B., Cummings, D., Hammond, T.: Object interaction detection using hand posture cues in an office setting. Int. J. Hum.-Comput. Stud. 69(1), 19–29 (2011)CrossRef

34.

Paulson, B., Hammond, T.: Paleosketch: accurate primitive sketch recognition and beautification. In: Proceedings of the 13th International Conference on Intelligent User Interfaces, IUI 2008, pp. 1–10. ACM, New York (2008). http://doi.acm.org/10.1145/1378773.1378775

35.

Paulson, B., Rajan, P., Davalos, P., Gutierrez-Osuna, R., Hammond, T.: What!?! no rubine features?: using geometric-based features to produce normalized confidence values for sketch recognition. In: HCC Workshop: Sketch Tools for Diagramming (VL/HCC), pp. 57–63 (2008)

36.

Pramanik, S., Bhattacharjee, D.: Geometric feature based face-sketch recognition. In: 2012 International Conference on Pattern Recognition, Informatics and Medical Engineering (PRIME), pp. 409–415, March 2012

37.

American College of Radiology: BI-RADS Committee. Breast imaging reporting and data system. American College of Radiology (1998)

38.

Rajan, P., Hammond, T.: From paper to machine: extracting strokes from images for use in sketch recognition. In: Proceedings of the 5th Eurographics Conference on Sketch-Based Interfaces and Modeling, pp. 41–48. Eurographics Association (2008)

39.

Rayner, K.: Eye movements in reading and information processing: 20 years of research. Psychol. Bull. 124(3), 372 (1998)CrossRef

40.

Rubine, D.: Specifying gestures by example. SIGGRAPH Comput. Graph. 25(4), 329–337 (1991). http://doi.acm.org/10.1145/127719.122753 CrossRef

41.

Schnitzer, B.S., Kowler, E.: Eye movements during multiple readings of the same text. Vis. Res. 46(10), 1611–1632 (2006). http://www.sciencedirect.com/science/article/pii/S0042698905004864 CrossRef

42.

Smith, R.A., Cokkinides, V., von Eschenbach, A.C., Levin, B., Cohen, C., Runowicz, C.D., Sener, S., Saslow, D., Eyre, H.J.: American cancer society guidelines for the early detection of cancer. CA Cancer J. Clin. 52(1), 8–22 (2002)CrossRef

43.

Taele, P., Peschel, J., Hammond, T.: A sketch interactive approach to computer-assisted biology instruction. In: Proceedings of IUI 2009 Workshop on Sketch Recognition (2009)

44.

Tweed, D., Vilis, T.: Geometric relations of eye position and velocity vectors during saccades. Vis. Res. 30(1), 111–127 (1990). http://www.sciencedirect.com/science/article/pii/0042698990901314 CrossRef

45.

Valentine, S., Vides, F., Lucchese, G., Turner, D., Kim, H.H., Li, W., Linsey, J., Hammond, T.: Mechanix: a sketch-based tutoring system for statics courses. In: Proceedings of the 24th Innovative Applications of Artificial Intelligence Conference on Artificial Intelligence (IAAI), pp. 2253–2260. AAAI (2012)

46.

Yoon, H.J., Carmichael, T.R., Tourassi, G.: Gaze as a biometric. In: Proceedings of SPIE, pp. 903707–903707 (2014)

Title: Geometry and Gesture-Based Features from Saccadic Eye-Movement as a Biometric in Radiology
Authors: Folami T. Alamudun
Tracy Hammond
Hong-Jun Yoon
Georgia D. Tourassi
Publisher: Springer International Publishing
Book: Augmented Cognition. Neurocognition and Machine Learning
Print ISBN: 978-3-319-58627-4

Electronic ISBN: 978-3-319-58628-1

Copyright Year: 2017
DOI: https://doi.org/10.1007/978-3-319-58628-1_11

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"