Skip to main content
Top

2020 | OriginalPaper | Chapter

Deep Eyedentification: Biometric Identification Using Micro-movements of the Eye

Authors : Lena A. Jäger, Silvia Makowski, Paul Prasse, Sascha Liehr, Maximilian Seidler, Tobias Scheffer

Published in: Machine Learning and Knowledge Discovery in Databases

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

We study involuntary micro-movements of the eye for biometric identification. While prior studies extract lower-frequency macro-movements from the output of video-based eye-tracking systems and engineer explicit features of these macro-movements, we develop a deep convolutional architecture that processes the raw eye-tracking signal. Compared to prior work, the network attains a lower error rate by one order of magnitude and is faster by two orders of magnitude: it identifies users accurately within seconds.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
2.
go back to reference Abdelwahab, A., Kliegl, R., Landwehr, N.: A semiparametric model for Bayesian reader identification. In: Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, EMNLP 2016, pp. 585–594 (2016) Abdelwahab, A., Kliegl, R., Landwehr, N.: A semiparametric model for Bayesian reader identification. In: Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, EMNLP 2016, pp. 585–594 (2016)
3.
go back to reference Bargary, G., Bosten, J.M., Goodbourn, P.T., Lawrance-Owen, A.J., Hogg, R.E., Mollon, J.: Individual differences in human eye movements: an oculomotor signature? Vision. Res. 141, 157–169 (2017)CrossRef Bargary, G., Bosten, J.M., Goodbourn, P.T., Lawrance-Owen, A.J., Hogg, R.E., Mollon, J.: Individual differences in human eye movements: an oculomotor signature? Vision. Res. 141, 157–169 (2017)CrossRef
5.
go back to reference Cantoni, V., Galdi, C., Nappi, M., Porta, M., Riccio, D.: GANT: gaze analysis technique for human identification. Pattern Recogn. 48, 1027–1038 (2015)CrossRef Cantoni, V., Galdi, C., Nappi, M., Porta, M., Riccio, D.: GANT: gaze analysis technique for human identification. Pattern Recogn. 48, 1027–1038 (2015)CrossRef
6.
go back to reference Cao, Q., Shen, L., Xie, W., Parkhi, O.M., Zisserman, A.: VGGFace2: a dataset for recognising faces across pose and age. In: 13th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2018, pp. 67–74 (2018) Cao, Q., Shen, L., Xie, W., Parkhi, O.M., Zisserman, A.: VGGFace2: a dataset for recognising faces across pose and age. In: 13th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2018, pp. 67–74 (2018)
8.
go back to reference Cuong, N., Dinh, V., Ho, L.S.T.: Mel-frequency cepstral coefficients for eye movement identification. In: 24th International Conference on Tools with Artificial Intelligence, ICTAI 2012, pp. 253–260 (2012) Cuong, N., Dinh, V., Ho, L.S.T.: Mel-frequency cepstral coefficients for eye movement identification. In: 24th International Conference on Tools with Artificial Intelligence, ICTAI 2012, pp. 253–260 (2012)
9.
go back to reference Cymek, D., Venjakob, A., Ruff, S., Lutz, O.M., Hofmann, S., Roetting, M.: Entering PIN codes by smooth pursuit eye movements. J. Eye Mov. Res. 7, 1–11 (2014) Cymek, D., Venjakob, A., Ruff, S., Lutz, O.M., Hofmann, S., Roetting, M.: Entering PIN codes by smooth pursuit eye movements. J. Eye Mov. Res. 7, 1–11 (2014)
10.
go back to reference Darwish, A., Pasquier, M.: Biometric identification using the dynamic features of the eyes. In: 6th International Conference on Biometrics: Theory, Applications and Systems, BTAS 2013, pp. 1–6 (2013) Darwish, A., Pasquier, M.: Biometric identification using the dynamic features of the eyes. In: 6th International Conference on Biometrics: Theory, Applications and Systems, BTAS 2013, pp. 1–6 (2013)
11.
go back to reference De Luca, A., Weiss, R., Hußmann, H., An, X.: Eyepass - eye-stroke authentication for public terminals. In: Extended Abstracts on Human Factors in Computing Systems, CHI EA 2008, pp. 3003–3008 (2007) De Luca, A., Weiss, R., Hußmann, H., An, X.: Eyepass - eye-stroke authentication for public terminals. In: Extended Abstracts on Human Factors in Computing Systems, CHI EA 2008, pp. 3003–3008 (2007)
12.
go back to reference Ditchburn, R.W., Ginsborg, B.L.: Vision with a stabilized retinal image. Nature 170, 36–37 (1952)CrossRef Ditchburn, R.W., Ginsborg, B.L.: Vision with a stabilized retinal image. Nature 170, 36–37 (1952)CrossRef
13.
go back to reference Dunphy, P., Fitch, A., Olivier, P.: Gaze-contingent passwords at the ATM. In: 4th Conference on Communication by Gaze Interaction, COGAIN, pp. 59–62 (2008) Dunphy, P., Fitch, A., Olivier, P.: Gaze-contingent passwords at the ATM. In: 4th Conference on Communication by Gaze Interaction, COGAIN, pp. 59–62 (2008)
14.
go back to reference Engbert, R., Kliegl, R.: Microsaccades uncover the orientation of covert attention. Vision. Res. 43, 1035–1045 (2003)CrossRef Engbert, R., Kliegl, R.: Microsaccades uncover the orientation of covert attention. Vision. Res. 43, 1035–1045 (2003)CrossRef
15.
go back to reference Engbert, R., Mergenthaler, K.: Microsaccades are triggered by low retinal image slip. Proc. Nat. Acad. Sci. USA 103, 7192–7197 (2006)CrossRef Engbert, R., Mergenthaler, K.: Microsaccades are triggered by low retinal image slip. Proc. Nat. Acad. Sci. USA 103, 7192–7197 (2006)CrossRef
16.
go back to reference Erdogmus, N., Marcel, S.: Spoofing face recognition with 3D masks. IEEE Trans. Inf. Forensics Secur. 9(7), 1084–1097 (2014)CrossRef Erdogmus, N., Marcel, S.: Spoofing face recognition with 3D masks. IEEE Trans. Inf. Forensics Secur. 9(7), 1084–1097 (2014)CrossRef
17.
go back to reference Galdi, C., Nappi, M., Riccio, D., Cantoni, V., Porta, M.: A new gaze analysis based soft biometric. In: 5th Mexican Conference on Pattern Recognition, MCPR 2013, pp. 136–144 (2013) Galdi, C., Nappi, M., Riccio, D., Cantoni, V., Porta, M.: A new gaze analysis based soft biometric. In: 5th Mexican Conference on Pattern Recognition, MCPR 2013, pp. 136–144 (2013)
18.
go back to reference Graves, A., Schmidhuber, J.: Framewise phoneme classification with bidirectional LSTM and other neural network architectures. Neural Netw. 18(5–6), 602–610 (2005)CrossRef Graves, A., Schmidhuber, J.: Framewise phoneme classification with bidirectional LSTM and other neural network architectures. Neural Netw. 18(5–6), 602–610 (2005)CrossRef
19.
go back to reference Holland, C., Komogortsev, O.V.: Biometric identification via eye movement scanpaths in reading. In: 2011 International Joint Conference on Biometrics, IJCB 2011, pp. 1–8 (2011) Holland, C., Komogortsev, O.V.: Biometric identification via eye movement scanpaths in reading. In: 2011 International Joint Conference on Biometrics, IJCB 2011, pp. 1–8 (2011)
20.
go back to reference Holland, C., Komogortsev, O.: Complex eye movement pattern biometrics: Analyzing fixations and saccades. In: 2013 International Conference on Biometrics, ICB 2013 (2013) Holland, C., Komogortsev, O.: Complex eye movement pattern biometrics: Analyzing fixations and saccades. In: 2013 International Conference on Biometrics, ICB 2013 (2013)
21.
go back to reference Holmqvist, K., Nyström, M., Andersson, R., Dewhurst, R., Jarodzka, H., Van de Weijer, J.: Eye Tracking: A Comprehensive Guide to Methods and Measures. Oxford University Press, Oxford (2011) Holmqvist, K., Nyström, M., Andersson, R., Dewhurst, R., Jarodzka, H., Van de Weijer, J.: Eye Tracking: A Comprehensive Guide to Methods and Measures. Oxford University Press, Oxford (2011)
22.
go back to reference Kasprowski, P.: Human identification using eye movements. Ph.D. thesis, Silesian Unversity of Technology, Poland (2004) Kasprowski, P.: Human identification using eye movements. Ph.D. thesis, Silesian Unversity of Technology, Poland (2004)
23.
go back to reference Kasprowski, P., Ober, J.: Enhancing eye-movement-based biometric identification method by using voting classifiers. In: Proceedings of SPIE 5779: Biometric Technology for Human Identification II, pp. 314–323 (2005) Kasprowski, P., Ober, J.: Enhancing eye-movement-based biometric identification method by using voting classifiers. In: Proceedings of SPIE 5779: Biometric Technology for Human Identification II, pp. 314–323 (2005)
24.
go back to reference Kasprowski, P., Harkeżlak, K.: The second eye movements verification and identification competition. In: Proceedings of the International Joint Conference on Biometrics, IJCB 2014 (2014) Kasprowski, P., Harkeżlak, K.: The second eye movements verification and identification competition. In: Proceedings of the International Joint Conference on Biometrics, IJCB 2014 (2014)
25.
go back to reference Kasprowski, P., Komogortsev, O.V., Karpov, A.: First eye movement verification and identification competition at BTAS 2012. In: Proceedings of the IEEE Fifth International Conference on Biometrics: Theory, Applications and Systems, BTAS 2012, pp. 195–202 (2012) Kasprowski, P., Komogortsev, O.V., Karpov, A.: First eye movement verification and identification competition at BTAS 2012. In: Proceedings of the IEEE Fifth International Conference on Biometrics: Theory, Applications and Systems, BTAS 2012, pp. 195–202 (2012)
27.
go back to reference Kinnunen, T., Sedlak, F., Bednarik, R.: Towards task-independent person authentication using eye movement signals. In: Proceedings of the 2010 Symposium on Eye-Tracking Research and Applications, ETRA 2010, pp. 187–190 (2010) Kinnunen, T., Sedlak, F., Bednarik, R.: Towards task-independent person authentication using eye movement signals. In: Proceedings of the 2010 Symposium on Eye-Tracking Research and Applications, ETRA 2010, pp. 187–190 (2010)
28.
go back to reference Ko, H.K., Snodderly, D.M., Poletti, M.: Eye movements between saccades: measuring ocular drift and tremor. Vision. Res. 122, 93–104 (2016)CrossRef Ko, H.K., Snodderly, D.M., Poletti, M.: Eye movements between saccades: measuring ocular drift and tremor. Vision. Res. 122, 93–104 (2016)CrossRef
29.
go back to reference Kumar, M., Garfinkel, T., Boneh, D., Winograd, T.: Reducing shoulder-surfing by using gaze-based password entry. In: Proceedings of the 3rd Symposium on Usable Privacy and Security, SOUPS 2007, pp. 13–19 (2007) Kumar, M., Garfinkel, T., Boneh, D., Winograd, T.: Reducing shoulder-surfing by using gaze-based password entry. In: Proceedings of the 3rd Symposium on Usable Privacy and Security, SOUPS 2007, pp. 13–19 (2007)
30.
go back to reference Landwehr, N., Arzt, S., Scheffer, T., Kliegl, R.: A model of individual differences in gaze control during reading. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing, EMNLP 2014, pp. 1810–1815 (2014) Landwehr, N., Arzt, S., Scheffer, T., Kliegl, R.: A model of individual differences in gaze control during reading. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing, EMNLP 2014, pp. 1810–1815 (2014)
31.
go back to reference MaatenMaaten, L.V.D., Hinton, G.: Visualizing data using t-SNE. J. Mach. Learn. Res. 9, 2579–2605 (2008)MATH MaatenMaaten, L.V.D., Hinton, G.: Visualizing data using t-SNE. J. Mach. Learn. Res. 9, 2579–2605 (2008)MATH
32.
go back to reference Maeder, A., Fookes, C., Sridharan, S.: Gaze based user authentication for personal computer applications. In: Proceedings of the 2004 International Symposium on Intelligent Multimedia, Video and Speech Processing, pp. 727–730 (2004) Maeder, A., Fookes, C., Sridharan, S.: Gaze based user authentication for personal computer applications. In: Proceedings of the 2004 International Symposium on Intelligent Multimedia, Video and Speech Processing, pp. 727–730 (2004)
33.
go back to reference Makowski, S., Jäger, L.A., Abdelwahab, A., Landwehr, N., Scheffer, T.: A discriminative model for identifying readers and assessing text comprehension from eye movements. In: Machine Learning and Knowledge Discovery in Databases, ECML PKDD 2018, pp. 209–225 (2019) Makowski, S., Jäger, L.A., Abdelwahab, A., Landwehr, N., Scheffer, T.: A discriminative model for identifying readers and assessing text comprehension from eye movements. In: Machine Learning and Knowledge Discovery in Databases, ECML PKDD 2018, pp. 209–225 (2019)
34.
go back to reference Martinez-Conde, S., Macknik, S.L., Hubel, D.H.: The role of fixational eye movements in visual perception. Nat. Rev. Neurosci. 5, 229–240 (2004)CrossRef Martinez-Conde, S., Macknik, S.L., Hubel, D.H.: The role of fixational eye movements in visual perception. Nat. Rev. Neurosci. 5, 229–240 (2004)CrossRef
35.
go back to reference Martinez-Conde, S., Macknik, S.L., Troncoso, X.G., Dyar, T.A.: Microsaccades counteract visual fading during fixation. Neuron 49, 297–305 (2006)CrossRef Martinez-Conde, S., Macknik, S.L., Troncoso, X.G., Dyar, T.A.: Microsaccades counteract visual fading during fixation. Neuron 49, 297–305 (2006)CrossRef
36.
go back to reference Martinez-Conde, S., Macknik, S.L., Troncoso, X.G., Hubel, D.H.: Microsaccades: a neurophysiological analysis. Trends Neurosci. 32, 463–475 (2009)CrossRef Martinez-Conde, S., Macknik, S.L., Troncoso, X.G., Hubel, D.H.: Microsaccades: a neurophysiological analysis. Trends Neurosci. 32, 463–475 (2009)CrossRef
38.
go back to reference Nalla, P.R., Kumar, A.: Toward more accurate iris recognition using cross-spectral matching. IEEE Trans. Image Process. 26, 208–221 (2017)MathSciNetCrossRef Nalla, P.R., Kumar, A.: Toward more accurate iris recognition using cross-spectral matching. IEEE Trans. Image Process. 26, 208–221 (2017)MathSciNetCrossRef
39.
go back to reference Nyström, M., Hansen, D.W., Andersson, R., Hooge, I.: Why have microsaccades become larger? Investigating eye deformations and detection algorithms. Vision. Res. 118, 17–24 (2016)CrossRef Nyström, M., Hansen, D.W., Andersson, R., Hooge, I.: Why have microsaccades become larger? Investigating eye deformations and detection algorithms. Vision. Res. 118, 17–24 (2016)CrossRef
40.
go back to reference Otero-Millan, J., Troncoso, X.G., Macknik, S.L., Serrano-Pedraza, I., Martinez-Conde, S.: Saccades and microsaccades during visual fixation, exploration, and search: foundations for a common saccadic generator. J. Vis. 8(14), 21 (2008)CrossRef Otero-Millan, J., Troncoso, X.G., Macknik, S.L., Serrano-Pedraza, I., Martinez-Conde, S.: Saccades and microsaccades during visual fixation, exploration, and search: foundations for a common saccadic generator. J. Vis. 8(14), 21 (2008)CrossRef
41.
go back to reference Poynter, W., Barber, M., Inman, J., Wiggins, C.: Individuals exhibit idiosyncratic eye-movement behavior profiles across tasks. Vision. Res. 89, 32–38 (2013)CrossRef Poynter, W., Barber, M., Inman, J., Wiggins, C.: Individuals exhibit idiosyncratic eye-movement behavior profiles across tasks. Vision. Res. 89, 32–38 (2013)CrossRef
42.
go back to reference Reddi, S.J., Kale, S., Kumar, S.: On the convergence of Adam and beyond. In: International Conference on Learning Representations, ICLR 2018 (2018) Reddi, S.J., Kale, S., Kumar, S.: On the convergence of Adam and beyond. In: International Conference on Learning Representations, ICLR 2018 (2018)
43.
go back to reference Rigas, I., Economou, G., Fotopoulos, S.: Biometric identification based on the eye movements and graph matching techniques. Patt. Recogn. Lett. 33, 786–792 (2012)CrossRef Rigas, I., Economou, G., Fotopoulos, S.: Biometric identification based on the eye movements and graph matching techniques. Patt. Recogn. Lett. 33, 786–792 (2012)CrossRef
44.
go back to reference Rigas, I., Economou, G., Fotopoulos, S.: Human eye movements as a trait for biometrical identification. In: Fifth International Conference on Biometrics: Theory, Applications and Systems, BTAS 2012, pp. 217–222 (2012) Rigas, I., Economou, G., Fotopoulos, S.: Human eye movements as a trait for biometrical identification. In: Fifth International Conference on Biometrics: Theory, Applications and Systems, BTAS 2012, pp. 217–222 (2012)
45.
go back to reference Rigas, I., Komogortsev, O., Shadmehr, R.: Biometric recognition via eye movements: saccadic vigor and acceleration cues. ACM Trans. Appl. Percept. 13(2), 6 (2016)CrossRef Rigas, I., Komogortsev, O., Shadmehr, R.: Biometric recognition via eye movements: saccadic vigor and acceleration cues. ACM Trans. Appl. Percept. 13(2), 6 (2016)CrossRef
46.
go back to reference Riggs, L.A., Ratliff, F.: The effects of counteracting the normal movements of the eye. J. Opt. Soc. Am. 42, 872–873 (1952) Riggs, L.A., Ratliff, F.: The effects of counteracting the normal movements of the eye. J. Opt. Soc. Am. 42, 872–873 (1952)
47.
go back to reference Srivastava, N., Agrawal, U., Roy, S., Tiwary, U.S.: Human identification using linear multiclass SVM and eye movement biometrics. In: 8th International Conference on Contemporary Computing, IC3, pp. 365–369 (2015) Srivastava, N., Agrawal, U., Roy, S., Tiwary, U.S.: Human identification using linear multiclass SVM and eye movement biometrics. In: 8th International Conference on Contemporary Computing, IC3, pp. 365–369 (2015)
48.
go back to reference Weaver, J., Mock, K., Hoanca, B.: Gaze-based password authentication through automatic clustering of gaze points. In: 2011 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2011, pp. 2749–2754 (2011) Weaver, J., Mock, K., Hoanca, B.: Gaze-based password authentication through automatic clustering of gaze points. In: 2011 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2011, pp. 2749–2754 (2011)
Metadata
Title
Deep Eyedentification: Biometric Identification Using Micro-movements of the Eye
Authors
Lena A. Jäger
Silvia Makowski
Paul Prasse
Sascha Liehr
Maximilian Seidler
Tobias Scheffer
Copyright Year
2020
DOI
https://doi.org/10.1007/978-3-030-46147-8_18

Premium Partner