Wolfgang Fuhl
ABSTRACT
Fast and robust pupil detection is an essential prerequisite for video-based eye-tracking in real-world settings. Several algorithms for image-based pupil detection have been proposed in the past, their applicability, however, is mostly limited to laboratory conditions. In real-world scenarios, automated pupil detection has to face various challenges, such as illumination changes, reflections (on glasses), make-up, non-centered eye recording, and physiological eye characteristics. We propose ElSe, a novel algorithm based on ellipse evaluation of a filtered edge image. We aim at a robust, inexpensive approach that can be integrated in embedded architectures, e.g., driving. The proposed algorithm was evaluated against four state-of-the-art methods on over 93,000 hand-labeled images from which 55,000 are new eye images contributed by this work. On average, the proposed method achieved a 14.53% improvement on the detection rate relative to the best state-of-the-art performer. Algorithm and data sets are available for download: ftp://[email protected] (password:eyedata).
- Fitzgibbon, A., Pilu, M., and Fisher, R. B. 1999. Direct least square fitting of ellipses. IEEE TPAMI 21. Google Scholar
Digital Library
- Fuhl, W., Kübler, T., Sippel, K., Rosenstiel, W., and Kasneci, E. 2015. Excuse: Robust pupil detection in real-world scenarios. In CAIP, Springer, 39--51.Google Scholar
- Gerstner, T., DeCarlo, D., Alexa, M., Finkelstein, A., Gingold, Y., and Nealen, A. 2012. Pixelated image abstraction. In Proceedings of the Symposium on NPAR, 29--36. Google ScholarDigital Library
- Goni, S., Echeto, J., Villanueva, A., and Cabeza, R. 2004. Robust algorithm for pupil-glint vector detection in a video-oculography eyetracking system. In ICPR, 941--944. Google ScholarDigital Library
- Javadi, A.-H., Hakimi, Z., Barati, M., Walsh, V., and Tcheang, L. 2015. Set: a pupil detection method using sinusoidal approximation. Frontiers in neuroengineering 8.Google Scholar
- Kasneci, E., Sippel, K., Aehling, K., Heister, M., Rosenstiel, W., Schiefer, U., and Papageorgiou, E. 2014. Driving with Binocular Visual Field Loss? A Study on a Supervised On-road Parcours with Simultaneous Eye and Head Tracking. Plos One 9, 2, e87470.Google ScholarCross Ref
- Kasneci, E., Sippel, K., Heister, M., Aehling, K., Rosenstiel, W., Schiefer, U., and Papageorgiou, E. 2014. Homonymous visual field loss and its impact on visual exploration: A supermarket study. TVST 3, 6.Google ScholarCross Ref
- Kasneci, E. 2013. Towards the Automated Recognition of Assistance Need for Drivers with Impaired Visual Field. PhD thesis, University of Tübingen.Google Scholar
- Keil, A., Albuquerque, G., Berger, K., and Magnor, M. A. 2010. Real-time gaze tracking with a consumer-grade video camera.Google Scholar
- Kopf, J., Shamir, A., and Peers, P. 2013. Content-adaptive image downscaling. ACM TOG 32. Google ScholarDigital Library
- Li, D., Winfield, D., and Parkhurst, D. J. 2005. Starburst: A hybrid algorithm for video-based eye tracking combining feature-based and model-based approaches. In CVPR Workshops 2005, 79--79. Google ScholarDigital Library
- Lin, L., Pan, L., Wei, L., and Yu, L. 2010. A robust and accurate detection of pupil images. In BMEI 2010, vol. 1, IEEE.Google Scholar
- Liu, X., Xu, F., and Fujimura, K. 2002. Real-time eye detection and tracking for driver observation under various light conditions. In IEEE Intelligent Vehicle Symposium, vol. 2.Google Scholar
- Long, X., Tonguz, O. K., and Kiderman, A. 2007. A high speed eye tracking system with robust pupil center estimation algorithm. In EMBS 2007, IEEE.Google Scholar
- Peréz, A., Cordoba, M., Garcia, A., Méndez, R., Munoz, M., Pedraza, J. L., and Sanchez, F. 2003. A precise eye-gaze detection and tracking system.Google Scholar
- Schnipke, S. K., and Todd, M. W. 2000. Trials and tribulations of using an eye-tracking system. In CHI'00 ext. abstr., ACM. Google ScholarDigital Library
- Sippel, K., Kasneci, E., Aehling, K., Heister, M., Rosenstiel, W., Schiefer, U., and Papageorgiou, E. 2014. Binocular Glaucomatous Visual Field Loss and Its Impact on Visual Exploration - A Supermarket Study. PLoS ONE 9, 8, e106089.Google ScholarCross Ref
- Świrski, L., Bulling, A., and Dodgson, N. 2012. Robust real-time pupil tracking in highly off-axis images. In Proceedings of the Symposium on ETRA, ACM, 173--176. Google ScholarDigital Library
- Trösterer, S., Meschtscherjakov, A., Wilfinger, D., and Tscheligi, M. 2014. Eye tracking in the car: Challenges in a dual-task scenario on a test track. In Proceedings of the 6th AutomotiveUI, ACM. Google ScholarDigital Library
- Valenti, R., and Gevers, T. 2012. Accurate eye center location through invariant isocentric patterns. TPAMI 34. Google ScholarDigital Library
- Zhu, D., Moore, S. T., and Raphan, T. 1999. Robust pupil center detection using a curvature algorithm. CMPB 59.Google Scholar
Index Terms
- ElSe: ellipse selection for robust pupil detection in real-world environments
Recommendations
PuReST: robust pupil tracking for real-time pervasive eye tracking
ETRA '18: Proceedings of the 2018 ACM Symposium on Eye Tracking Research & ApplicationsPervasive eye-tracking applications such as gaze-based human computer interaction and advanced driver assistance require real-time, accurate, and robust pupil detection. However, automated pupil detection has proved to be an intricate task in real-world ...
Labelled pupils in the wild: a dataset for studying pupil detection in unconstrained environments
ETRA '16: Proceedings of the Ninth Biennial ACM Symposium on Eye Tracking Research & ApplicationsWe present labelled pupils in the wild (LPW), a novel dataset of 66 high-quality, high-speed eye region videos for the development and evaluation of pupil detection algorithms. The videos in our dataset were recorded from 22 participants in everyday ...
PuRe: Robust pupil detection for real-time pervasive eye tracking
Highlights- A novel computer-vision based algorithm for robust pupil detection is introduced.
Graphical abstractDisplay Omitted
AbstractReal-time, accurate, and robust pupil detection is an essential prerequisite to enable pervasive eye-tracking and its applications – e.g., gaze-based human computer interaction, health monitoring, foveated rendering, and advanced ...
Comments