Lech Świrski
Andreas Bulling
Neil Dodgson
ABSTRACT
Robust, accurate, real-time pupil tracking is a key component for online gaze estimation. On head-mounted eye trackers, existing algorithms that rely on circular pupils or contiguous pupil regions fail to detect or accurately track the pupil. This is because the pupil ellipse is often highly eccentric and partially occluded by eyelashes. We present a novel, real-time dark-pupil tracking algorithm that is robust under such conditions. Our approach uses a Haar-like feature detector to roughly estimate the pupil location, performs a k-means segmentation on the surrounding region to refine the pupil centre, and fits an ellipse to the pupil using a novel image-aware Random Sample Concensus (RANSAC) ellipse fitting. We compare our approach against existing real-time pupil tracking implementations, using a set of manually labelled infra-red dark-pupil eye images. We show that our technique has a higher pupil detection rate and greater pupil tracking accuracy.
Supplemental Material
- Boykov, Y. Y., and Jolly, M.-P. 2001. Interactive graph cuts for optimal boundary & region segmentation of objects in N-D images. In Proc. ICCV, 105--112.Google Scholar
- Chang, F., Chen, C.-J., and Lu, C.-J. 2004. A linear-time component-labeling algorithm using contour tracing technique. Computer Vision and Image Understanding 93, 2, 206--220. Google ScholarDigital Library
- Chau, M., and Betke, M. 2005. Real Time Eye Tracking and Blink Detection with USB Cameras. Tech. rep., Boston University Computer Science.Google Scholar
- Fischler, M. A., and Bolles, R. C. 1981. Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Communications of the ACM 24, 6 (June), 381--395. Google ScholarDigital Library
- Fitzgibbon, A., Pilu, M., and Fisher, R. B. 1999. Direct least square fitting of ellipses. IEEE TPAMI 21, 5, 476--480. Google ScholarDigital Library
- Hansen, D. W., and Ji, Q. 2010. In the eye of the beholder: a survey of models for eyes and gaze. IEEE TPAMI 32, 3, 478--500. Google ScholarDigital Library
- Li, D., Winfield, D., and Parkhurst, D. J. 2005. Starburst: A hybrid algorithm for video-based eye tracking combining feature-based and model-based approaches. In Proc. IEEE Vision for Human-Computer Interaction Workshop, 1--8.Google Scholar
- Rosin, P. L. 1996. Analysing error of fit functions for ellipses. Pattern Recognition Letters 17, 14, 1461--1470. Google ScholarDigital Library
- San Agustin, J., Skovsgaard, H., Mollenbach, E., Barret, M., Tall, M., Hansen, D. W., and Hansen, J. P. 2010. Evaluation of a low-cost open-source gaze tracker. In Proc. ETRA, 77--80. Google ScholarDigital Library
- Viola, P., and Jones, M. 2001. Rapid object detection using a boosted cascade of simple features. In Proc. CVPR, I-511--I-518.Google Scholar
Recommendations
Pupil: an open source platform for pervasive eye tracking and mobile gaze-based interaction
UbiComp '14 Adjunct: Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct PublicationIn this paper we present Pupil -- an accessible, affordable, and extensible open source platform for pervasive eye tracking and gaze-based interaction. Pupil comprises 1) a light-weight eye tracking headset, 2) an open source software framework for ...
Pupil vs. Eyelid: Evaluating the Accuracy of Blink Detection in Pupil-based Eye Tracking Devices
AbstractSpontaneous eye blinks as a means to tap into human cognitive and affective processes have been demonstrated to offer valuable insight in various fields of application, such as human-computer-interaction and driver drowsiness detection. ...
Event-Based Pupil Tracking Using Bright and Dark Pupil Effect
UIST '23 Adjunct: Adjunct Proceedings of the 36th Annual ACM Symposium on User Interface Software and TechnologyReal-time high-speed gaze estimation can enable next-generation gaze-based interaction. The event camera, which captures intensity variations at high frequency, has been employed to this end. However, pupil tracking based only on events is difficult ...
Comments