Shinjae Kang
ABSTRACT
A smart car can be defined in various dimensions. In this paper, we consider a gaze-based driver query processing system where the vehicle recognizes where the driver is looking at when she asks about roadside landmarks. By linking the tracked gaze of the driver with annotated maps and geo-location information, the system can let the vehicle provide immediate answers to the driver. We discuss the design and implementation of the system, along with the test results during real driving.
- C. Amon and F. Fuhrmann. 2014. Evaluation of the Spatial Resolution Accuracy of the Face Tracking System for Kinect for Windows V1 and V2. In Proceedings of the 6th Congress of Alps-Adria Acoustics Association.Google Scholar
- T. Bär, J. F. Reuter, M. Yguel, and J. M. Zöllner. 2012. Driver Head Pose and Gaze Estimation based on Multi-Template ICP 3D Point Cloud Alignment. In Proceedings of the IEEE Conference on Intelligent Transportation Systems (ITSC).Google Scholar
- L. Fletcher and A. Zelinsky. 2009. Driver Inattention Detection based on Eye Gaze-Road Event Correlation. Int. J. Rob. Res. 28, 6 (June 2009), 774--801. Google ScholarDigital Library
- K. Fujimura, L. Xu, C. Tran, R. Bhandari, and V. Ng-Thow-Hing. 2013. Driver queries using wheel-constrained finger pointing and 3-D head-up display visual feedback. In Proceedings of the 5th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI'13). Google ScholarDigital Library
- D. Kern, A. Mahr, S. Castronovo, A. Schmidt, and C. Müller. 2010. Making use of drivers' glances onto the screen for explicit gaze-based interaction. In Proceedings of the 2nd International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI'10). Google ScholarDigital Library
- MSDN Library. Face Tracking. Retrieved April 10, 2015 from https://msdn.microsoft.com/en-s/library/jj130970.aspx.Google Scholar
- Microsoft. Speech API (SAPI) 5.4. Available at https://msdn.microsoft.com/en-us/library/ee125663(v=vs.85).aspx.Google Scholar
- T. Misu, A. Raux, I. Lane, J. Devassy, and R. Gupta. 2013. Situated Multi-modal Dialog System in Vehicles. In Proceedings of the 6th Workshop on Eye Gaze in Intelligent Human Machine Interaction (GazeIn). Google ScholarDigital Library
- J. Oh and N. Kwak. 2012. Recognition of a Driver's Gaze for Vehicle Headlamp Control. IEEE Transactions on Vehicular Technology 61, 5 (June 2012), 2008--2017.Google Scholar
- T. Poitschke, F. Laquai, S. Stamboliev, and G. Rigoll. 2011. Gaze-based interaction on multiple displays in an automotive environment. In Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics (SMC).Google Scholar
- S. Rümelin, C. Marouane, and A. Butz. 2013. Free-hand pointing for identification and interaction with distant objects. In Proceedings of the 5th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI'13). Google ScholarDigital Library
- D. L. Strayer, J. Turrill, J. R. Coleman, E. V. Ortiz, and J. M. Cooper. 2014. Measuring Cognitive Distraction in the Automobile II: Assessing In-Vehicle Voice-Based Interactive Technologies. AAA Foundation for Traffic Safety report.Google Scholar
- A. Tawari, A. Mogelmose, S. Martin, T. B. Møeslund, and M. M. Trivedi. 2014. Attention Estimation By Simultaneous Analysis of Viewer and View. In Proceedings of the IEEE Conference on Intelligent Transportation Systems (ITSC).Google Scholar
Index Terms
- Do you see what I see: towards a gaze-based surroundings query processing system
Recommendations
Four Eyes See More Than Two: Shared Gaze in the Car
Human-Computer Interaction – INTERACT 2015AbstractPurposeful collaboration of driver and front-seat passenger can help in demanding driving situations and therefore increase safety. The characteristics of the car, as a context, limit the collaboration possibilities of the driver and front-seat ...
Mining consumer complaints to identify unsuccessful interactions with advanced driver assistance systems
AutomotiveUI '19: Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications: Adjunct ProceedingsAdvanced driver assistance systems, which warn drivers of danger of an impending collision or temporarily control the vehicle's speed and/or direction under limited circumstances to assist the driver, have the potential to prevent large numbers of motor ...
An auditory display that assist commercial drivers in lane changing situations
AM '13: Proceedings of the 8th Audio Mostly ConferenceThis paper presents a simulator study that evaluates four auditory displays to assist commercial drivers in lane changing situations. More specifically, the displays warned the drivers about vehicles in the adjacent lane. Three displays utilized ...
Comments