A.S.M. Mahfujur Rahman
Abdulmotaleb El Saddik
ABSTRACT
The goal of this work is to create a simple and intuitive interaction scheme for the in-car multimedia devices. In fact, we propose a hand gestures control that aims to minimize the users distraction while driving. We devise a set of gesture vocabulary for a the multimedia device interaction. Users hand gestures are recognized by capturing the motion-path while they draw different symbols in the air. In order to capture the motion-path, we use Microsoft Kinect camera's 3D body tracking capability. As the camera tracks user's hands, it produces a sequence of motion-points of the body joints, which are then analyzed syntactically to recognize the intended hand gestures. The recognized gesture is further used to interact with the in-car multimedia devices for accessing various entertainment services. Browsing media playlists, changing the track of the audio player, and playing/pausing the media are few examples for which we have integrated the gesture-based interaction. The interaction scheme devoid of any graphical user interface, rather incorporates haptic and audio modality to provide selection feedbacks to the user. Our experiment shows that the proposed gesture recognition technique is robust and its simplified interaction scheme in the automobile environment is interesting and appealing to the people.
- Akyol, S., Ulrich, C., Klaus, B., Wolfgang, H. T.: Gesture control for use in automobiles. In: In IAPR MVA Workshop, pp. 349--352 (2000).Google Scholar
- Beirness, D.: Distracted driving: The role of survey research. In: International Conference on Distracted Driving (2005).Google Scholar
- Damiani, S., Deregibus, E., Andreone, L.: Driver-vehicle interfaces and interaction: where are they going? European Transport Research Review 1, 87--96 (2009).Google ScholarCross Ref
- Fischer, P., Nurnberger, A.: mycomand automotive user interface: Personalized interaction with multimedia content based on fuzzy preference modeling. In: User Modeling, pp. 315--326 (2010). Google ScholarDigital Library
- Doring, T., Kern, D., Marshall, P., Pfeiffer, M., Schoning, J., Gruhn, V., Schmidt, A.: Gestural interaction on the steering wheel: reducing the visual demand. In: Proceedings of the 2011 annual conference on Human factors in computing systems, CHI '11, pp. 483--492. ACM, New York, NY, USA (2011). Google ScholarDigital Library
- Duchaineau, M.: Roaming terrain: Real-time optimally adapting meshes. In: Proc. of the Conference on Visualization '97, pp. 81--88 (1997). Google ScholarDigital Library
- Ecker, R., Broy, V., Hertzschuch, K., Butz, A.: Visual cues supporting direct touch gesture interaction with in-vehicle information systems. In: Proceedings of the 2nd International Conference on Automotive User Interfaces and Interactive Vehicular Applications, AutomotiveUI '10, pp. 80--87. ACM, New York, NY, USA (2010). Google ScholarDigital Library
- Dingus, T. A., Klauser, S. G., Neale, V. L., Petersen, A., Lee, S. E., Sudweeks, J., Perez, M. A., Hawkey, J., Ramsey, D., Gupta, S., Bucher, C., Daersaph, Z. R., Jermeland, J., Knipling, R. R.: 100-car naturalistic driving study - phase ii - results of the 100-car field experiment. report no. dot hs810593. Tech. rep., Virginia Tech. Transportation Institute (2006).Google Scholar
- Hua, Z., Ng, W. L.: Speech recognition interface design for in-vehicle system. In: Proceedings of the 2nd International Conference on Automotive User Interfaces and Interactive Vehicular Applications, AutomotiveUI '10, pp. 29--33. ACM, New York, NY, USA (2010). Google ScholarDigital Library
- Kang, S. H., Lee, S. H.: User interface device for controlling car multimedia system (2011).Google Scholar
- Likert, R.: A technique for the measurement of attitudes. Archives of Psychology 140, 1--55 (1932).Google Scholar
- Lin, Q., Zhao, Z., Xu, D., Wang, R.: Design and Implementation of an OpenGL Based 3D First Person Shooting Game, chap. Transactions on Edutainment, pp. 50--61. Lecture Notes in Computer Science. Springer Berlin / Heidelberg (2001). Google ScholarDigital Library
- Rahman, A. S. M. M., Hossain, M. A., Parra, J., El Saddik, A.: Motion-path based gesture interaction with smart home services. In: ACM International Conference on Multimedia, HCM track short paper. Beijing, China (2009). Google ScholarDigital Library
- Rahman, A. S. M. M., Hossain, S. A., El Saddik, A.: Bridging the gap between virtual and real world by bringing an interpersonal haptic communication system in second life. In: IEEE International Symposium on Multimedia (ISM2010). Taiwan (2010). Google ScholarDigital Library
- LWJGL, T. L. J. G. L.: Url: www. http://lwjgl.org/. Tech. rep., Last accessed June 11, 2011.Google Scholar
- Ryu, J., Chun, J., Park, G., Choi, S., Han, S.: Vibrotactile feedback for information delivery in the vehicle. Haptics, IEEE Transactions on \textbf3(2), 138--149 (2010). Google ScholarDigital Library
- Sandnes, F., Huang, Y.P., Huang, Y.M.: Near eyes-free chauffeur computer interaction with chording and visual text mnemonics. Journal of Universal Computer Science 16(10), 1311--1326 (2010).Google Scholar
- Singh, S., Singh, S., Kour, M., Manhas, S.: Article:voice recognition in automobiles. International Journal of Computer Applications 6(6), 7--11 (2010). Published By Foundation of Computer Science.Google ScholarCross Ref
- Srovnal, V., Machacek, Z., Hercik, R., Slaby, R., Srovnal, V.: Intelligent car control and recognition embedded system. In: IMCSIT, pp. 831--836 (2010).Google ScholarCross Ref
- Stutts, J. C.: How risky is distracted driving. In: International Conference on Distracted Driving (2005).Google Scholar
- Yang, C., Yoon, J., Beh, J., Ko, H.: Modeling for gesture set design toward realizing effective human-vehicle interface. In: R. Lee (ed.) Computers, Networks, Systems, and Industrial Engineering 2011, Studies in Computational Intelligence, vol. 365, pp. 171--180. Springer Berlin / Heidelberg (2011).Google Scholar
- Zobl, M., Geiger, M., Bengler, K., Lang, M.: A usability study on hand gesture controlled operation of in-car devices. In: Human-Computer Interaction.Google Scholar
- Zobl, M., Geiger, M., Schuller, B., Lang, M., Rigoll, G.: A real-time system for hand gesture controlled operation of in-car devices. In: Multimedia and Expo, 2003. ICME '03. Proceedings. 2003 International Conference on, vol. 3, pp. III-541--4 vol. 3 (2003). 10.1109/ICME.2003.1221368. Google ScholarDigital Library
- Zobl, M., Nieschulz, R., Geiger, M., Lang, M. K., Rigoll, G.: Gesture components for natural interaction with in-car devices. In: Gesture Workshop, pp. 448--459 (2003).Google Scholar
Index Terms
- Motion-path based in car gesture control of the multimedia devices
Recommendations
Hands-free gesture control with a capacitive textile neckband
ISWC '14: Proceedings of the 2014 ACM International Symposium on Wearable ComputersWe present a novel sensing modality for hands-free gesture controlled user interfaces, based on active capacitive sensing. Four capacitive electrodes are integrated into a textile neckband, allowing continuous unobtrusive head movement monitoring. We ...
Fluid gesture interaction design: Applications of continuous recognition for the design of modern gestural interfaces
This article presents Gesture Interaction DEsigner (GIDE), an innovative application for gesture recognition. Instead of recognizing gestures only after they have been entirely completed, as happens in classic gesture recognition systems, GIDE exploits ...
Contents-aware gesture interaction using wearable motion sensor
ISWC '14 Adjunct: Proceedings of the 2014 ACM International Symposium on Wearable Computers: Adjunct ProgramGesture interaction has become a major role as intuitive control of remote devices. Motion-based hand gesture recognition using a wearable motion sensor equipped on the wrist-band helps decreasing recognition errors compared with that of video-based ...
Comments