Dominik Schmidt
Ming Ki Chong
ABSTRACT
HandsDown is a novel technique for user identification on interactive surfaces. It enables users to access personal data on a shared surface, to associate objects with their identity, and to fluidly customize appearance, content, or functionality of the user interface. To identify, users put down their hand flat on the surface. HandsDown is based on hand contour analysis; neither user instrumentation nor external devices are required for identification. Characteristic features of the hand are initially extracted from images captured by the surface's camera system and then classified using Support Vector Machines (SVM).
We present a proof-of-concept implementation and show results of our evaluation which indicates the technique's robustness for user identification within small groups. Additionally, we introduce a set of interaction techniques to illustrate how HandsDown can improve the user experience, and we discuss the design space of such interactions.
- E. Bier and S. Freeman. MMM: a user interface architecture for shared editors on a single screen. In Proc. UIST '91, pages 79--86, 1991. Google Scholar
Digital Library
- E. A. Bier, M. C. Stone, K. Pier, W. Buxton, and T. D. Derose. Toolglass and magic lenses: The see-through interface. Computer Graphics, 27(Annual Conference Series):73--80, 1993. Google ScholarDigital Library
- G. Boreki and A. Zimmer. Hand geometry: a new approach for feature extraction. In Automatic Identification Advanced Technologies '05. Fourth IEEE Workshop on, pages 149--154, 2005. Google ScholarDigital Library
- C.-C. Chang and C.-J. Lin. LIBSVM: a library for support vector machines, 2001.Google Scholar
- C. T. Dang, M. Straub, and E. André. Hand distinction for multi-touch tabletop interaction. In Proc. ITS '09, pages 101--108, 2009. Google ScholarDigital Library
- P. Dietz and D. Leigh. DiamondTouch: a multi-user touch technology. In Proc. UIST '01, pages 219--226, 2001. Google ScholarDigital Library
- K. C. Dohse, T. Dohse, J. D. Still, and D. J. Parkhurst. Enhancing multi-user interaction with multi-touch tabletop displays using hand tracking. In Proc. ACHI '08, pages 297--302, 2008. Google ScholarDigital Library
- T. Fawcett. ROC graphs: Notes and practical considerations for researchers, 2004.Google Scholar
- Y. Guiard. Asymmetric division of labor in human skilled bimanual action: The kinematic chain as a model. Journal of motor behavior, 19(4):486--517, December 1987.Google Scholar
- A. K. Jain, A. Ross, and S. Pankanti. A prototype hand geometry-based verification system. In Proc. AVBPA '99, pages 166--171, 1999.Google Scholar
- S. Jordà, G. Geiger, M. Alonso, and M. Kaltenbrunner. The reactable: exploring the synergy between live music performance and tabletop tangible interfaces. In Proc. TEI '07, pages 139--146, 2007. Google ScholarDigital Library
- D. Kim, P. Dunphy, P. Briggs, J. Hook, J. Nicholson, J. Nicholson, and P. Olivier. Multi-touch authentication on tabletops. In Proc. CHI '10, pages 1093--1102, 2010. Google ScholarDigital Library
- D. Kirk, A. Sellen, S. Taylor, N. Villar, and S. Izadi. Putting the physical into the digital: issues in designing hybrid interactive surfaces. In Proc. BCS HCI '09, pages 35--44, 2009. Google ScholarDigital Library
- Microsoft Corp. Surface. 06 May 2010. http://www.microsoft.com/surface.Google Scholar
- M. R. Morris, K. Ryall, C. Shen, C. Forlines, and F. Vernier. Beyond "social protocols": Multi-user coordination policies for co-located groupware. In Proc. CSCW '04, pages 262--265, 2004. Google ScholarDigital Library
- B. Myers, H. Stiel, and R. Gargiulo. Collaboration using multiple PDAs connected to a PC. In Proc. CSCW '98, pages 285--294, 1998. Google ScholarDigital Library
- M. Ringel, K. Ryall, C. Shen, C. Forlines, and F. Vernier. Release, relocate, reorient, resize: Fluid techniques for document sharing on multi-user interactive tables. In Proc. CHI '04, pages 1441--1444, 2004. Google ScholarDigital Library
- K. Ryall, A. Esenther, K. Everitt, C. Forlines, M. R. Morris, C. Shen, S. Shipman, and F. Vernier. iDwidgets: parameterizing widgets by user identity. In Proc. INTERACT '05, pages 1124--1128, 2005. Google ScholarDigital Library
- R. Sanchez-Reillo, C. Sanchez-Avila, and A. Gonzalez-Marcos. Biometric identification through hand geometry measurements. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 22(10):1168--1171, 2000. Google ScholarDigital Library
- D. Schmidt. Design and realization of an interactive multi-touch table. Technical report, Lancaster University, 2009.Google Scholar
- D. Schmidt, F. Chehimi, E. Rukzio, and H. Gellersen. PhoneTouch: A technique for direct phone interaction on surfaces. In Proc. UIST, 2010. Google ScholarDigital Library
- D. Schmidt and H. Gellersen. Show your hands: A vision-based approach to user identification for interactive surfaces. Poster ITS, 2009.Google Scholar
- B. Schneier. Inside risks: the uses and abuses of biometrics. Commun. ACM, 42(8):136+, 1999. Google ScholarDigital Library
- J. Schöning, J. Hook, T. Bartindale, D. Schmidt, P. Olivier, F. Echtler, N. Motamedi, and P. Brandl. Building interactive multi-touch surfaces. In C. Müller-Tomfelde, editor, Tabletops - Horizontal Interactive Displays. Springer, 2010.Google ScholarCross Ref
- J. Schöning, M. Rohs, and A. Krüger. Using mobile phones to spontaneously authenticate and interact with multi-touch surfaces. In Proc. PPD '08, 2008.Google Scholar
- S. Scott and S. Carpendale. Guest editors' introduction: Interacting with digital tabletops. Computer Graphics and Applications, IEEE, 26(5):24--27, 2006. Google ScholarDigital Library
- S. D. Scott, S. Carpendale, and K. M. Inkpen. Territoriality in collaborative tabletop workspaces. In Proc. CSCW '04, pages 294--303, 2004. Google ScholarDigital Library
- J. Stewart, B. Bederson, and A. Druin. Single display groupware: a model for co-present collaboration. In Proc. CHI '99, pages 286--293, 1999. Google ScholarDigital Library
- A. D. Wilson and R. Sarin. BlueTable: connecting wireless mobile devices on interactive surfaces using vision-based handshaking. In Proc. GI '07, pages 119--125, 2007. Google ScholarDigital Library
- E. Yörük, E. Konukoglu, B. Sankur, and J. Darbon. Shape-based hand recognition. Image Processing, IEEE Transactions on, 15(7):1803--1815, 2006. Google ScholarDigital Library
- R. L. Zunkel. Hand geometry based verification. In A. K. Jain, R. Bolle, and S. Pankanti, editors, Biometrics, chapter 4, pages 87--101. Springer US, Boston, MA, 2002.Google Scholar
Index Terms
- HandsDown: hand-contour-based user identification for interactive surfaces
Recommendations
Carpus: a non-intrusive user identification technique for interactive surfaces
UIST '12: Proceedings of the 25th annual ACM symposium on User interface software and technologyInteractive surfaces have great potential for co-located collaboration because of their ability to track multiple inputs simultaneously. However, the multi-user experience on these devices could be enriched significantly if touch points could be ...
IdWristbands: IR-based user identification on multi-touch surfaces
ITS '10: ACM International Conference on Interactive Tabletops and SurfacesMulti-touch surfaces are predestined to be used by many users at the same time. However, most systems are not able to distinguish touches of different users. This paper presents ongoing work on using wristbands, equipped with infrared LEDs, to provide ...
IdLenses: dynamic personal areas on shared surfaces
ITS '10: ACM International Conference on Interactive Tabletops and SurfacesIdLenses is a novel interaction concept to realize user-aware interfaces on shared surfaces. Users summon virtual lenses which allow for personalized input and output. The ability to create a lens instantaneously anywhere on the surface, and to move it ...
Comments