skip to main content
research-article

Light on horizontal interactive surfaces: Input space for tabletop computing

Published:01 January 2014Publication History
Skip Abstract Section

Abstract

In the last 25 years we have witnessed the rise and growth of interactive tabletop research, both in academic and in industrial settings. The rising demand for the digital support of human activities motivated the need to bring computational power to table surfaces. In this article, we review the state of the art of tabletop computing, highlighting core aspects that frame the input space of interactive tabletops: (a) developments in hardware technologies that have caused the proliferation of interactive horizontal surfaces and (b) issues related to new classes of interaction modalities (multitouch, tangible, and touchless). A classification is presented that aims to give a detailed view of the current development of this research area and define opportunities and challenges for novel touch- and gesture-based interactions between the human and the surrounding computational environment.

References

  1. J. Alexander, R. Brotman, D. Holman, A. Younkin, R. Vertegaal, J. Kildal, A. Lucero, and S. Subramanian. 2013. Organic experiences: (Re-)shaping interactions with deformable displays. In Extended Abstracts on Human Factors in Computing Systems (CHI EA’13). 3171--3174. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. M. Annett, T. Grossman, D. Wigdor, and G. Fitzmaurice. 2011. Medusa: A proximity-aware multi-touch tabletop. In Proceedings of the ACM Symposium on User Interface Software and Technology (UIST’11). 337--346. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. R. Balakrishnan and K. Hinckley. 1999. The role of kinesthetic reference frames in two-handed input performance. In Proceeding of the ACM Symposium on User Interface Software and Technology (UIST’99). 171--178. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. R. Balakrishnan, G. Fitzmaurice, G. Kurtenbach, and W. Buxton. 1999. Digital tape drawing. In Proceedings of the ACM Symposium on User Interface Software and Technology (UIST’99). 161--169. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. R. Ballagas, J. Borchers, M. Rohs, and J. G. Sheridan. 2006. The smart phone: A ubiquitous input device. IEEE Pervasive Computing 5, 1, 70--77. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. A. Banerjee, J. Burstyn, A. Girouard, and R. Vertegaal. 2012. MultiPoint: Comparing laser and manual pointing as remote input in large display interactions. International Journal of Human-Computer Studies 70, 10, 690--702. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. T. Baudel and M. Beaudouin-Lafon. 1993. Charade: Remote control of objects using free-hand gestures. Communications of the ACM 36, 7, 28--35. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. P. Baudisch and G. Chu. 2009. Back-of-device interaction allows creating very small touch devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’09). 1923--1932. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. L. Baxter. 1997. Capacitive Sensors Design and Applications. IEEE Press.Google ScholarGoogle Scholar
  10. M. Beaudouin-Lafon. 2000. Instrumental interaction: An interaction model for designing post-WIMP user interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’00). 446--453. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. H. Benko. 2009. Beyond flat surface computing: Challenges of depth-aware and curved interfaces. In Proceedings of the ACM International Conference on Multimedia (Multimedia’09). 935--944. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. H. Benko, M. R. Morris, A. J. Brush, and A. Wilson. 2009. Insights on Interactive Tabletops: A Survey of Researchers and Developers. Technical Report.Google ScholarGoogle Scholar
  13. R. Bencina, M. Kaltenbrunner, and S. Jorda. 2005. Improved topological fiducial tracking in the reacTIVision system. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition—Workshops (CVPR Workshops’05). 99--106. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. G. Bieber, E. Abd Al Rahman, and B. Urban. 2007. Screen coverage: A pen-interaction problem for PDA's and touch screen computers. In Proceedings of the Conference on Wireless and Mobile Communications (ICWMC’07). 87--92. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. E. A. Bier, M. C. Stone, K. Pier, W. Buxton, and T. D. Derose. 1993. Toolglass and magic lenses: The see-through interface. In Proceedings of the Conference on Computer Graphics and Interactive Techniques (SIGGRAPH’93). 73--80. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. M. Blackshaw, A. Devincenzi, D. Lakatos, D. Leithinger, and H. Ishii. 2011. Recompose: Direct and gestural interaction with an actuated surface. In Extended Abstracts on Human Factors in Computing Systems (CHI EA’11). 1237--1242. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. A. Bolt. 1980. Put-that-there: Voice and gesture at the graphics interface. In Proceedings of Conference on Computer Graphics and Interactive Techniques (SIGGRAPH’80). 262--270. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. B. Buxton. 2008. Surface and tangible computing, and the “small” matter of people and design. Digest of Technical Papers of IEEE International Solid-State Circuits Conference (ISSCC’08). 24--29.Google ScholarGoogle ScholarCross RefCross Ref
  19. B. Buxton. 2009. Multi-Touch Systems That I Have Known and Loved. Retrieved January 24, 2013 from http://www.billbuxton.com/multitouchOverview.html.Google ScholarGoogle Scholar
  20. W. Buxton and B. Myers. 1986. A study in two-handed input. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’86). 321--326. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. V. Bus. 1945. As we may think. The Atlantic Monthly 176, 1, 101--108.Google ScholarGoogle Scholar
  22. E. Costanza and J. A. Robinson. 2003. A region adjacency tree approach to the detection and design of fiducials. In Proceedings of Vision, Video and Graphics (VVG’03). 63--70.Google ScholarGoogle Scholar
  23. T. Coughlan, T. D. Collins, A. Adams, Y. Rogers, P. A. Haya, and E. Martin. 2012. The conceptual framing, design and evaluation of device ecologies for collaborative activities. International Journal of Human-Computer Studies 70, 10, 765--779. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. L. D. Cutler, B. Fröhlich, and P. Hanrahan. 1997. Two-handed direct manipulation on the responsive workbench. In Proceedings of the Symposium on Interactive 3D Graphics (I3D’97). 107--114. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. P. Dietz and D. Leigh. 2001. DiamondTouch: A multi-user touch technology. In Proceedings of the ACM Symposium on User interface software and technology (UIST’01). 219--226. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. J. Edelmann, P. Mock, A. Schilling, P. Gerjets, P. Rosenstiel, and W. Straßer. 2012. Towards the keyboard of oz: Learning individual soft-keyboard models from raw optical sensor data. In Proceedings of the International Conference on Interactive Tabletops and Surfaces (ITS’12), 163--172. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. A. Esenther, C. Forlines, K. Ryall, and S. Shipman. 2002. DiamondTouch SDK: Support for Multi-User, Multi-Touch Applications. Technical Report, MERL TR2002-48, Mitsubishi Electric Research Laboratory.Google ScholarGoogle Scholar
  28. A. Esenther and K. Ryall. 2006. Fluid DTMouse: Better mouse support for touch-based interactions. In Proceedings of the Working Conference on Advanced Visual Interfaces (AVI’06). 112--115. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. L. Findlater and J. Wobbrock. 2012. Personalized input: Improving ten-finger touchscreen typing through automatic adaptation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’12). 815--824. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. K. P. Fishkin. 2004. A taxonomy for and analysis of tangible interfaces. Personal and Ubiquitous Computing 8, 5, 347--358. Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. G. W. Fitzmaurice and W. Buxton. 1997. An empirical evaluation of graspable user interfaces: Towards specialized, space multiplexed input. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’97). 43--50. Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. G. W. Fitzmaurice, H. Ishii, and W. A. S. Buxton. 1995. Bricks: Laying the foundations for graspable user interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’95). 442--449. Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. C. Forlines, D. Wigdor, C. Shen, and R. Balakrishnan. 2007. Direct-touch vs. mouse input for tabletop displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’07). 647--656. Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. D. Freeman, H. Benko, M. R. Morris, and D. Wigdor. 2009. ShadowGuides: Visualizations for in-situ learning of multi-touch and whole-hand gestures. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS’09). 165--172. Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. C. Goldberg and C. Richardson. 1993. Touch-typing with a stylus. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’93). 80--87. Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. T. Grossman and D. Wigdor. 2007. Going deeper: A taxonomy of 3D on the tabletop. In Proceeding of IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP’07). 137--144.Google ScholarGoogle Scholar
  37. V. Ha, K. M. Inkpen, R. L. Mandryk, and T. Whalen. 2006. Direct intentions: The effects of input devices on collaboration around a tabletop display. In Proceedings of the IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP’06). 8--15. Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. J. Y. Han. 2005. Low-cost multi-touch sensing through frustrated total internal reflection. In Proceedings of the ACM Symposium on User Interface Software and Technology (UIST’05). 115--118. Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. J. Hardy. 2012. Experiences: A year in the life of an interactive desk. In Proceedings of the Designing Interactive Systems Conference (DIS’12). 679--688. Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. R. Hardy and E. Rukzio. 2008. Touch & interact: Touch-based interaction of mobile phones with displays. In Proceedings of the International Conference on Human Computer Interaction with Mobile Devices and Services (MobileHCI’08). 245--254. Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. O. Hilliges, S. Izadi, A. D. Wilson, S. Hodges, A. Garcia-Mendoza, and A. Butz. 2009. Interactions in the air: Adding further depth to interactive tabletops. In Proceedings of the ACM Symposium on User Interface Software and Technology (UIST’09). 139--148. Google ScholarGoogle ScholarDigital LibraryDigital Library
  42. K. Hinckley, R. Pausch, J. C. Goble, and N. F. Kassell. 1994. Passive real-world interface props for neurosurgical visualization. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’94). 452--458. Google ScholarGoogle ScholarDigital LibraryDigital Library
  43. K. Hinckley, K. Yatani, M. Pahud, N. Coddington, J. Rodenhouse, A. Wilson, H. Benko, and B. Buxton. 2010. Pen + touch = new tools. In Proceedings of the ACM Symposium on User Interface Software and Technology (UIST’10). 27--36. Google ScholarGoogle ScholarDigital LibraryDigital Library
  44. K. Hinckley and D. Wigdor. 2012. Input technologies and techniques. Human-Computer Interaction Handbook: Fundamentals, Evolving Technologies, and Emerging Applications (3rd ed.). CRC Press. Google ScholarGoogle ScholarDigital LibraryDigital Library
  45. U. Hinrichs, M. Hancock, C. Collins, and S. Carpendale. 2007. Examination of text-entry methods for tabletop displays. In Proceedings of the IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP’07). 105--112.Google ScholarGoogle Scholar
  46. S. Hodges, S. Izadi, A. Butler, A. Rrustemi, and B. Buxton. 2007. ThinSight: Versatile multi-touch sensing for thin form-factor displays. In Proceedings of the ACM Symposium on User Interface Software and Technology (UIST’07). 259--268. Google ScholarGoogle ScholarDigital LibraryDigital Library
  47. R. Hofer, D. Naeff, and A. Kunz. 2009. FLATIR: FTIR multi-touch detection on a discrete distributed sensor array. In Proceedings of the International Conference on Tangible and Embedded Interaction (TEI’09). 317--322. Google ScholarGoogle ScholarDigital LibraryDigital Library
  48. D. Holman and R. Vertegaal. 2008. Organic user interfaces: Designing computers in any way, shape, or form. Communications of the ACM 51, 6, 48--55. Google ScholarGoogle ScholarDigital LibraryDigital Library
  49. C. Holz and P. Baudisch. 2010. The generalized perceived input point model and how to double touch accuracy by extracting fingerprints. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’10). 581--590. Google ScholarGoogle ScholarDigital LibraryDigital Library
  50. E. Hornecker and J. Buur. 2006. Getting a grip on tangible interaction: A framework on physical space and social interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’06). 437--446. Google ScholarGoogle ScholarDigital LibraryDigital Library
  51. E. L. Hutchins, J. D. Hollan, and D. A. Norman. 1985. Direct manipulation interfaces. Human-Computer Interact. 1, 4, 311--338. Google ScholarGoogle ScholarDigital LibraryDigital Library
  52. T. Isenberg and M. Hancock. 2012. Gestures vs. postures: ‘Gestural’ touch interaction in 3D environments. In Proceedings of the CHI Workshop on the 3rd Dimension of CHI: Touching and Designing 3D User Interfaces (3DCHI’12). 53--61.Google ScholarGoogle Scholar
  53. H. Ishii and M. Kobayashi. 1992. Clearboard: A seamless medium for shared drawing and conversation with eye contact. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’97). 525--532. Google ScholarGoogle ScholarDigital LibraryDigital Library
  54. H. Ishii and B. Ullmer. 1997. Tangible bits. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’97). 234--241. Google ScholarGoogle ScholarDigital LibraryDigital Library
  55. S. Izadi, S. Hodges, S. Taylor, D. Rosenfeld, N. Villar, A. Butler, and J. Westhues. 2008. Going beyond the display: A surface technology with an electronically switchable diffuser. In Proceedings of the 21st Annual ACM Symposium on User Interface Software and Technology (UIST’08). 269--278. Google ScholarGoogle ScholarDigital LibraryDigital Library
  56. R. J. Jacob, J. J. Leggett, B. A. Myers, and R. Pausch. 1993. Interaction styles and input/output devices. Behaviour & Information Technology 12, 2, 69--79.Google ScholarGoogle ScholarCross RefCross Ref
  57. S. Jordá, G. Geiger, M. Alonso, and M. Kaltenbrunner. 2007. The reacTable: Exploring the synergy between live music performance and tabletop tangible interfaces. In Proceedings of the International Conference on Tangible and Embedded Interaction (TEI’07). 139--146. Google ScholarGoogle ScholarDigital LibraryDigital Library
  58. M. Kaltenbrunner, T. Bovermann, R. Bencina, and E. Costanza. 2005. Tuio: A protocol for table-top tangible user interfaces. In Proceedings of the International Workshop on Gesture in Human-Computer Interaction and Simulation.Google ScholarGoogle Scholar
  59. M. Kaltenbrunner and R. Bencina. 2007. reacTIVision: A computer--vision framework for table--based tangible interaction. In Proceedings of the 1st International Conference on Tangible and Embedded Interaction (TEI’07). 69--74. Google ScholarGoogle ScholarDigital LibraryDigital Library
  60. J. F. Kelley. 1983. An empirical methodology for writing user-friendly natural language computer applications. In Proceedings of the SIGCHI conference on Human factors in computing systems (CHI’83). 193--196. Google ScholarGoogle ScholarDigital LibraryDigital Library
  61. K. Kin, M. Agrawala, and T. Derose. 2009. Determining the benefits of direct-touch, bimanual, and multifinger input on a multitouch workstation. In Proceedings of Graphics Interface (GI’09). 119--124. Google ScholarGoogle ScholarDigital LibraryDigital Library
  62. S. R. Klemmer, M. W. Newman, R. Farrell, M. Bilezikjian, and J. A. Landay. 2001. The designers’ outpost: A tangible interface for collaborative web site. In Proceedings of the ACM Symposium on User Interface Software and Technology (UIST’01). 1--10. Google ScholarGoogle ScholarDigital LibraryDigital Library
  63. C. Kray, D. Nesbitt, J. Dawson, and M. Rohs. 2010. User-defined gestures for connecting mobile phones, public displays, and tabletops. In Proceedings of the International Conference on Human Computer Interaction with Mobile Devices and Services (MobileHCI’10). 239--248. Google ScholarGoogle ScholarDigital LibraryDigital Library
  64. P. O. Kristensson, J. Clawson, M. Dunlop, P. Isokoski, B. Roark, K. Vertanen, A. Waller, and J. Wobbrock. 2012. Designing and evaluating text entry methods. In Extended Abstracts on Human Factors in Computing Systems (CHI EA’12). 2747--2750. Google ScholarGoogle ScholarDigital LibraryDigital Library
  65. M. Krueger, T. Gionfriddo, and K. Hinrichsen. 1985. VIDEOPLACE—an artificial reality. In Proceedings of the SIGCHI Conference on Human factors in Computing Systems (CHI’85). 35--40 Google ScholarGoogle ScholarDigital LibraryDigital Library
  66. M. Krueger. 1991. Artificial Reality II. Addison-Wesley.Google ScholarGoogle Scholar
  67. W. Kruger, C.-A. Bohn, B. Frohlich, H. Schuth, W. Strauss, and G. Wesche. 1995. The responsive workbench: A virtual work environment. IEEE Computer 28, 7, 42--48. Google ScholarGoogle ScholarDigital LibraryDigital Library
  68. A. Kunz and M. Fjeld. 2010. From table--system to tabletop: Integrating technology into interactive surfaces. Tabletops - Horizontal Interactive Displays, Human-Computer Interaction Series, 51--69.Google ScholarGoogle Scholar
  69. G. Kurtenbach, G. Fitzmaurice, T. Baudel, and B. Buxton. 1997. The design of a GUI paradigm based on tablets, two-hands, and transparency. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’97). 35--42. Google ScholarGoogle ScholarDigital LibraryDigital Library
  70. C. Latulipe, C. S. Kaplan, and C. L. Clarke. 2005. Bimanual and unimanual image alignment: An evaluation of mouse-based techniques. In Proceedings of the ACM Symposium on User Interface Software and Technology (UIST’05). 123--131. Google ScholarGoogle ScholarDigital LibraryDigital Library
  71. J. Lee and H. Ishii. 2010. Beyond: Collapsible tools and gestures for computational design. In Extended Abstracts on Human Factors in Computing Systems (CHI EA’10). 3931--3936. Google ScholarGoogle ScholarDigital LibraryDigital Library
  72. D. Leithinger and H. Ishii. 2010. Relief: A scalable actuated shape display. In Proceedings of the International Conference on Tangible, Embedded, and Embodied Interaction (TEI’10). 221--222. Google ScholarGoogle ScholarDigital LibraryDigital Library
  73. J. Luk, J. Pasquero, S. Little, K. Maclean, V. Levesque, and V. Hayward. 2006. A role for haptics in mobile interaction: initial design using a handheld tactile display prototype. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’06). 171--180. Google ScholarGoogle ScholarDigital LibraryDigital Library
  74. K. Lyons, T. Starner, D. Plaisted, J. Fusia, A. Lyons, A. Drew, and E. W. Looney. 2004. Twiddler typing: One-handed chording text entry for mobile phones. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’04). 671--678. Google ScholarGoogle ScholarDigital LibraryDigital Library
  75. I. S. Mackenzie and S. X. Zhang. 1997. The immediate usability of graffiti. In Proceedings of the Conference on Graphics Interface (GI’97). 129--137. Google ScholarGoogle ScholarDigital LibraryDigital Library
  76. I. S. Mackenzie, S. X. Zhang, and R. W. Soukoreff. 1999. Text entry using soft keyboards. Behaviour and Information Technology 18, 4, 235--244.Google ScholarGoogle ScholarCross RefCross Ref
  77. K. Maclean and M. Enriquez. 2003. Perceptual design of haptic icons. In Proceedings of Eurohaptics 2003. 351--363.Google ScholarGoogle Scholar
  78. S. Malik and J. Laszlo. 2004. Visual touchpad: A two-handed gestural input device. In Proceedings of the International Conference on Multimodal Interfaces (ICMI’04). 289--296. Google ScholarGoogle ScholarDigital LibraryDigital Library
  79. N. Marquardt, R. Diaz-Marino, S. Boring, and S. Greenberg. 2011a. The proximity toolkit: Prototyping proxemic interactions in ubiquitous computing ecologies. In Proceedings of the ACM Symposium on User Interface Software and Technology (UIST’11). 315--326. Google ScholarGoogle ScholarDigital LibraryDigital Library
  80. N. Marquardt, J. Kiemer, D. Ledo, S. Boring, and S. Greenberg. 2011b. Designing user-, hand-, and handpart-aware tabletop interactions with the TouchID toolkit. In Proceedings of the International Conference on Interactive Tabletops and Surfaces (ITS’11). 21--30. Google ScholarGoogle ScholarDigital LibraryDigital Library
  81. P. Marshall. 2007. Do tangible interfaces enhance learning? In Proceedings of the International Conference on Tangible and Embedded Interaction (TEI’07). 15--17. Google ScholarGoogle ScholarDigital LibraryDigital Library
  82. P. Marshall, R. Fleck, A. Harris, J. Rick, E. Hornecker, Y. Rogers, N. Yuill, et al. 2009. Fighting for control: Children's embodied interactions when using physical and digital representations. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’09). 2149--2158. Google ScholarGoogle ScholarDigital LibraryDigital Library
  83. N. Matsushita and J. Rekimoto. 1997. HoloWall: Designing a finger, hand, body, and object sensitive wall. In Proceedings of the Symposium on User Interface Software and Technology (UIST’97). 209--210. Google ScholarGoogle ScholarDigital LibraryDigital Library
  84. A. Mazalek. 2005. Media Tables: An Extensible Method for Developing Multi-user Media Interaction Platforms for Shared Spaces. PhD dissertation, Massachusetts Institute of Technology (MIT). Google ScholarGoogle ScholarDigital LibraryDigital Library
  85. A. Mazalek, M. Reynolds, and G. Davenport. 2006. TViews: An extensible architecture for multiuser digital media tables. IEEE Computer Graphics and Applications 26, 5, 47--55. Google ScholarGoogle ScholarDigital LibraryDigital Library
  86. Microsoft Corp. 2007. Surface. Retrieved January 23, 2013 from http://www.microsoft.com/surface/en/us/default.aspx.Google ScholarGoogle Scholar
  87. J. Moeller and A. Kerne. 2010. Scanning FTIR: Unobtrusive optoelectronic multi-touch sensing through waveguide transmissivity imaging. In Proceedings of the International Conference on Tangible, Embedded, and Embodied Interaction (TEI’10). 73--76. Google ScholarGoogle ScholarDigital LibraryDigital Library
  88. J. Moeller, A. Kerne, and S. Damaraju. 2011. ZeroTouch: A zero-thickness optical multi-touch force field. In Extended Abstracts on Human Factors in Computing Systems (CHI EA’11). 1165--1170. Google ScholarGoogle ScholarDigital LibraryDigital Library
  89. J. Moeller and A. Kerne. 2012. ZeroTouch: An optical multi-touch and free-air interaction architecture. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’12). 2165--2174. Google ScholarGoogle ScholarDigital LibraryDigital Library
  90. M. R. Morris, A. J. B. Brush, and B. R. Meyers. 2008. A field study of knowledge workers’ use of interactive horizontal displays. In Proceedings of the IEEE International Workshop on Horizontal Interactive Human Computer Systems (TABLETOP’08). 105--112.Google ScholarGoogle Scholar
  91. M. R. Morris, A. Huang, A. Paepcke, and T. Winograd. 2006. Cooperative gestures: Multi-user gestural interactions for co-located groupware. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’06). 1201--1210. Google ScholarGoogle ScholarDigital LibraryDigital Library
  92. T. Moscovich and J. F. Hughes. 2006. Multi-finger cursor techniques. In Proceedings of Graphics Interface (GI’06). 1--7. Google ScholarGoogle ScholarDigital LibraryDigital Library
  93. N. Motamedi. 2008. HD touch: Multi-touch and object sensing on a high definition LCD TV. In Extended Abstracts on Human Factors in Computing Systems (CHI EA’08). 3069--3074. Google ScholarGoogle ScholarDigital LibraryDigital Library
  94. C. Müller-Tomfelde, A. Wessels, and C. Schremmer. 2008. Tilted tabletops: In between horizontal and vertical workspaces. In Proceedings of the IEEE International Workshop on Horizontal Interactive Human Computer Systems (TABLETOP’08). 49--56.Google ScholarGoogle Scholar
  95. C. Müller-Tomfelde and M. Fjeld. 2010. Introduction: A short history of tabletop research, technologies, and products. In Tabletops - Horizontal Interactive Displays, Human-Computer Interaction Series. 1--24.Google ScholarGoogle Scholar
  96. C. Müller-Tomfelde and M. Fjeld. 2012. Tabletops: Interactive horizontal displays for ubiquitous computing. IEEE Computer 45, 2, 78--81. Google ScholarGoogle ScholarDigital LibraryDigital Library
  97. D. Norman and J. Nielsen. 2010. Gestural interfaces: A step backward in usability. ACM Interactions 17, 5, 46--49. Google ScholarGoogle ScholarDigital LibraryDigital Library
  98. Nui Group Authors. 2009. Multi-touch Technologies. Community Book. Retrieved from http://nuicode.com/projects/wiki-book/files.Google ScholarGoogle Scholar
  99. K. O’Hara, R. Harper, H. Mentis, A. Sellen, and A. Taylor. 2012. On the naturalness of touchless interaction. ACM Transactions on Computer Human Interaction, Special Issue on Embodied interaction. Google ScholarGoogle ScholarDigital LibraryDigital Library
  100. D. R. Olsen and S. T. Nielsen. 2001. Laser pointer interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’01). 17--22. Google ScholarGoogle ScholarDigital LibraryDigital Library
  101. R. J. Orr and G. D. Abowd. 2000. The smart floor: A mechanism for natural user identification and tracking. In Extended Abstracts on Human Factors in Computing Systems (CHI EA’00). 275--276. Google ScholarGoogle ScholarDigital LibraryDigital Library
  102. J. Paradiso, C. Abler, K. Hsiao, and M. Reynolds. 1997. The magic carpet: Physical sensing for immersive environments. In Extended Abstracts on Human Factors in Computing Systems (CHI EA’97). 277--278. Google ScholarGoogle ScholarDigital LibraryDigital Library
  103. J. Patten, H. Ishii, J. Hines, and G. Pangaro. 2001. SenseTable: A wireless object tracking platform for tangible user interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’01). 253--260. Google ScholarGoogle ScholarDigital LibraryDigital Library
  104. E. W. Pedersen and K. Hornbæk. 2011. Tangible bots: Interaction with active tangibles in tabletop interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’11). 2975--2984. Google ScholarGoogle ScholarDigital LibraryDigital Library
  105. K. Perlin. 1998. Quikwriting: Continuous stylus-based text entry. In Proceedings of the Annual ACM Symposium on User Interface Software and Technology (UIST’98). 215--216. Google ScholarGoogle ScholarDigital LibraryDigital Library
  106. M. G. Petersen, P. G. Krogh, M. Ludvigsen, and A. Lykke-Olesen. 2005. Floor interaction HCI reaching new ground. In Extended Abstracts on Human Factors in Computing Systems (CHI EA’05). 1717--1720. Google ScholarGoogle ScholarDigital LibraryDigital Library
  107. M. G. Petersen and K. Grønbæk. 2004. Interactive spaces: Towards collaborative structuring and ubiquitous presentation in domestic environments. In Proceedings of OZCHI 2004.Google ScholarGoogle Scholar
  108. T. Poston and L. Serra. 1996. Dextrous virtual work. Communications of the ACM 39, 5, 37--45. Google ScholarGoogle ScholarDigital LibraryDigital Library
  109. R. L. Potter, L. J. Weldon, and B. Shneiderman. 1988. Improving the accuracy of touch screens: An experimental evaluation of three strategies. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’88). 27--32. Google ScholarGoogle ScholarDigital LibraryDigital Library
  110. E. Rabin and A. M. Gordon. 2004. Tactile feedback contributes to consistency of finger movements during typing. Experimental Brain Research 155, 3, 362--369.Google ScholarGoogle ScholarCross RefCross Ref
  111. M. Rauterberg, M. Fjeld, H. Krueger, M. Bichsel, U. Leonhardt, and M. Meier. 1998. BUILD-IT: A planning tool for construction and design. In Extended Abstracts on Human factors in Computing Systems (CHI EA’98). 177--178. Google ScholarGoogle ScholarDigital LibraryDigital Library
  112. A. Reetz, C. Gutwin, T. Stach, M. Nacenta, and S. Subramanian. 2006. Superflick: A natural and efficient technique for long-distance object placement on digital tables. In Proceedings of Graphics Interface (GI’06). 7--9. Google ScholarGoogle ScholarDigital LibraryDigital Library
  113. J. Rekimoto and N. Matsushita. 1997. Perceptual surfaces: Towards a human and object sensitive interactive display. In Proceedings of the Workshop on Perceptual User Interfaces (PUI’97). 30--32.Google ScholarGoogle Scholar
  114. J. Rekimoto and M. Saitoh. 1999. Augmented surfaces: A spatially continuous work space for hybrid computing environments. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’99). 378--385. Google ScholarGoogle ScholarDigital LibraryDigital Library
  115. M. Ringel, K. Ryall, C. Shen, C. Forlines, and F. Vernier. 2004. Release, relocate, reorient, resize. In Extended Abstracts on Human Factors in Computing Systems (CHI EA’04). 1441--1444. Google ScholarGoogle ScholarDigital LibraryDigital Library
  116. Y. Rogers and S. Lindley. 2004. Collaborating around vertical and horizontal large interactive displays: Which way is best? Interacting with Computers 16, 6, 1133--1152.Google ScholarGoogle Scholar
  117. K. Ryall, C. Forlines, C. Shen, and M. R. Morris. 2004. Exploring the effects of group size and table size on interactions with tabletop shared-display groupware. In Proceedings of the Conference on Computer Supported Cooperative Work (CSCW’04). 284--293. Google ScholarGoogle ScholarDigital LibraryDigital Library
  118. J. Ruiz, Y. Li, and E. Lank. 2011. User-defined motion gestures for mobile interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’11). 197--206. Google ScholarGoogle ScholarDigital LibraryDigital Library
  119. S. D. Scott, K. D. Grant, and R. L. Mandryk. 2003. System guidelines for co-located collaborative work on a tabletop display. In Proceedings of the European Conference on Computer-Supported Cooperative Work (ECSCW’03). 159--178. Google ScholarGoogle ScholarDigital LibraryDigital Library
  120. O. Shaer and E. Hornecker. 2010. Tangible user interfaces: past, present, and future directions. Foundations and Trends in Human-Computer Interaction 3, 1--2, 1--137. Google ScholarGoogle ScholarDigital LibraryDigital Library
  121. C. Shen, K. M. Everitt, and K. Ryall. 2003. UbiTable: Impromptu face-to-face collaboration on horizontal interactive surfaces. In Proceedings of the International Conference on Ubiquitous Computing (UbiComp’03). 281--288.Google ScholarGoogle Scholar
  122. C. Shen, K. Ryall, C. Forlines, A. Esenther, F. Vernier, K. Everitt, M. Wu, et al. 2006. Informing the design of direct-touch tabletops. IEEE Computer Graphics and Applications 26, 5, 36--46. Google ScholarGoogle ScholarDigital LibraryDigital Library
  123. B. Shneiderman. 1982. The future of interactive systems and the emergence of direct manipulation. Behaviour & Information Technology 1, 3, 237--256.Google ScholarGoogle ScholarCross RefCross Ref
  124. M. Silfverberg, I. S. Mackenzie, and P. Korhonen. 2000. Predicting text entry speed on mobile phones. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’00). 9--16. Google ScholarGoogle ScholarDigital LibraryDigital Library
  125. I. E. Sutherland. 1964. Sketch pad a man-machine graphical communication system. In Proceedings of the SHARE Design Automation Workshop (DAC’64). 6329--6346. Google ScholarGoogle ScholarDigital LibraryDigital Library
  126. J. Schöning, P. Brandl, F. Daiber, F. Echtler, O. Hilliges, J. Hook, M. Löchtefeld, N. Motamedi, L. Muller, P. Olivier, T. Roth, and U. Von Zadow. 2008. Multi-Touch Surfaces: A Technical Guide. Technical Report TUM-I0833, Technical University of Munich.Google ScholarGoogle Scholar
  127. J. Steimle and S. Olberding. 2012. When mobile phones expand into handheld tabletops. In Extended Abstracts on Human Factors in Computing Systems (CHI EA’12). 271--280. Google ScholarGoogle ScholarDigital LibraryDigital Library
  128. A. Tang, M. Pahud, K. Inkpen, H. Benko, J. C. Tang, and B. Buxton. 2010. Three's company: Understanding communication channels in three-way distributed collaboration. In Proceedings of ACM Conference on Computer Supported Cooperative Work (CSCW’10). 271--280. Google ScholarGoogle ScholarDigital LibraryDigital Library
  129. L. Terrenghi, D. Kirk, A. Sellen, and S. Izadi. 2007. Affordances for manipulation of physical versus digital media on interactive surfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’07). 1157--1166. Google ScholarGoogle ScholarDigital LibraryDigital Library
  130. P. Tuddenham, D. Kirk, and S. Izadi. 2010. Graspables revisited. In Proceedings of the SICHI Conference on Human Factors in Computing Ssystems (CHI’10). 2223--2232. Google ScholarGoogle ScholarDigital LibraryDigital Library
  131. B. Ullmer and H. Ishii. 1997. The metaDESK. In Proceedings of the ACM Symposium on User Interface Software and Technology (UIST’97). 223--232. Google ScholarGoogle ScholarDigital LibraryDigital Library
  132. B. Ullmer and H. Ishii. 2000. Emerging frameworks for tangible user interfaces. IBM Systems Journal 39, 3.4, 915--931. Google ScholarGoogle ScholarDigital LibraryDigital Library
  133. J. Underkoffler and H. Ishii. 1999. Urp: A luminous-tangible workbench for urban planning and design. In Proceedings of the SICHI Conference on Human Factors in Computing Systems (CHI’99). 386--393. Google ScholarGoogle ScholarDigital LibraryDigital Library
  134. A. Van Dam. 1997. Post-WIMP user interfaces. Communications of the ACM 40, 2, 63--67. Google ScholarGoogle ScholarDigital LibraryDigital Library
  135. F. Vernier, N. Lesh, and C. Shen. 2002. Visualization techniques for circular tabletop interfaces. In Proceedings of the Working Conference on Advanced Visual Interfaces (AVI’02). 257--265. Google ScholarGoogle ScholarDigital LibraryDigital Library
  136. N. Villar, S. Izadi, D. Rosenfeld, H. Benko, J. Helmes, J. Westhues, S. Hodges, E. Ofek, A. Butler, X. Cao, and B. Chen. 2009. Mouse 2.0: Multi-touch meets the mouse. In Proceedings of the ACM symposium on User Interface Software and Technology (UIST’09). 33--42. Google ScholarGoogle ScholarDigital LibraryDigital Library
  137. M. Weiser. 1991. The computer for the 21st century. Scientific American 94--104.Google ScholarGoogle Scholar
  138. M. Weiss, J. Wagner, Y. Jansen, R. Jennings, R. Khoshabeh, J. D. Hollan, and J. Borchers. 2009. SLAP widgets: Bridging the gap between virtual and physical controls on tabletops. In Proceedings of the SIGCHI Conference on Human factors in computing systems (CHI’09). 481--490. Google ScholarGoogle ScholarDigital LibraryDigital Library
  139. P. Wellner. 1991. The DigitalDesk calculator. In Proceedings of the ACM Symposium on User Interface Software and Technology (UIST’91). 27--33. Google ScholarGoogle ScholarDigital LibraryDigital Library
  140. P. Wellner. 1993. Interacting with paper on the DigitalDesk. Communications of the ACM 36, 7, 87--96. Google ScholarGoogle ScholarDigital LibraryDigital Library
  141. W. Westerman, J. G. Elias, and A. Hedge. 2001. Multi-touch: A new tactile 2-d gesture interface for human-computer interaction. In Proceedings of Human Factors and Ergonomics Society Annual Meeting. 45, 632--636.Google ScholarGoogle ScholarCross RefCross Ref
  142. D. Wigdor, G. Perm, K. Ryall, A. Esenther, and C. Shen. 2007. Living with a tabletop: Analysis and observations of long term office use of a multi-touch table. In Proceedings of the IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP’07). 60--67.Google ScholarGoogle Scholar
  143. D. Wigdor, H. Jiang, C. Forlines, M. Borkin, and C. Shen. 2009. WeSpace: The design development and deployment of a walk-up and share multi-surface visual collaboration system. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’09). 1237--1246. Google ScholarGoogle ScholarDigital LibraryDigital Library
  144. D. Wigdor and D. Wixon. 2011. Brave NUI World: Designing Natural User Interfaces for Touch and Gesture (1st ed.). Morgan Kaufmann. Google ScholarGoogle ScholarDigital LibraryDigital Library
  145. A. D. Wilson. 2004. TouchLight: An imaging touch screen and display for gesture-based interaction. In Proceedings of the International Conference on Multimodal Interfaces (ICMI’04). 69--76. Google ScholarGoogle ScholarDigital LibraryDigital Library
  146. A. D. Wilson and H. Benko. 2010. Combining multiple depth cameras and projectors for interactions on, above and between surfaces. In Proceedings of the Symposium on User Interface Software and Technology (UIST’10). 273--282. Google ScholarGoogle ScholarDigital LibraryDigital Library
  147. A. D. Wilson, S. Izadi, O. Hilliges, A. Garcia-Mendoza, and D. Kirk. 2008. Bringing physics to the surface. In Proceedings of the ACM Symposium on User Interface Software and Technology (UIST’08). 67--76. Google ScholarGoogle ScholarDigital LibraryDigital Library
  148. J. O. Wobbrock, M. R. Morris, and A. D. Wilson. 2009. User-defined gestures for surface computing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’09). 1083--1092. Google ScholarGoogle ScholarDigital LibraryDigital Library
  149. M. Wu and R. Balakrishnan. 2003. Multi-finger and whole hand gestural interaction techniques for multi-user tabletop displays. In Proceedings of the Symposium on User Interface Software and Technology (UIST’03). 193--202. Google ScholarGoogle ScholarDigital LibraryDigital Library
  150. M. Wu, C. Shen, K. Ryall, C. Forlines, and R. Balakrishnan. 2006. Gesture registration, relaxation, and reuse for multi-point direct-touch surfaces. In Proceedings of the IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP’06). 185--192. Google ScholarGoogle ScholarDigital LibraryDigital Library
  151. S. Zhai, P. O. Kristensson, and B. A. Smith. 2005. In search of effective text input interfaces for off the desktop computing. Interacting with Computers 17, 3, 229--250.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Light on horizontal interactive surfaces: Input space for tabletop computing

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in

    Full Access

    • Published in

      cover image ACM Computing Surveys
      ACM Computing Surveys  Volume 46, Issue 3
      January 2014
      507 pages
      ISSN:0360-0300
      EISSN:1557-7341
      DOI:10.1145/2578702
      Issue’s Table of Contents

      Copyright © 2014 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 1 January 2014
      • Accepted: 1 June 2013
      • Revised: 1 February 2013
      • Received: 1 April 2012
      Published in csur Volume 46, Issue 3

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article
      • Research
      • Refereed

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader