ABSTRACT
People naturally understand and use proxemic relationships (e.g., their distance and orientation towards others) in everyday situations. However, only few ubiquitous computing (ubicomp) systems interpret such proxemic relationships to mediate interaction (proxemic interaction). A technical problem is that developers find it challenging and tedious to access proxemic information from sensors. Our Proximity Toolkit solves this problem. It simplifies the exploration of interaction techniques by supplying fine-grained proxemic information between people, portable devices, large interactive surfaces, and other non-digital objects in a room-sized environment. The toolkit offers three key features. 1) It facilitates rapid prototyping of proxemic-aware systems by supplying developers with the orientation, distance, motion, identity, and location information between entities. 2) It includes various tools, such as a visual monitoring tool, that allows developers to visually observe, record and explore proxemic relationships in 3D space. (3) Its flexible architecture separates sensing hardware from the proxemic data model derived from these sensors, which means that a variety of sensing technologies can be substituted or combined to derive proxemic information. We illustrate the versatility of the toolkit with proxemic-aware systems built by students.
Supplemental Material
- Ballagas, R., Ringel, M., Stone, M., and Borchers, J. iStuff: a physical user interface toolkit for ubiquitous computing environments. Proc. of CHI'03, ACM (2003). Google ScholarDigital Library
- Ballendat, T., Marquardt, N., and Greenberg, S. Proxemic Interaction: Designing for a Proximity and Orientation-Aware Environment. Proc. of ITS'10, ACM (2010). Google ScholarDigital Library
- Boyle, M. and Greenberg, S. Rapidly prototyping multimedia groupware. Proc. of DMS, Knowl. Sys. Institute, (2005).Google Scholar
- Dey, A.K., et al. A conceptual framework and a toolkit for supporting the rapid prototyping of context-aware applications. Hum.-Comp. Int. 16, 2, L. Erlbaum (2001), 97--166. Google ScholarDigital Library
- Diaz-Marino, R. and Greenberg, S. The proximity toolkit and ViconFace: the video. Ext. Abst. CHI '10, ACM (2010). Google ScholarDigital Library
- Feiner, S., et al. A touring machine: Prototyping 3D mobile augmented reality systems for exploring the urban environment. Personal Technologies 1, 4 (1997), 208--217.Google ScholarCross Ref
- Gamma, E., et al. Design Patterns: Elements of Reusable Object-Oriented Software. Addison-Wesley, 1994. Google ScholarDigital Library
- Greenberg, S. and Fitchett, C. Phidgets: Easy Development of Physical Interfaces Through Physical Widgets. Proc. of UIST'01, ACM (2001), 209--218. Google ScholarDigital Library
- Greenberg, S., Marquardt, N., et al. Proxemic interactions: the new ubicomp? interactions 18, ACM (2011), 42--50. Google ScholarDigital Library
- GroupLab. Proximity Toolkit website, http://grouplab.cpsc.ucalgary.ca/proximitytoolkit, Retrieved July 5, 2011.Google Scholar
- Hall, E.T. The Hidden Dimension. Doubleday, N.Y, 1966.Google Scholar
- Hartmann, B., et al. Reflective physical prototyping through integrated design, test, and analysis. Proc. UIST, ACM (2006). Google ScholarDigital Library
- Hightower, J., et al. The location stack: A layered model for location in ubiquitous computing. Proc. of WMCSA'02, (2002). Google ScholarDigital Library
- Ishii, H. and Ullmer, B. Tangible Bits: Towards Seamless Interfaces Between People, Bits and Atoms. Proc. of CHI'97, ACM (1997), 234--241. Google ScholarDigital Library
- Ju, W., et al. Range: exploring implicit interaction through electronic whiteboard design. Proc. of CSCW'08, ACM (2008). Google ScholarDigital Library
- Klemmer, S.R., et al. Papier-Mache: Toolkit Support for Tangible Input. Proc. of CHI'04, ACM (2004), 399--406. Google ScholarDigital Library
- Kortuem, G., et al. Sensing and visualizing spatial relations of mobile devices. Proc. of UIST'05, ACM (2005), 93--102. Google ScholarDigital Library
- Krumm, J. and Hinckley, K. The NearMe wireless proximity server. Lecture notes in computer science, (2004), 283--300.Google Scholar
- Li, Y., et al. Topiary: a tool for prototyping location-enhanced applications. Proc. of UIST '04, ACM (2004). Google ScholarDigital Library
- MacIntyre, B., et al. DART: a toolkit for rapid design exploration of augmented reality experiences. Proc. of UIST'04, ACM (2004). Google ScholarDigital Library
- Marquardt, N. and Greenberg, S. Distributed Physical Interfaces with Shared Phidgets. Proc. of TEI'07, ACM (2007). Google ScholarDigital Library
- Matthews, T., et al. A toolkit for managing user attention in peripheral displays. Proc. of UIST '04, ACM (2004). Google ScholarDigital Library
- Myers, B.A., et al. Past, Present, and Future of User Interface Software Tools. TOCHI 7, 1, ACM (2000), 3--28. Google ScholarDigital Library
- PrimeSense. OpenNI SDK, http://www.openni.org, Accessed July 5, 2011.Google Scholar
- Reitmayr, G. et al. OpenTracker: A flexible software design for three-dimensional interaction. Virt. Reality 9, (2005). Google ScholarDigital Library
- Sandor, C. and Klinker, G. A rapid prototyping software infrastructure for user interfaces in ubiquitous augmented reality. Pers. and Ubiq. Comp. 9, (2005). Google ScholarDigital Library
- Schwarz, J., et al. A framework for robust and flexible handling of inputs with uncertainty. Proc of UIST, ACM (2010). Google ScholarDigital Library
- Snibbe, S.S. et al. Social immersive media: pursuing best practices for multi-user interactive camera/projector exhibits. Proc. of CHI '09, ACM (2009), 1447--1456. Google ScholarDigital Library
- Streitz, N., et al. Ambient displays and mobile devices for the creation of social architectural spaces. In Public and Situated Displays. Kluwer, 2003, 387--410.Google Scholar
- Vicon Motion Systems. Nexus software, http://www.vicon.com/products/nexus.html, Retrieved July 5, 2011.Google Scholar
- Vogel, D. et al. Interactive public ambient displays: transitioning from implicit to explicit, public to personal, interaction with multiple users. Proc. of UIST'04, ACM (2004). Google ScholarDigital Library
- Weiser, M. The Computer for the 21st Century. Scientific American 265, (1991), 94.Google ScholarDigital Library
- Zhao, T., Aggarwal, M., Kumar, R., and Sawhney, H. Real-Time Wide Area Multi-Camera Stereo Tracking. Proc. of CVPR'05, IEEE (2005), 976--983. Google ScholarDigital Library
Index Terms
- The proximity toolkit: prototyping proxemic interactions in ubiquitous computing ecologies
Recommendations
Proxemic interaction: designing for a proximity and orientation-aware environment
ITS '10: ACM International Conference on Interactive Tabletops and SurfacesIn the everyday world, much of what we do is dictated by how we interpret spatial relationships, or proxemics. What is surprising is how little proxemics are used to mediate people's interactions with surrounding digital devices. We imagine proxemic ...
Proxemic interactions in ubiquitous computing ecologies
CHI EA '11: CHI '11 Extended Abstracts on Human Factors in Computing SystemsAn important challenge in ubiquitous computing (ubicomp) is to create techniques that allow people to seamlessly and naturally connect to and interact with the increasing number of digital devices. I propose to leverage the knowledge of people's and ...
Proxemic interactions with and around digital surfaces
ITS '13: Proceedings of the 2013 ACM international conference on Interactive tabletops and surfacesThis tutorial introduces strategies how the knowledge of people's and devices' proxemic relationships can be applied to interaction design. The goal is to inform the design of future proxemic-aware devices that -- similar to people's natural ...
Comments