Jens Emil Grønbæk
Mille Skovhus Knudsen
Jo Vermeulen
ABSTRACT
Cross-device interactions enable ad hoc sharing of content and control in co-located collaboration. Cross-device research often draws from proxemics theory for designing interactions based on detection of spatial relations such as distance and orientation between people and devices. However, detection of human-human or human-device proximity also constrains flexibility in co-located social interaction. We suggest a proxemics-based approach to designing flexible cross-device interactions. From observations in a field study, we articulate how co-located sharing practices are shaped by the interplay between everyday mobile devices and the physical environment. Based on these insights, we present three cross-device prototypes as proofs-of-concept, demonstrating three design sensitivities for considering proxemics beyond proximity; incorporating features in the environment, enabling flexibility in interpersonal distance and orientation, and providing multiple alternative action possibilities. Drawing from characteristics of our prototypes, we discuss concrete proposals for designing cross-device interactions to enable flexible social interaction.
Supplemental Material
- 2016. AirDrop. (24 9 2016). Retrieved from https://support.apple.com/en-us/HT203106.Google Scholar
- 2016. Android Beam. (24 9 2016). Retrieved from https://developer.android.com/training/beam-files/index.html.Google Scholar
- 2017. Chirp.io -- Send data with sound. (1 9 2017). Retrieved from http://chirp.io/.Google Scholar
- 2018. Vuforia Developer Portal. (16 8 2018). Retrieved from https://developer.vuforia.com/.Google Scholar
- Rafael Ballagas, Michael Rohs, Jennifer G Sheridan, and Jan Borchers. 2004. Byod: Bring your own device. In Proceedings of the Workshop on Ubiquitous Display Environments, Ubicomp, Vol. 2004.Google Scholar
- Till Ballendat, Nicolai Marquardt, and Saul Greenberg. 2010. Proxemic Interaction: Designing for a Proximity and Orientation-Aware Environment. In ACM International Conference on Interactive Tabletops and Surfaces (ITS '10). Association for Computing Machinery, New York, NY, USA, 121--130. DOI: http://dx.doi.org/10.1145/1936652.1936676Google ScholarDigital Library
- Anne Louise Bang and Mette Agger Eriksen. 2014. Experiments all the way in programmatic design research. Artifact: Journal of Design Practice 3, 2 (2014), 4--1.Google Scholar
- Jakob Bardram, Jonathan Bunde-Pedersen, Afsaneh Doryab, and Steffen Sørensen. 2009. CLINICAL SURFACES - Activity-Based Computing for Distributed Multi-Display Environments in Hospitals, Vol. 5727. 704--717. DOI: http://dx.doi.org/10.1007/978--3--642-03658--3_76Google ScholarCross Ref
- Jacob Biehl, William Baker, Brian P. Bailey, Desney S. Tan, Kori M. Inkpen, and Mary Czerwinski. 2008. IMPROMPTU: A new interaction framework for supporting collaboration in multiple display environments and its field evaluation for co-located software development. Conference on Human Factors in Computing Systems - Proceedings (01 2008), 939--948. DOI: http://dx.doi.org/10.1145/1357054.1357200Google ScholarDigital Library
- Thomas Binder and Johan Redström. 2006. Exemplary design research. (2006).Google Scholar
- Sebastian Boring, Manuela Altendorfer, Gregor Broll, Otmar Hilliges, and Andreas Butz. 2007. Shoot & Copy: Phonecam-based Information Transfer from Public Displays Onto Mobile Phones. In Proceedings of the 4th International Conference on Mobile Technology, Applications, and Systems and the 1st International Symposium on Computer Human Interaction in Mobile Technology (Mobility '07). ACM, NY, NY, USA, 24--31. DOI: http://dx.doi.org/10.1145/1378063.1378068Google ScholarDigital Library
- Sebastian Boring, Dominikus Baur, Andreas Butz, Sean Gustafson, and Patrick Baudisch. 2010. Touch Projector: Mobile Interaction through Video. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'10). Association for Computing Machinery, New York, NY, USA, 2287--2296. DOI: http://dx.doi.org/10.1145/1753326.1753671Google ScholarDigital Library
- Andrew Bragdon, Rob DeLine, Ken Hinckley, and Meredith Ringel Morris. 2011. Code Space: Touch + Air Gesture Hybrid Interactions for Supporting Developer Meetings. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS '11). Association for Computing Machinery, New York, NY, USA, 212--221. DOI: http://dx.doi.org/10.1145/2076354.2076393Google ScholarDigital Library
- Eva Brandt and Thomas Binder. 2007. Experimental design research: genealogy, intervention, argument. International Association of Societies of Design Research, Hong Kong (2007).Google Scholar
- Frederik Brudy, Christian Holz, Roman Rädle, Chi-Jui Wu, Steven Houben, Clemens Nylandsted Klokmose, and Nicolai Marquardt. 2019. Cross-Device Taxonomy: Survey, Opportunities and Challenges of Interactions Spanning Across Multiple Devices. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). ACM, NY, NY, USA, Article 562, 28 pages. DOI: http://dx.doi.org/10.1145/3290605.3300792Google ScholarDigital Library
- W. Buxton. 2006. Space-function integration and ubiquitous media. Towards and Interactive and Integrative Design Process. Linz, Austria: DOM Publications (2006), 248--271.Google Scholar
- Debaleena Chattopadhyay, Kenton O'Hara, Sean Rintel, and Roman Rädle. 2016. Office Social: Presentation Interactivity for Nearby Devices. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI'16). Association for Computing Machinery, New York, NY, USA, 2487--2491. DOI: http://dx.doi.org/10.1145/2858036.2858337Google ScholarDigital Library
- Debaleena Chattopadhyay, Francesca Salvadori, Kenton O'Hara, and Sean Rintel. 2017. Beyond Presentation: Shared Slideware Control as a Resource for Collocated Collaboration. Human--Computer Interaction (2017), 1--44.Google Scholar
- Giuseppe Desolda, Carmelo Ardito, Hans-Christian Jetter, and Rosa Lanzilotti. 2019. Exploring spatially-aware cross-device interaction techniques for mobile collaborative sensemaking. International Journal of Human-Computer Studies 122 (2019), 1--20.Google ScholarCross Ref
- Paul Dourish. 2004. Where the action is: the foundations of embodied interaction. MIT press.Google Scholar
- Maiken Hillerup Fogtmann, Peter Gall Krogh, and Thomas Markussen. 2011. Spatial sharing: Designing computational artifacts as architecture. In Proceedings of the International Conference on Designing Pleasurable Products and Interfaces. 1--9.Google Scholar
- Mayank Goel, Brendan Lee, Md. Tanvir Islam Aumi, Shwetak Patel, Gaetano Borriello, Stacie Hibino, and Bo Begole. 2014. SurfaceLink: Using Inertial and Acoustic Sensing to Enable Multi-Device Interaction on a Surface. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). Association for Computing Machinery, New York, NY, USA, 1387--1396. DOI: http://dx.doi.org/10.1145/2556288.2557120Google ScholarDigital Library
- Saul Greenberg. 2001. Context as a Dynamic Construct. Hum.-Comput. Interact. 16, 2 (Dec. 2001), 257--268. DOI: http://dx.doi.org/10.1207/S15327051HCI16234_09Google ScholarDigital Library
- Saul Greenberg, Nicolai Marquardt, Till Ballendat, Rob Diaz-Marino, and Miaosen Wang. 2011. Proxemic Interactions: The New Ubicomp? Interactions 18, 1 (Jan. 2011), 42--50. DOI: http://dx.doi.org/10.1145/1897239.1897250Google ScholarDigital Library
- Jens Emil Grønbæk, Henrik Korsgaard, Marianne Graves Petersen, Morten Henriksen Birk, and Peter Gall Krogh. 2017. Proxemic Transitions: Designing Shape-Changing Furniture for Informal Meetings. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). Association for Computing Machinery, New York, NY, USA, 7029--7041. DOI: http://dx.doi.org/10.1145/3025453.3025487Google ScholarDigital Library
- Jens Emil Grønbæk, Christine Linding, Anders Kromann, Thomas Fly Hylddal Jensen, and Marianne Graves Petersen. 2019. Proxemics Play: Exploring the Interplay between Mobile Devices and Interiors. In Companion Publication of the 2019 on Designing Interactive Systems Conference 2019 Companion (DIS '19 Companion). Association for Computing Machinery, New York, NY, USA, 177--181. DOI: http://dx.doi.org/10.1145/3301019.3323886Google ScholarDigital Library
- Jens Emil Grønbæk and Kenton O'Hara. 2016. Built-In Device Orientation Sensors for Ad-Hoc Pairing and Spatial Awareness. In Cross-Surface'16 workshop.Google Scholar
- Edward T. Hall. 1966. The Hidden Dimension.Google Scholar
- Eva Hornecker. 2005. A design theme for tangible interaction: embodied facilitation. In ECSCW 2005.Google ScholarDigital Library
- Steven Houben, Nicolai Marquardt, Jo Vermeulen, Clemens Klokmose, Johannes Schöning, Harald Reiterer, and Christian Holz. 2017. Opportunities and Challenges for Cross-Device Interactions in the Wild. Interactions 24, 5 (Aug. 2017), 58--63. DOI: http://dx.doi.org/10.1145/3121348Google ScholarDigital Library
- Hans-Christian Jetter, Harald Reiterer, and Florian Geyer. 2014. Blended Interaction: Understanding Natural Human-Computer Interaction in Post-WIMP Interactive Spaces. Personal Ubiquitous Comput. 18, 5 (June 2014), 1139--1158. DOI: http://dx.doi.org/10.1007/s00779-013-0725--4Google ScholarDigital Library
- Haojian Jin, Christian Holz, and Kasper Hornbundefinedk. 2015. Tracko: Ad-Hoc Mobile 3D Tracking Using Bluetooth Low Energy and Inaudible Signals for Cross-Device Interaction. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology (UIST '15). Association for Computing Machinery, New York, NY, USA, 147--156. DOI: http://dx.doi.org/10.1145/2807442.2807475Google ScholarDigital Library
- Tero Jokela, Ming Ki Chong, Andrés Lucero, and Hans Gellersen. 2015. Connecting Devices for Collaborative Interactions. Interactions 22, 4 (June 2015), 39--43. DOI: http://dx.doi.org/10.1145/2776887Google ScholarDigital Library
- Mandy Korzetz, Romina Kühn, Peter Heisig, and Thomas Schlegel. 2016. Natural Collocated Interactions for Merging Results with Mobile Devices. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (MobileHCI '16). ACM, NY, NY, USA, 746--752. DOI: http://dx.doi.org/10.1145/2957265.2961839Google ScholarDigital Library
- Peter Gall Krogh, Marianne Graves Petersen, Kenton O'Hara, and Jens Emil Grønbæk. 2017. Sensitizing Concepts for Socio-Spatial Literacy in HCI. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). Association for Computing Machinery, New York, NY, USA, 6449--6460. DOI: http://dx.doi.org/10.1145/3025453.3025756Google ScholarDigital Library
- Bryan Lawson. 2007. Language of space. Routledge.Google Scholar
- Paul Luff and Christian Heath. 1998. Mobility in Collaboration. In Proceedings of the 1998 ACM Conference on Computer Supported Cooperative Work (CSCW '98). Association for Computing Machinery, New York, NY, USA, 305--314. DOI: http://dx.doi.org/10.1145/289444.289505Google ScholarDigital Library
- Kent Lyons, Trevor Pering, Barbara Rosario, Shivani Sud, and Roy Want. 2009. Multi-display composition: Supporting display sharing for collocated mobile devices. In IFIP Conference on Human-Computer Interaction. Springer, 758--771.Google ScholarDigital Library
- Nicolai Marquardt, Robert Diaz-Marino, Sebastian Boring, and Saul Greenberg. 2011. The Proximity Toolkit: Prototyping Proxemic Interactions in Ubiquitous Computing Ecologies. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (UIST '11). Association for Computing Machinery, New York, NY, USA, 315--326. DOI: http://dx.doi.org/10.1145/2047196.2047238Google ScholarDigital Library
- Nicolai Marquardt and Saul Greenberg. 2015. Proxemic interactions: From theory to practice. Synthesis Lectures on Human-Centered Informatics 8, 1 (2015), 1--199.Google ScholarCross Ref
- Nicolai Marquardt, Ken Hinckley, and Saul Greenberg. 2012. Cross-Device Interaction via Micro-Mobility and f-Formations. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (UIST '12). Association for Computing Machinery, New York, NY, USA, 13--22. DOI: http://dx.doi.org/10.1145/2380116.2380121Google ScholarDigital Library
- Rene Mayrhofer and Hans Gellersen. 2007. Shake well before use: Authentication based on accelerometer data. In International Conference on Pervasive Computing. Springer, 144--161.Google ScholarCross Ref
- Helena M. Mentis, Kenton O'Hara, Abigail Sellen, and Rikin Trivedi. 2012. Interaction Proxemics and Image Use in Neurosurgery. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). Association for Computing Machinery, New York, NY, USA, 927--936. DOI: http://dx.doi.org/10.1145/2207676.2208536Google ScholarDigital Library
- Kenton O'Hara, Richard Harper, Helena Mentis, Abigail Sellen, and Alex Taylor. 2013. On the Naturalness of Touchless: Putting the "Interaction" Back into NUI. ACM Trans. Comput.-Hum. Interact. 20, 1, Article Article 5 (April 2013), 25 pages. DOI: http://dx.doi.org/10.1145/2442106.2442111Google ScholarDigital Library
- Kenton O'Hara and Tim Kindberg. 2007. Understanding user engagement with barcoded signs in the 'Coast' location-based experience. Journal of location based services 1, 4 (2007), 256--273.Google ScholarCross Ref
- Kenton O'Hara, Jesper Kjeldskov, and Jeni Paay. 2011. Blended Interaction Spaces for Distributed Team Collaboration. ACM Trans. Comput.-Hum. Interact. 18, 1, Article Article 3 (May 2011), 28 pages. DOI: http://dx.doi.org/10.1145/1959022.1959025Google ScholarDigital Library
- Antti Oulasvirta and Kasper Hornbæk. 2016. HCI Research As Problem-Solving. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, NY, NY, USA, 4956--4967. DOI: http://dx.doi.org/10.1145/2858036.2858283Google ScholarDigital Library
- Trevor Pering, Kent Lyons, Roy Want, Mary Murphy-Hoye, Mark Baloga, Paul Noll, Joe Branc, and Nicolas De Benoist. 2010. What do you bring to the table?: investigations of a collaborative workspace. 183--192. DOI: http://dx.doi.org/10.1145/1864349.1864389Google ScholarDigital Library
- Mark J Perry and Kenton O'Hara. 2003. Display-Based Activity in the Workplace. In INTERACT.Google Scholar
- Salil Pradhan. 2000. Semantic Location. Personal Ubiquitous Comput. 4, 4 (Jan. 2000), 213--216. DOI: http://dx.doi.org/10.1007/s007790070005Google ScholarDigital Library
- Roman Rädle, Hans-Christian Jetter, Jonathan Fischer, Inti Gabriel, Clemens N. Klokmose, Harald Reiterer, and Christian Holz. 2018. PolarTrack: Optical Outside-In Device Tracking That Exploits Display Polarization. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). Association for Computing Machinery, New York, NY, USA, Article Paper 497, 9 pages. DOI: http://dx.doi.org/10.1145/3173574.3174071Google ScholarDigital Library
- Roman Rädle, Hans-Christian Jetter, Nicolai Marquardt, Harald Reiterer, and Yvonne Rogers. 2014. HuddleLamp: Spatially-Aware Mobile Displays for Ad-Hoc Around-the-Table Collaboration. In Proceedings of the Ninth ACM International Conference on Interactive Tabletops and Surfaces (ITS '14). Association for Computing Machinery, New York, NY, USA, 45--54. DOI: http://dx.doi.org/10.1145/2669485.2669500Google ScholarDigital Library
- Stuart Reeves, Steve Benford, Claire O'Malley, and Mike Fraser. 2005. Designing the Spectator Experience. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '05). Association for Computing Machinery, New York, NY, USA, 741--750. DOI: http://dx.doi.org/10.1145/1054972.1055074Google ScholarDigital Library
- Yvonne Rogers. 2006. Moving on from Weiser's vision of calm computing: Engaging ubicomp experiences. In International conference on Ubiquitous computing. Springer, 404--421.Google ScholarDigital Library
- Maurício Sousa, Daniel Mendes, Rafael Kuffner Dos Anjos, Daniel Medeiros, Alfredo Ferreira, Alberto Raposo, João Madeiras Pereira, and Joaquim Jorge. 2017. Creepy Tracker Toolkit for Context-Aware Interfaces. In Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces (ISS '17). Association for Computing Machinery, New York, NY, USA, 191--200. DOI: http://dx.doi.org/10.1145/3132272.3134113Google ScholarDigital Library
- Alexandros Stylianidis, Jo Vermeulen, Steven Houben, Lindsay MacDonald, and Russell Beale. 2017. SenseBelt: A Belt-Worn Sensor to Support Cross-Device Interaction. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '17). Association for Computing Machinery, New York, NY, USA, 2123--2131. DOI: http://dx.doi.org/10.1145/3027063.3053135Google ScholarDigital Library
- Josephine Raun Thomsen, Peter Gall Krogh, Jacob Albundefinedk Schnedler, and Hanne Linnet. 2018. Interactive Interior and Proxemics Thresholds: Empowering Participants in Sensitive Conversations. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). Association for Computing Machinery, New York, NY, USA, Article Paper 68, 12 pages. DOI: http://dx.doi.org/10.1145/3173574.3173642Google ScholarDigital Library
- Roy Want. 2004. Enabling ubiquitous sensing with RFID. Computer 37, 4 (2004), 84--86.Google ScholarDigital Library
- Andrew D. Wilson and Hrvoje Benko. 2010. Combining Multiple Depth Cameras and Projectors for Interactions on, above and between Surfaces. In Proceedings of the 23nd Annual ACM Symposium on User Interface Software and Technology (UIST '10). Association for Computing Machinery, New York, NY, USA, 273--282. DOI: http://dx.doi.org/10.1145/1866029.1866073Google ScholarDigital Library
- Chi-Jui Wu, Steven Houben, and Nicolai Marquardt. 2017. EagleSense: Tracking People and Devices in Interactive Spaces Using Real-Time Top-View Depth-Sensing. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). Association for Computing Machinery, New York, NY, USA, 3929--3942. DOI: http://dx.doi.org/10.1145/3025453.3025562Google ScholarDigital Library
- John Zimmerman, Erik Stolterman, and Jodi Forlizzi. 2010. An Analysis and Critique of Research Through Design: Towards a Formalization of a Research Approach. In Proceedings of the 8th ACM Conference on Designing Interactive Systems (DIS '10). ACM, NY, NY, USA, 310--319. DOI: http://dx.doi.org/10.1145/1858171.1858228Google ScholarDigital Library
Index Terms
- Proxemics Beyond Proximity: Designing for Flexible Social Interaction Through Cross-Device Interaction
Recommendations
A study on touch & hover based interaction for zooming
CHI EA '12: CHI '12 Extended Abstracts on Human Factors in Computing SystemsProximity is a useful medium for interaction with high interactive digital contents. It can be used in different contexts such as for navigation through depth in 3D space in zoomable interfaces. In this paper, we propose hover-based zoom interaction as ...
Designing for Interaction Proxemics: Configurations and Transitions
CHI EA '18: Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing SystemsDesign of interactive technology provides opportunities as well as constraints in how a group of users can organize in a shared space. The core argument of interaction proxemics is to consider this in designing for collaboration. In my thesis, I focus ...
Hover Cursor: Improving Touchscreen Acquisition Of Small Targets With Hover-enabled Pre-selection
CHI EA '15: Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing SystemsEven with highly-sensitive touchscreens and emphasis on "designing for touch", small target selection remains difficult. Good touch performance cannot solve the "fat-finger" problem, which results from occlusion and the size disparity between fingers ...
Comments