Brennan Jones
Kody Dillman
Ehud Sharlin
ABSTRACT
People are increasingly using mobile video to communicate, collaborate, and share experiences while on the go. Yet this presents challenges in adequately sharing camera views with remote users. In this paper, we study the use of semi-autonomous drones for video conferencing, where an outdoor user (using a smartphone) is connected to a desktop user who can explore the environment from the drone's perspective. We describe findings from a study where pairs collaborated to complete shared navigation and search tasks. We illustrate the benefits of providing the desktop user with a view that is elevated, manipulable, and decoupled from the outdoor user. In addition, we articulate how participants overcame challenges in communicating environmental information and navigational cues, negotiated control of the view, and used the drone as a tool for sharing experiences. This provides a new way of thinking about mobile video conferencing where cameras that are decoupled from both users play an integral role in communication, collaboration, and sharing experiences.
Supplemental Material
- Jenay M. Beer and Leila Takayama. 2011. Mobile Remote Presence Systems for Older Adults: Acceptance, Benefits, and Concerns. Proceedings of the 6th International Conference on Human-robot Interaction, ACM, 19--26. http://doi.org/10.1145/1957656.1957665 Google Scholar
Digital Library
- Jed R. Brubaker, Gina Venolia, and John C. Tang. 2012. Focusing on shared experiences: moving beyond the camera in video communication. Proceedings of the Designing Interactive Systems Conference, ACM, 96--105. Google ScholarDigital Library
- Jessica R. Cauchard, L. E. Jane, Kevin Y. Zhai, and James A. Landay. 2015. Drone & Me: An Exploration into Natural Human-drone Interaction. Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing, ACM, 361--365. http://doi.org/10.1145/2750858.2805823 Google ScholarDigital Library
- Lars M. Ellison, Peter A. Pinto, Fernando Kim, et al. 2004. Telerounding and patient satisfaction after surgery. Journal of the American College of Surgeons 199, 4: 523--530. http://doi.org/10.1016/j.jamcollsurg.2004.06.022Google ScholarCross Ref
- Mica R. Endsley. 1995. Toward a Theory of Situation Awareness in Dynamic Systems. Human Factors: The Journal of the Human Factors and Ergonomics Society 37, 1: 32--64. http://doi.org/10.1518/001872095779049543Google ScholarCross Ref
- Omid Fakourfar, Kevin Ta, Richard Tang, Scott Bateman, and Anthony Tang. 2016. Stabilized Annotations for Mobile Remote Assistance. Proceedings of the 34th Annual ACM Conference on Human Factors in Computing Systems, ACM. http://doi.org/10.1145/2858036.2858171 Google ScholarDigital Library
- Susan R. Fussell, Leslie D. Setlock, Jie Yang, Jiazhi Ou, Elizabeth Mauer, and Adam D. I. Kramer. 2004. Gestures over Video Streams to Support Remote Collaboration on Physical Tasks. Hum.-Comput. Interact. 19, 3: 273--309. http://doi.org/10.1207/s15327051hci1903_3 Google ScholarDigital Library
- Steffen Gauglitz, Cha Lee, Matthew Turk, and Tobias Höllerer. 2012. Integrating the Physical Environment into Mobile Remote Collaboration. Proceedings of the 14th International Conference on Human-computer Interaction with Mobile Devices and Services, ACM, 241--250. http://doi.org/10.1145/2371574.2371610 Google ScholarDigital Library
- Steffen Gauglitz, Benjamin Nuernberger, Matthew Turk, and Tobias Höllerer. 2014. World-stabilized Annotations and Virtual Scene Navigation for Remote Collaboration. Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology, ACM, 449--459. http://doi.org/10.1145/2642918.2647372 Google ScholarDigital Library
- Carl Gutwin and Reagan Penner. 2002. Improving Interpretation of Remote Gestures with Telepointer Traces. Proceedings of the 2002 ACM Conference on Computer Supported Cooperative Work, ACM, 49--57. http://doi.org/10.1145/587078.587086 Google ScholarDigital Library
- Jim Hollan and Scott Stornetta. 1992. Beyond Being There. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM, 119--125. http://doi.org/10.1145/142750.142769 Google ScholarDigital Library
- Kori Inkpen, Brett Taylor, Sasa Junuzovic, John Tang, and Gina Venolia. 2013. Experiences2Go: sharing kids' activities outside the home with remote family members. Proceedings of the 2013 conference on Computer supported cooperative work, ACM, 1329--1340. Google ScholarDigital Library
- C. A. Johnson, J. A. Adams, and K. Kawamura. 2003. Evaluation of an enhanced human-robot interface. IEEE International Conference on Systems, Man and Cybernetics, 2003, 900--905 vol.1. http://doi.org/10.1109/ICSMC.2003.1243929Google Scholar
- Brennan Jones, Anna Witcraft, Scott Bateman, Carman Neustaedter, and Anthony Tang. 2015. Mechanics of Camera Work in Mobile Video Collaboration. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, ACM, 957--966. http://doi.org/10.1145/2702123.2702345 Google ScholarDigital Library
- Tejinder K. Judge and Carman Neustaedter. 2010. Sharing Conversation and Sharing Life: Video Conferencing in the Home. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM, 655--658. http://doi.org/10.1145/1753326.1753422 Google ScholarDigital Library
- Shunichi Kasahara and Jun Rekimoto. 2014. JackIn: integrating first-person view with out-of-body vision generation for human-human augmentation. Proceedings of the 5th Augmented Human International Conference, ACM, 46. Google ScholarDigital Library
- Shunichi Kasahara and Jun Rekimoto. 2015. JackIn Head: An Immersive Human-human Telepresence System. SIGGRAPH Asia 2015 Emerging Technologies, ACM, 14:1--14:3. http://doi.org/10.1145/2818466.2818486 Google ScholarDigital Library
- Shunichi Kasahara and Jun Rekimoto. 2015. JackIn Head: Immersive Visual Telepresence System with Omnidirectional Wearable Camera for Remote Collaboration. Proceedings of the 21st ACM Symposium on Virtual Reality Software and Technology, ACM, 217--225. http://doi.org/10.1145/2821592.2821608 Google ScholarDigital Library
- Tadakazu Kashiwabara, Hirotaka Osawa, Kazuhiko Shinozawa, and Michita Imai. 2012. TEROOS: A Wearable Avatar to Enhance Joint Activities. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM, 2001--2004. http://doi.org/10.1145/2207676.2208345 Google ScholarDigital Library
- Seungwon Kim, Sasa Junuzovic, and Kori Inkpen. 2014. The Nomad and the Couch Potato: Enriching Mobile Shared Experiences with Contextual Information. Proceedings of the 18th International Conference on Supporting Group Work, ACM, 167--177. Google ScholarDigital Library
- David Kirk and Danae Stanton Fraser. 2006. Comparing Remote Gesture Technologies for Supporting Collaborative Physical Tasks. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM, 1191--1200. http://doi.org/10.1145/1124772.1124951 Google ScholarDigital Library
- Sven Kratz, Daniel Avrahami, Don Kimber, Jim Vaughan, Patrick Proppe, and Don Severns. 2015. Polly Wanna Show You: Examining ViewpointConveyance Techniques for a Shoulder-Worn Telepresence System. Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI 2014), Industrial Case Studies, ACM. Google ScholarDigital Library
- Sven Kratz, Don Kimber, Weiqing Su, Gwen Gordon, and Don Severns. 2014. Polly: Being there through the parrot and a guide. Proceedings of the 16th international conference on Human-computer interaction with mobile devices & services, ACM, 625--630. Google ScholarDigital Library
- Min Kyung Lee and Leila Takayama. 2011. Now, I have a body: Uses and social norms for mobile remote presence in the workplace. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM, 33--42. Google ScholarDigital Library
- Paul Luff, Christian Heath, Hideaki Kuzuoka, Jon Hindmarsh, Keiichi Yamazaki, and Shinya Oyama. 2003. Fractured ecologies: creating environments for collaboration. Human-Computer Interaction 18, 1: 51--84. Google ScholarDigital Library
- Michael Massimi and Carman Neustaedter. 2014. Moving from talking heads to newlyweds: exploring video chat use during major life events. Proceedings of the 2014 conference on Designing interactive systems, ACM, 43--52. Google ScholarDigital Library
- Florian 'Floyd' Mueller and Matthew Muirhead. 2015. Jogging with a Quadcopter. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, ACM, 2023--2032. http://doi.org/10.1145/2702123.2702472 Google ScholarDigital Library
- Carman Neustaedter and Tejinder K. Judge. 2010. Peek-A-Boo: The Design of a Mobile Family Media Space. Proceedings of the 12th ACM International Conference Adjunct Papers on Ubiquitous Computing - Adjunct, ACM, 449--450. http://doi.org/10.1145/1864431.1864482 Google ScholarDigital Library
- Carman Neustaedter, Gina Venolia, Jason Procyk, and Daniel Hawkins. 2016. To Beam or Not to Beam: A Study of Remote Telepresence Attendance at an Academic Conference. Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing, ACM, 418--431. http://doi.org/10.1145/2818048.2819922 Google ScholarDigital Library
- Kenton O'Hara, Alison Black, and Matthew Lipson. 2006. Everyday Practices with Mobile Video Telephony. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM, 871--880. http://doi.org/10.1145/1124772.1124900 Google ScholarDigital Library
- Oscar Olmos, Christopher D. Wickens, and Andrew Chudy. 2000. Tactical Displays for Combat Awareness: An Examination of Dimensionality and Frame of Reference Concepts and the Application of Cognitive Engineering. The International Journal of Aviation Psychology 10, 3: 247--271. http://doi.org/10.1207/S15327108IJAP1003_03Google ScholarCross Ref
- Eric Paulos and John Canny. 1998. PRoP: Personal Roving Presence. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM Press/Addison-Wesley Publishing Co., 296--303. http://doi.org/10.1145/274644.274686 Google ScholarDigital Library
- Eric Paulos and John Canny. 2001. Social TeleEmbodiment: Understanding Presence. Autonomous Robots 11, 1: 87--95. http://doi.org/10.1023/A:1011264330469 Google ScholarDigital Library
- Jason Procyk, Carman Neustaedter, Carolyn Pang, Anthony Tang, and Tejinder K. Judge. 2014. Exploring Video Streaming in Public Settings: Shared Geocaching over Distance Using Mobile Video Chat. Proceedings of the 32Nd Annual ACM Conference on Human Factors in Computing Systems, ACM, 2163--2172. http://doi.org/10.1145/2556288.2557198 Google ScholarDigital Library
- Irene Rae, Bilge Mutlu, and Leila Takayama. 2014. Bodies in Motion: Mobility, Presence, and Task Awareness in Telepresence. Proceedings of the 32Nd Annual ACM Conference on Human Factors in Computing Systems, ACM, 2153--2162. http://doi.org/10.1145/2556288.2557047 Google ScholarDigital Library
- M. Sharma, D. Hildebrandt, G. Newman, J.E. Young, and R. Eskicioglu. 2013. Communicating affect via flight path Exploring use of the Laban Effort System for designing affective locomotion paths. 2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI), 293--300. http://doi.org/10.1109/HRI.2013.6483602 Google ScholarDigital Library
- Daniel Szafir, Bilge Mutlu, and Terrence Fong. 2014. Communication of Intent in Assistive Free Flyers. Proceedings of the 2014 ACM/IEEE International Conference on Human-robot Interaction, ACM, 358--365. http://doi.org/10.1145/2559636.2559672 Google ScholarDigital Library
- Daniel Szafir, Bilge Mutlu, and Terry Fong. 2015. Communicating Directionality in Flying Robots. Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction, ACM, 19--26. http://doi.org/10.1145/2696454.2696475 Google ScholarDigital Library
- Lisa C. Thomas and Christopher D. Wickens. 2000. Effects of Display Frames of Reference on Spatial Judgments and Change Detection.Google Scholar
- Lisa C. Thomas and Christopher D. Wickens. 2001. Visual Displays and Cognitive Tunneling: Frames of Reference Effects on Spatial Judgments and Change Detection. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 45, 4: 336--340. http://doi.org/10.1177/154193120104500415Google Scholar
- Tzung-Cheng Tsai, Yeh-Liang Hsu, An-I. Ma, Trevor King, and Chang-Huei Wu. 2007. Developing a Telepresence Robot for Interpersonal Communication with the Elderly in a Home Environment. Telemedicine and e-Health 13, 4: 407--424. http://doi.org/10.1089/tmj.2006.0068Google ScholarCross Ref
- Gina Venolia, John Tang, Ruy Cervantes, et al. 2010. Embodied Social Proxy: Mediating Interpersonal Connection in Hub-and-satellite Teams. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM, 1049--1058. http://doi.org/10.1145/1753326.1753482 Google ScholarDigital Library
- Lily - The Camera That Follows You. Retrieved September 23, 2015 from https://www.lily.camera/Google Scholar
- Virtual Photo Walks, using Video conferencing tools to help people be interactive citizens again. - Home. Retrieved September 23, 2015 from http://www.virtualphotowalks.org/Google Scholar
- Periscope. Periscope. Retrieved January 11, 2016 from https://www.periscope.tvGoogle Scholar
Index Terms
- Elevating Communication, Collaboration, and Shared Experiences in Mobile Video through Drones
Recommendations
Designing Telepresence Drones to Support Synchronous, Mid-air Remote Collaboration: An Exploratory Study
CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing SystemsDrones are increasingly used to support humanitarian crises and events that involve dangerous or costly tasks. While drones have great potential for remote collaborative work and aerial telepresence, existing drone technology is limited in its support ...
Mechanics of Camera Work in Mobile Video Collaboration
CHI '15: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing SystemsMobile video conferencing, where one or more participants are moving about in the real world, enables entirely new interaction scenarios (e.g., asking for help to construct or repair an object, or showing a physical location). While we have a good ...
Collaboard: a remote collaboration groupware device featuring an embodiment-enriched shared workspace
GROUP '10: Proceedings of the 2010 ACM International Conference on Supporting Group WorkIn this paper we present a mixed presence groupware device called "CollaBoard". The device improves collaboration between co-located and remote partners by providing a high level of workspace awareness. This is achieved by superimposing a life-size ...
Comments