Barry Brown
ABSTRACT
Despite the widespread use of mobile devices, details of mobile technology use 'in the wild' have proven difficult to collect. This paper uses video data to gain new insight into the use of mobile computing devices. Our new method combines screen-capture of iPhone use with video recordings from wearable cameras. We use this data to analyse how mobile device use is threaded into other co-present activities, focusing on the use of maps and internet searches. Close analysis reveals novel aspects of gestures on touch screens, how they serve 'double duty' - both as interface gestures but as as resources for ongoing joint action. We go on to describe how users 'walk the blue dot' to orientate themselves, and how searches are occasioned by the local environment. In conclusion, we argue that mobile devices - rather than pushing us away from the world around us - are instead just another thread in the complex tapestry of everyday interaction.
- Barkhuus, L. and Polichar, V. E. Empowerment through seamfulness: smart phones in everyday life. Personal and Ubiquitous Computing, 15, 6 (2011), 629--639. Google Scholar
Digital Library
- Berg, S., Taylor, A., et al. Mobile devices for the next generation: device designs for teenagers. In Proceedings of CHI 2003, Fort Lauderdale, Florida, ACM Press (2003). Google ScholarDigital Library
- Böhmer, M., Hecht, B., et al. Falling asleep with angry birds, facebook and kindle: a large scale study on mobile application usage. In Proceedings of MobileHCI 2011 (2011), 47--56 ACM. Google ScholarDigital Library
- Brown, B. and Chalmers, M. Tourism and mobile technology. In Proceedings of ECSCW 2003, Klewer Academic Press (2003), 335--355. Google ScholarDigital Library
- Brown, B. and Laurier, E. The normal natural troubles of driving with GPS. In Proceedings of CHI 2012 (2012), 1621--1630 ACM. Google ScholarDigital Library
- Brown, B. and O'hara, K. Place as a practical concern of mobile workers. Environment and Planning A, 35, 9 (2003), 1565--1587.Google ScholarCross Ref
- Carter, S., Mankoff, J., et al. Momento: support for situated ubicomp experimentation. In Proceedings of the SIGCHI conference on Human factors in computing systems (2007), 125--134 ACM. Google ScholarDigital Library
- Church, K. and Oliver, N. Understanding mobile web and mobile search use in today's dynamic mobile landscape. In Mobile HCI 2011 (2011), 67--76 ACM. Google ScholarDigital Library
- Froehlich, J., Chen, M. Y., et al. MyExperience: a system for in situ tracing and capturing of user feedback on mobile phones. In MobiSys '07 (2007), 57--70 ACM. Google ScholarDigital Library
- Golledge, R. G. Human Wayfinding and cognitive maps. In Wayfinding behavior, cognitive mapping and other spatial processes, The John Hopkins University Press (1999).Google Scholar
- Goodwin, C. Notes on story structure and the organization of participation. In Structures of social action (1984), 225--246.Google Scholar
- Greiffenhagen, C. and Watson, R. Visual repairables: analysing the work of repair in human-computer interaction. Visual Communication, 8, 1 (2009), 65--90.Google ScholarCross Ref
- Heath, C. and Luff, P. Technology in action. Cambridge university press, Cambridge, 2000. Google ScholarDigital Library
- Heath, C., Svensson, M. S., et al. Configuring awareness. Computer Supported Cooperative Work (CSCW), 11, 3 (2002), 317--347. Google ScholarDigital Library
- Heath, C. C. and Luff, P. Collaboration and control: Crisis Management and Multimedia Technology. CSCW, 1 (1-2) (1992), 69--94.Google Scholar
- Hindmarsh, J., Fraser, M., et al. Object-focused interaction in collaborative virtual environments. ACM Transactions on Computer-Human Interaction (TOCHI), 7, 4 (2000), 477--509. Google ScholarDigital Library
- Ipsos-MediaCT/Google. Mobile Internet & Smartphone Adoption: New Insights into Consumer Usage of Mobile Devices, the Shift to Smartphones & the Emergence of Tablets, http://googlemobileads.blogspot.se/2012/01/new-research-global-surge-in-smartphone.html. 2012.Google Scholar
- Kamvar, M. and Baluja, S. A large scale study of wireless search behavior: Google mobile search. In Proceedings of the SIGCHI conference on Human Factors in computing systems (2006), 701--709 ACM. Google ScholarDigital Library
- Laurier, E. and Brown, B. Rotating maps and readers: praxiological aspects of alignment and orientation. Transactions of the Institute of British Geographers, 33, 2 (2008), 201--216.Google ScholarCross Ref
- Luff, P. and Heath, C. Mobility in Collaboration. In Proceedings of CSCW 1998, ACM Press (1998), 305--314. Google ScholarDigital Library
- March, J. and Sevon, G. Gossip, information and decision making. In Decisions and Organzations, Basil Blackwell (1988).Google Scholar
- Merchant, G. Mobile practices in everyday life: Popular digital technologies and schooling revisited. British Journal of Educational Technology, 43, 5 (2012), 770--782.Google ScholarCross Ref
- Mondada, L. Talking and driving: multi-activity in the car. Semiotica, 2012, 191 (2012), 223--256.Google Scholar
- Murtagh, G. Seeing the 'rules': preliminary observations on action, interaction and mobile phone use. In Wireless World, Springer (2001). Google ScholarDigital Library
- Palen, L. and Salzman, M. Voice-mail diary studies for naturalistic data capture under mobile conditions. ACM, City, 2002.Google ScholarDigital Library
- Palen, L., Salzman, M., et al. Going wireless: behavior & practice of new mobile phone users. In Proceedings of CSCW '00, ACM (2000), 201--210. Google ScholarDigital Library
- Psathas, G. Conversation analysis: The study of talk-in-interaction. Sage Publications, Incorporated, 1994.Google Scholar
- Rodriguez, B. Amid GPS boom, paper maps hang on, 3rd July 2012. USA Today (2012).Google Scholar
- Scollon, C. N., Kim-Prieto, C., et al. Experience sampling: Promises and pitfalls, strengths and weaknesses. Journal of Happiness Studies, 4, 1 (2003), 5--34.Google ScholarCross Ref
- Tse, E., Shen, C., et al. How pairs interact over a multimodal digital table. In Proceedings of the SIGCHI conference on Human factors in computing systems (2007), 215--218 ACM. Google ScholarDigital Library
- vom Lehn, D., Heath, C., et al. Exhibiting Interaction: Conduct and Collaboration in Museums and Galleries. Symbolic Interaction, 24, 2 (2001), 189--216.Google ScholarCross Ref
- Weilenmann, A. and Larsson, C. Local Use and Sharing of Mobile Phones. In Wireless World: social, cultural and interactional aspects of wireless technology, Springer Verlag (2001). Google ScholarDigital Library
Index Terms
- iPhone in vivo: video analysis of mobile device use
Recommendations
100 days of iPhone use: understanding the details of mobile device use
MobileHCI '14: Proceedings of the 16th international conference on Human-computer interaction with mobile devices & servicesInternet connected mobile devices are an increasingly ubiquitous part of our everyday lives and we present here the results from unobtrusive audio-video recordings of iPhone use -- over 100 days of device use collected from 15 users. The data reveals ...
100 days of iPhone use: mobile recording in the wild
CHI EA '14: CHI '14 Extended Abstracts on Human Factors in Computing SystemsThis report presents preliminary results from an unobtrusive video study of iPhone use -- totalling over 100 days of everyday device usage. The data gives us a uniquely detailed view on how messages, social media and internet use are integrated and ...
Responsibilities and implications: further thoughts on ethnography and design
DUX '07: Proceedings of the 2007 conference on Designing for User eXperiencesMany researchers and practitioners in user experience design have turned towards social sciences to find ways to understand the social contexts in which both users and technologies are embedded. Ethnographic approaches are increasingly prominent as ...
Comments