Alexis Hiniker
Jon E. Froehlich
Mingrui Zhang
ABSTRACT
Many traditional HCI methods, such as surveys and interviews, are of limited value when working with preschoolers. In this paper, we present anchored audio sampling (AAS), a remote data collection technique for extracting qualitative audio samples during field deployments with young children. AAS offers a developmentally sensitive way of understanding how children make sense of technology and situates their use in the larger context of daily life. AAS is defined by an anchor event, around which audio is collected. A sliding window surrounding this anchor captures both antecedent and ensuing recording, providing the researcher insight into the activities that led up to the event of interest as well as those that followed. We present themes from three deployments that leverage this technique. Based on our experiences using AAS, we have also developed a reusable open-source library for embedding AAS into any Android application.
- {n. d.}. Amazon Web Services (AWS) - Cloud Computing Services. https://aws.amazon.com/Google Scholar
- 1978. The Belmont report: Ethical principles and guidelines for the protection of human subjects of research. Superintendent of Documents.Google Scholar
- 2017. The Common Sense Census: Media Use by Kids Age Zero to Eight 2017 | Common Sense Media., 64 pages. https://www.commonsensemedia.org/research/ the-common-sense-census-media-use-by-kids-age-zero-to-eight-2017Google Scholar
- Saeed Abdullah, Elizabeth L. Murnane, Mark Matthews, Matthew Kay, Julie A. Kientz, Geri Gay, and Tanzeem Choudhury. 2016. Cognitive rhythms. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing - UbiComp '16. ACM Press, New York, New York, USA, 178--189. Google ScholarDigital Library
- Sabirah Adams, Shazly Savahl, and Tobia Fattore. 2017. Children's representations of nature using photovoice and community mapping: Perspectives from South Africa. International Journal of Qualitative Studies on Health and Well-being 12, 1 (jan 2017), 1333900.Google ScholarCross Ref
- William Albert, Thomas Tullis, and Donna Tedesco. 2009. Beyond the usability lab: Conducting large-scale online user experience studies. Morgan Kaufmann. Google ScholarDigital Library
- AHMED S Alghamdi, ALIH Al-Badi, ROOBAEA ALROOBAEA, and P Mayhew. 2013. A Comparative Study of Synchronous and Asynchronous Remote Usability Testing Methods. International Review of Basic and Applied Sciences 1, 3 (2013), 61--97.Google Scholar
- Morten Sieker Andreasen, Henrik Villemann Nielsen, Simon Ormholt Schrøder, and Jan Stage. 2007. What happened to remote usability testing?. In Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '07. ACM Press, New York, New York, USA, 1405. Google ScholarDigital Library
- Sangwon Bae, Tammy Chung, Denzil Ferreira, Anind K. Dey, and Brian Sufoletto. 2018. Mobile phone sensors and supervised machine learning to identify alcohol use events in young adults: Implications for just-in-time adaptive interventions. Addictive Behaviors 83 (aug 2018), 42--47.Google Scholar
- Erin Beneteau, Olivia Richards, Mingrui Zhang, Julie A. Kientz, Jason C. Yip, and Alexis Hiniker. 2019. Communication breakdowns between families and Alexa. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems - CHI '19. 1--14. Google ScholarDigital Library
- Scott Carter, Jennifer Mankof, and Jefrey Heer. 2007. Momento. In Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '07. ACM Press, New York, New York, USA, 125. arXiv:arXiv:1303.5153v1 Google ScholarDigital Library
- Eve V Clark. 2009. First language acquisition. Cambridge University Press.Google Scholar
- Sunny Consolvo and Miriam Walker. 2003. Using the experience sampling method to evaluate ubicomp applications. IEEE Pervasive Computing 2, 2 (apr 2003), 24--31. Google ScholarDigital Library
- Juliet Corbin and Anselm Strauss. 2008. Basics of qualitative research: Techniques and procedures for developing grounded theory. (2008).Google Scholar
- Mary Czerwinski, Eric Horvitz, and Susan Wilhite. 2004. A diary study of task switching and interruptions. Proceedings of the 2004 conference on Human factors in computing systems - CHI '04 (2004), 175--182. Google ScholarDigital Library
- Pierre-Charles David and Thomas Ledoux. 2005. WildCAT. In Proceedings of the 3rd international workshop on Middleware for pervasive and ad-hoc computing - MPAC '05. ACM Press, New York, New York, USA, CHI 2019, May 4--9, 2019, Glasgow, Scotland UK A. Hiniker et al. 1--7.Google Scholar
- Anind K. Dey and Jennifer Mankof. 2005. Designing mediation for context-aware applications. ACM Transactions on Computer-Human Interaction 12, 1 (mar 2005), 53--80. Google ScholarDigital Library
- Anind K. Dey, Katarzyna Wac, Denzil Ferreira, Kevin Tassini, Jin-Hyuk Hong, and Julian Ramos. 2011. Getting closer. In Proceedings of the 13th international conference on Ubiquitous computing - UbiComp '11. ACM Press, New York, New York, USA, 163.Google ScholarDigital Library
- Allison Druin. 1999. Cooperative inquiry. In Proceedings of the SIGCHI conference on Human factors in computing systems the CHI is the limit - CHI '99. ACM Press, New York, New York, USA, 592--599. Google ScholarDigital Library
- Allison Druin. 2002. The role of children in the design of new technology. Behaviour & Information Technology 21, 1 (jan 2002), 1--25.Google ScholarCross Ref
- Nicolas Ducheneaut and Robert J. Moore. 2004. The social side of gaming. In Proceedings of the 2004 ACM conference on Computer supported cooperative work - CSCW '04. ACM Press, New York, New York, USA, 360. Google ScholarDigital Library
- Jóhanna Einarsdóttir. 2007. Research with children: methodological and ethical challenges. European Early Childhood Education Research Journal 15, 2 (jun 2007), 197--211.Google ScholarCross Ref
- Emre Ertin, Nathan Stohs, Santosh Kumar, Andrew Raij, Mustafa Al'Absi, and Siddharth Shah. 2011. AutoSense. In Proceedings of the 9th ACM Conference on Embedded Networked Sensor Systems SenSys '11. ACM Press, New York, New York, USA, 274.Google Scholar
- Allison Farber, Allison Druin, Gene Chipman, Dawn Julian, and Sheila Somashekher. 2002. How Young Can Our Technology Design Partners Be?. In PDC. 272--277.Google Scholar
- Jon Froehlich, Mike Y. Chen, Sunny Consolvo, Beverly Harrison, and James A. Landay. 2007. MyExperience. In Proceedings of the 5th international conference on Mobile systems, applications and services - MobiSys '07. ACM Press, New York, New York, USA, 57.Google Scholar
- Amy Gallo. 2017. A Refresher on A/B Testing. Harvard Business Review (jun 2017). https://hbr.org/2017/06/a-refresher-on-ab-testingGoogle Scholar
- Franca Garzotto. 2008. Broadening children's involvement as design partners. In Proceedings of the 7th international conference on Interaction design and children - IDC '08. ACM Press, New York, New York, USA, 186. Google ScholarDigital Library
- M Elizabeth Graue and Daniel J Walsh. 1998. Studying children in context: Theories, methods, and ethics. Sage Publications.Google Scholar
- Deborah Harcourt. 2011. An encounter with children: Seeking meaning and understanding about childhood. European Early Childhood Education Research Journal 19, 3 (sep 2011), 331--343.Google ScholarCross Ref
- Gillian R. Hayes, Shwetak N. Patel, Khai N. Truong, Giovanni Iachello, Julie A. Kientz, Rob Farmer, and Gregory D. Abowd. 2004. The Personal Audio Loop: Designing a Ubiquitous Audio-Based Memory Aid. Springer, Berlin, Heidelberg, 168--179.Google Scholar
- Gillian R. Hayes, Khai N. Truong, Gregory D. Abowd, and Trevor Pering. 2005. Experience bufers. In CHI '05 extended abstracts on Human factors in computing systems - CHI '05. ACM Press, New York, New York, USA, 1435. Google ScholarDigital Library
- Morten Hertzum, Pia Borlund, and Kristina B. Kristofersen. 2015. What Do Thinking-Aloud Participants Say? A Comparison of Moderated and Unmoderated Usability Sessions. International Journal of Human-Computer Interaction 31, 9 (sep 2015), 557--570.Google ScholarCross Ref
- Alexis Hiniker, Sharon S. Heung, Sungsoo (Ray) Hong, and Julie A. Kientz. 2018. Coco's Videos. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI '18, Vol. 2018-April. 1--13. Google ScholarDigital Library
- Steve Hodges, Lyndsay Williams, Emma Berry, Shahram Izadi, James Srinivasan, Alex Butler, Gavin Smyth, Narinder Kapur, and Ken Wood. 2006. SenseCam: A Retrospective Memory Aid. Springer, Berlin, Heidelberg, 177--193. arXiv:9780201398298 Google ScholarDigital Library
- Karen Holtzblatt and Sandra Jones. 1993. Contextual inquiry: A participatory technique for system design. Participatory design: Principles and practices (1993), 177--210.Google Scholar
- John Hughes, L Bannon, J Bowers, P Carstensen, K Kuutti, J Pycock, T Rodden, K Schmidt, D Shapiro, W Sharrock, and Others. 1993. Informing CSCW system requirements. COMIC, Esprit Basic Research Project 6225 (1993).Google Scholar
- Stephen S. Intille, John Rondoni, Charles Kukla, Isabel Ancona, and Ling Bao. 2003. A context-aware experience sampling tool. In CHI '03 extended abstracts on Human factors in computer systems - CHI '03. ACM Press, New York, New York, USA, 972. Google ScholarDigital Library
- Sara Isola and Jerry Fails. 2012. Family and Design in the IDC and CHI Communitieis. IDC 2012 (2012), 40--49. Google ScholarDigital Library
- Janne J. Jensen and Mikael B. Skov. 2005. A review of research methods in children's technology design. In Proceeding of the 2005 conference on Interaction design and children - IDC '05. ACM Press, New York, New York, USA, 80--87. Google ScholarDigital Library
- Jasmine Jones, David Merritt, and Mark S. Ackerman. 2017. KidKeeper. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing - CSCW '17. ACM Press, New York, New York, USA, 1864--1875. Google ScholarDigital Library
- Hilda K Kabali, Matilde M Irigoyen, Rosemary Nunez-Davis, Jennifer G Budacki, Sweta H Mohanty, Kristin P Leister, and Robert L Bonner. 2015. Exposure and Use of Mobile Media Devices by Young Children. Pediatrics (nov 2015), peds.2015--2151--.Google Scholar
- Eiman Kanjo. 2010. NoiseSPY: A real-time mobile phone platform for urban noise monitoring and mapping. Mobile Networks and Applications 15, 4 (aug 2010), 562--574. Google ScholarDigital Library
- Kostadin Kushlev and Elizabeth W. Dunn. 2018. Smartphones distract parents from cultivating feelings of connection when spending time with their children. Journal of Social and Personal Relationships (apr 2018), 026540751876938.Google Scholar
- Reed Larson and Mihaly Csikszentmihalyi. 1983. The experience sampling method. New directions for methodology of social & behavioral science (1983).Google Scholar
- Kai Lukof, Cissy Yu, Julie Kientz, and Alexis Hiniker. 2018. What Makes Smartphone Use Meaningful or Meaningless? Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2, 1 (mar 2018), 1--26. Google ScholarDigital Library
- Emily McReynolds, Sarah Hubbard, Timothy Lau, Aditya Saraf, Maya Cakmak, and Franziska Roesner. 2017. Toys that Listen. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems - CHI '17 (CHI '17). ACM, New York, 5197--5207. Google ScholarDigital Library
- David R. Millen. 2000. Rapid ethnography. In Proceedings of the conference on Designing interactive systems processes, practices, methods, and techniques - DIS '00. ACM Press, New York, New York, USA, 280--286. Anchored Audio Sampling Google ScholarDigital Library
- E Olmsted and M Gill. 2005. In-person usability study compared with self-administered web (remote-diferent time-place) study: does mode of study produce similar results. In Proceedings of UPA.Google Scholar
- Judith S Olson and Wendy A Kellogg. 2014. Ways of Knowing in HCI. Springer Science & Business. Google Scholar
- Antti Oulasvirta. 2009. Field Experiments in HCI: Promises and Challenges. In Future Interaction Design II. Springer London, London, 87-- 116.Google Scholar
- Leysia Palen and Marilyn Salzman. 2002. Voice-mail diary studies for naturalistic data capture under mobile conditions. In Proceedings of the 2002 ACM conference on Computer supported cooperative work - CSCW '02. ACM Press, New York, New York, USA, 87. Google ScholarDigital Library
- Kiran K. Rachuri, Cecilia Mascolo, Mirco Musolesi, and Peter J. Rentfrow. 2011. SociableSense. In Proceedings of the 17th annual international conference on Mobile computing and networking - MobiCom '11. ACM Press, New York, New York, USA, 73.Google Scholar
- Kiran K. Rachuri, Mirco Musolesi, Cecilia Mascolo, Peter J. Rentfrow, Chris Longworth, and Andrius Aucinas. 2010. EmotionSense. In Proceedings of the 12th ACM international conference on Ubiquitous computing - Ubicomp '10. ACM Press, New York, New York, USA, 281. Google ScholarDigital Library
- Mika Raento, Antti Oulasvirta, and Nathan Eagle. 2009. Smartphones: An emerging tool for social scientists. Sociological Methods and Research 37, 3 (feb 2009), 426--454. arXiv:arXiv:1011.1669v3Google ScholarCross Ref
- M. Raento, A. Oulasvirta, R. Petit, and H. Toivonen. 2005. ContextPhone: A Prototyping Platform for Context-Aware Mobile Applications. IEEE Pervasive Computing 4, 2 (apr 2005), 51--59. Google ScholarDigital Library
- Robert W. Reeder, Adrienne Porter Felt, Sunny Consolvo, Nathan Malkin, Christopher Thompson, and Serge Egelman. 2018. An Experience Sampling Study of User Reactions to Browser Warnings in the Field. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI '18. ACM Press, New York, New York, USA, 1--13. Google ScholarDigital Library
- Katharina Reinecke and Abraham Bernstein. 2011. Improving performance, perceived usability, and aesthetics with culturally adaptive user interfaces. ACM Transactions on Computer-Human Interaction 18, 2 (jun 2011), 1--29. Google ScholarDigital Library
- Yvonne Rogers, Kay Connelly, Lenore Tedesco, William Hazlewood, Andrew Kurtz, Robert E. Hall, Josh Hursey, and Tammy Toscos. 2007. Why It's Worth the Hassle: The Value of In-Situ Studies When Designing Ubicomp. In UbiComp 2007: Ubiquitous Computing. Springer Berlin Heidelberg, Berlin, Heidelberg, 336--353. Google ScholarDigital Library
- Juergen Sauer, Andreas Sonderegger, Klaus Heyden, Jasmin Biller, Julia Klotz, and Andreas Uebelbacher. 2019. Extra-laboratorial usability tests: An empirical comparison of remote and classical feld testing with lab testing. Applied Ergonomics 74 (jan 2019), 85--96.Google Scholar
- Abigail J. Sellen, Andrew Fogg, Mike Aitken, Steve Hodges, Carsten Rother, and Ken Wood. 2007. Do life-logging technologies support memory for the past?. In Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '07. ACM Press, New York, New York, USA, 81. Google ScholarDigital Library
- Clayton Shepard, Ahmad Rahmati, Chad Tossell, Lin Zhong, and Phillip Kortum. 2011. LiveLab. ACM SIGMETRICS Performance Evaluation Review 38, 3 (jan 2011), 15. CHI 2019, May 4--9, 2019, Glasgow, Scotland UKGoogle Scholar
- Timothy Sohn, Kevin A. Li, William G. Griswold, and James D. Hollan. 2008. A diary study of mobile information needs. In Proceeding of the twenty-sixth annual CHI conference on Human factors in computing systems - CHI '08. ACM Press, New York, New York, USA, 433. Google ScholarDigital Library
- Arthur A Stone, Saul S Shifman, and Marten W DeVries. 1999. Ecological momentary assessment. (1999).Google Scholar
- Lucy A Suchman. 1987. Plans and situated actions: The problem of human-machine communication. Cambridge university press. Google ScholarDigital Library
- Caroline Wang and Mary Ann Burris. 1997. Photovoice: Concept, Methodology, and Use for Participatory Needs Assessment. Health Education & Behavior 24, 3 (jun 1997), 369--387.Google ScholarCross Ref
- Rui Wang, Emily A. Scherer, Vincent W. S. Tseng, Dror Ben-Zeev, Min S. H. Aung, Saeed Abdullah, Rachel Brian, Andrew T. Campbell, Tanzeem Choudhury, Marta Hauser, John Kane, and Michael Merrill. 2016. CrossCheck: toward passive sensing and detection of mental health changes in people with schizophrenia. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing - UbiComp '16. ACM Press, New York, New York, USA, 886--897. Google ScholarDigital Library
- Rui Wang, Emily A. Scherer, Megan Walsh, Weichen Wang, Min Hane Aung, Dror Ben-Zeev, Rachel Brian, Andrew T. Campbell, Tanzeem Choudhury, Marta Hauser, and John Kane. 2018. PREDICTING SYMPTOM TRAJECTORIES OF SCHIZOPHRENIA USING MOBILE SENSING. GetMobile: Mobile Computing and Communications 22, 2 (sep 2018), 32--37. Google ScholarDigital Library
- Graver J. Whitehurst and Christopher J. Lonigan. 1998. Child Development and Emergent Literacy. Child Development 69, 3 (jun 1998), 848--872.Google ScholarCross Ref
- Jason C. Yip, Kiley Sobel, Caroline Pitt, Kung Jin Lee, Sijin Chen, Kari Nasu, and Laura R. Pina. 2017. Examining Adult-Child Interactions in Intergenerational Participatory Design. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems - CHI '17. ACM Press, New York, New York, USA, 5742--5754. Google ScholarDigital Library
Index Terms
- Anchored Audio Sampling: A Seamless Method for Exploring Children's Thoughts During Deployment Studies
Recommendations
Are screen media the new pacifiers? The role of parenting stress and parental attitudes for children's screen time in early childhood
AbstractScreen media are increasingly shaping our everyday lives, including those of young children. Among other reasons, parents might use screen media as a problem-oriented coping strategy to reduce parenting stress levels. Furthermore, parental ...
Highlights- Parenting stress was positively associated with young children's screen time.
- Positive parental attitudes toward young children's screen media use were positively associated with children's screen time.
- Parental attitudes partly ...
Exploring Parent Use of Early STEM Media to Inform Design for Children
IDC '19: Proceedings of the 18th ACM International Conference on Interaction Design and ChildrenThis paper explores how parents identify and use science and math media to engage their preschool children in informal science and math learning. Through an interview study, we examine parental beliefs about media's role in their preschool-aged children'...
Persuasive design-related motivators, ability factors and prompts in early childhood apps: A content analysis
AbstractDespite the increasing rates of early childhood smartphone and tablet use and the possible link to engagement-promoting persuasive digital environment design, there has been limited research examining persuasive design features in ...
Highlights- Persuasive design in apps attempt to motivate, facilitate ability and prompt child users.
Comments