Oussama Metatla
Nick Bryan-Kinns
ABSTRACT
Graphical displays are a typical means for conveying awareness information in groupware systems to help users track joint activities, but are not ideal when vision is constrained. Understanding how people maintain awareness through non-visual means is crucial for designing effective alternatives for supporting awareness in such situations. We present a lab study simulating an extreme scenario where 32 pairs of participants use an audio-only tool to edit shared audio menus. Our aim is to characterise collaboration in this audio-only space in order to identify whether and how, by itself, audio can mediate collaboration. Our findings show that the means for audio delivery and choice of working styles in this space influence types and patterns of awareness information exchange. We thus highlight the need to accommodate different working styles when designing audio support for awareness, and extend previous research by identifying types of awareness information to convey in response to group work dynamics.
Supplemental Material
Available for Download
- Dix Alan. 2010. Human-computer interaction: A stable discipline, a nascent science, and the growth of the long tail. Interacting with Computers 22 (2010), 13--27. Google Scholar
Digital Library
- Dix Alan, Finlay Janet, Abowd Gregory, and Beale Russell. 2004. Human-computer interaction. England: Pearson Education Limited 5 (2004).Google Scholar
- Ronald M Baecker, Dimitrios Nastos, Ilona R Posner, and Kelly L Mawby. 1995. The user-centred iterative design of collaborative writing software. In Human-computer interaction. Morgan Kaufmann Publishers Inc., 775--782. Google ScholarDigital Library
- Tina Blaine and Tim Perkis. 2000. The Jam-O-Drum interactive music system: a study in interaction design. In Proceedings of the 3rd conference on Designing interactive systems: processes, practices, methods, and techniques. ACM, 165--173. Google ScholarDigital Library
- Meera M Blattner, Denise A Sumikawa, and Robert M Greenberg. 1989. Earcons and icons: Their structure and common design principles. Human-Computer Interaction 4, 1 (1989), 11--44. Google ScholarDigital Library
- Sara A Bly, Steven P Frysinger, David Lunney, Douglass L Mansur, Joseph J Mezrich, Robert C Morrison, and William Buxton. 1985. Communicating with sound (panel session. In ACM SIGCHI Bulletin, Vol. 16. ACM, 115--119. Google ScholarDigital Library
- Sara A Bly, Steve R Harrison, and Susan Irwin. 1993. Media spaces: bringing people together in a video, audio, and computing environment. Commun. ACM 36, 1 (1993), 28--46. Google ScholarDigital Library
- A Boming and M Travers. 1991. Two approaches to casual interaction over computer and video networks. In International Conference on Human Factors in Computing Systems (CHI91). 13--19. Google ScholarDigital Library
- Stephen Brewster. 2002. Overcoming the lack of screen space on mobile computers. Personal and Ubiquitous Computing 6, 3 (2002), 188--205. Google ScholarDigital Library
- William Buxton. 1989. Introduction to this special issue on nonspeech audio. Human Computer Interaction 4, 1 (1989), 1--9.Google Scholar
- Herbert H Clark, Susan E Brennan, and others. 1991. Grounding in communication. Perspectives on socially shared cognition 13, 1991 (1991), 127--149.Google Scholar
- Herbert H Clark and Meredyth A Krych. 2004. Speaking while monitoring addressees for understanding. Journal of memory and language 50, 1 (2004), 62--81.Google ScholarCross Ref
- Jonathan Cohen. 1993. 'Kirk here": using genre sounds to monitor background activity. In INTERACT'93 and CHI'93 Conference Companion on Human Factors in Computing Systems. ACM, 63--64. Google ScholarDigital Library
- Gwyneth Doherty-Sneddon, Anne Anderson, Claire O'malley, Steve Langton, Simon Garrod, and Vicki Bruce. 1997. Face-to-face and video-mediated communication: A comparison of dialogue structure and task performance. Journal of experimental psychology applied 3 (1997), 105--125.Google ScholarCross Ref
- Paul Dourish and Victoria Bellotti. 1992. Awareness and coordination in shared workspaces. In Proceedings of the 1992 ACM conference on Computer-supported cooperative work. ACM, 107--114. Google ScholarDigital Library
- Daniel J Finnegan, Eamonn O'Neill, and Michael J Proulx. 2016. Compensating for Distance Compression in Audiovisual Virtual Environments Using Incongruence. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 200--212. Google ScholarDigital Library
- Robert S Fish, Robert E Kraut, and Barbara L Chalfonte. 1990. The VideoWindow system in informal communication. In Proceedings of the 1990 ACM conference on Computer-supported cooperative work. ACM, 1--11. Google ScholarDigital Library
- Asbjørn Følstad and Petter Bae Brandtzæg. 2017. Chatbots and the new world of HCI. interactions 24, 4 (2017), 38--42. Google ScholarDigital Library
- Christopher Frauenberger, Tony Stockman, and Marie-Luce Bourguet. 2007. A survey on common practice in designing audio in the user interface. In Proceedings of the 21st British HCI Group Annual Conference on People and Computers: HCI... but not as we know it-Volume 1. British Computer Society, 187--194. Google ScholarDigital Library
- William W Gaver. 1986. Auditory icons: Using sound in computer interfaces. Human-computer interaction 2, 2 (1986), 167--177. Google ScholarDigital Library
- William W Gaver. 1991. Sound support for collaboration. In Proceedings of the Second European Conference on Computer-Supported Cooperative Work ECSCW'91. Springer, 293--308. Google ScholarCross Ref
- William W Gaver. 1992. The affordances of media spaces for collaboration. In Proceedings of the 1992 ACM conference on Computer-supported cooperative work. ACM, 17--24. Google ScholarDigital Library
- William W Gaver, Randall B Smith, and Tim O'Shea. 1991. Effective sounds in complex systems: The ARKola simulation. In Proceedings of the SIGCHI Conference on Human factors in Computing Systems. ACM, 85--90. Google ScholarDigital Library
- Darren Gergle, Robert E Kraut, and Susan R Fussell. 2004. Action as language in a shared visual space. In Proceedings of the 2004 ACM conference on Computer supported cooperative work. ACM, 487--496. Google ScholarDigital Library
- Tom Gross. 2013. Supporting effortless coordination: 25 years of awareness research. Computer Supported Cooperative Work (CSCW) 22, 4--6 (2013), 425--474. Google ScholarDigital Library
- Carl Gutwin and Saul Greenberg. 2002. A descriptive framework of workspace awareness for real-time groupware. Computer Supported Cooperative Work (CSCW) 11, 3--4 (2002), 411--446. Google ScholarDigital Library
- Carl Gutwin, Oliver Schneider, Robert Xiao, and Stephen Brewster. 2011. Chalk sounds: the effects of dynamic synthesized audio on workspace awareness in distributed groupware. In Proceedings of the ACM 2011 conference on Computer supported cooperative work. ACM, 85--94. Google ScholarDigital Library
- Mark S Hancock, Chia Shen, Clifton Forlines, and Kathy Ryall. 2005. Exploring non-speech auditory feedback at an interactive multi-user tabletop. In Proceedings of Graphics Interface 2005. Canadian Human-Computer Communications Society, 41--50. Google ScholarDigital Library
- Christian Heath and Paul Luff. 1992. Collaboration and control Crisis management and multimedia technology in London Underground Line Control Rooms. Computer Supported Cooperative Work (CSCW) 1, 1 (1992), 69--94.Google ScholarCross Ref
- Debby Hindus, Mark S Ackerman, Scott Mainwaring, and Brian Starr. 1996. Thunderwire: a field study of an audio-only media space. In Proceedings of the 1996 ACM conference on Computer supported cooperative work. ACM, 238--247. Google ScholarDigital Library
- Ying Ying Huang, Jonas Moll, Eva-Lotta Sallnäs, and Yngve Sundblad. 2012. Auditory feedback in haptic collaborative interfaces. International journal of human-computer studies 70, 4 (2012), 257--270. Google ScholarDigital Library
- Hiroshi Ishii, Minoru Kobayashi, and Jonathan Grudin. 1993. Integration of interpersonal space and shared workspace: ClearBoard design and experiments. ACM Transactions on Information Systems (TOIS) 11, 4 (1993), 349--375. Google ScholarDigital Library
- Manuele Kirsch-Pinheiro, José Valdeni De Lima, and Marcos RS Borges. 2003. A framework for awareness support in groupware systems. Computers in Industry 52, 1 (2003), 47--57. Google ScholarDigital Library
- Gregory Kramer. 1994. An introduction to auditory display. In Auditory Display: Sonification, Audification and Auditory Interfaces, SFI Studies in the Sciences of Complexity, Proceedings. Addison-Wesley, 1--77.Google Scholar
- Jiannan Li, Saul Greenberg, and Ehud Sharlin. 2014. Enhancing Workspace Awareness on Collaborative Transparent Displays. (2014), Research report 2014--1065--16.Google Scholar
- Jack M Loomis, Reginald G Golledge, and Roberta L Klatzky. 2006. Navigation system for the blind: Auditory display modes and guidance. Navigation 7, 2 (2006).Google Scholar
- Paul Luff, Hideaki Kuzuoka, Christian Heath, Keiichi Yamazaki, and Jun Yamashita. 2009. Creating assemblies in media space: Recent developments in enhancing access to workspaces. In Media Space 20+ Years of Mediated Life. Springer, 27--55.Google Scholar
- David McGookin and Stephen Brewster. 2007. An initial investigation into non-visual computer supported collaboration. In CHI'07 Extended Abstracts on Human Factors in Computing Systems. ACM, 2573--2578. Google ScholarDigital Library
- Oussama Metatla, Nick Bryan-Kinns, and Tony Stockman. 2008. Constructing relational diagrams in audio: the multiple perspective hierarchical approach. In Proceedings of the 10th international ACM SIGACCESS conference on Computers and accessibility. ACM, 97--104. Google ScholarDigital Library
- Oussama Metatla, Nick Bryan-Kinns, and Tony Stockman. 2012. Interactive hierarchy-based auditory displays for accessing and manipulating relational diagrams. Journal on Multimodal User Interfaces 5, 3--4 (2012), 111--122.Google ScholarCross Ref
- Oussama Metatla, Nuno N Correia, Fiore Martin, Nick Bryan-Kinns, and Tony Stockman. 2016a. Tap the ShapeTones: Exploring the Effects of Crossmodal Congruence in an Audio-Visual Interface. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 1055--1066. Google ScholarDigital Library
- Oussama Metatla, Fiore Martin, Adam Parkinson, Nick Bryan-Kinns, Tony Stockman, and Atau Tanaka. 2016b. Audio-haptic interfaces for digital audio workstations. Journal on Multimodal User Interfaces 10, 3 (2016), 247--258.Google ScholarCross Ref
- Pascal Molli, Hala Skaf-Molli, and Christophe Bouthier. 2001. State treemap: an awareness widget for multi-synchronous groupware. In Groupware, 2001. Proceedings. Seventh International Workshop on. IEEE, 106--114. Google ScholarDigital Library
- Meredith Ringel Morris, Dan Morris, and Terry Winograd. 2004. Individual audio channels with single display groupware: effects on communication and task strategy. In Proceedings of the 2004 ACM conference on Computer supported cooperative work. ACM, 242--251. Google ScholarDigital Library
- Elizabeth D Mynatt. 1994. Designing with auditory icons: how well do we identify auditory cues?. In Conference companion on Human factors in computing systems. ACM, 269--270. Google ScholarDigital Library
- Michael A Nees and Bruce N Walker. 2011. Auditory displays for in-vehicle technologies. Reviews of human factors and ergonomics 7, 1 (2011), 58--99.Google Scholar
- Donald A Norman. 1993. Things that make us smart: Defending human attributes in the age of the machine. Basic Books. Google ScholarDigital Library
- Daniele Pagani and Wendy E Mackay. 1993. Bringing Media Spaces into the Real World.. In ECSCW. 347. Google ScholarDigital Library
- Michael J Proulx. 2007. Bottom-up guidance in visual search for conjunctions. Journal of Experimental Psychology: Human Perception and Performance 33, 1 (2007), 48.Google ScholarCross Ref
- Rameshsharma Ramloll and Stephen Brewster. 2002. An environment for studying the impact of spatialising sonified graphs on data comprehension. In Information Visualisation, 2002. Proceedings. Sixth International Conference on. IEEE, 167--174.Google ScholarCross Ref
- Markus Rittenbruch. 2002. Atmosphere: a framework for contextual awareness. International Journal of Human-Computer Interaction 14, 2 (2002), 159--180.Google ScholarCross Ref
- Charles Spence and Jon Driver. 1997. Audiovisual links in exogenous covert spatial orienting. Attention, Perception,&Psychophysics 59, 1 (1997), 1--22.Google Scholar
- R Stults. 1986. Media space (Technical Report). Palo Alto, CA: Xerox Palo Alto Research Center (1986).Google Scholar
- Barry Truax. 2001. Acoustic communication. Vol. 1. Greenwood Publishing Group.Google Scholar
- David D Woods. 1995. The alarm problem and directed attention in dynamic fault management. Ergonomics 38, 11 (1995), 2371--2393.Google ScholarCross Ref
- Jiajie Zhang. 1991. The interaction of internal and external representations in a problem solving task. In Proceedings of the thirteenth annual conference of cognitive science society, Vol. 88. Erlbaum Hillsdale, NJ, 91.Google Scholar
- Shengdong Zhao, Pierre Dragicevic, Mark Chignell, Ravin Balakrishnan, and Patrick Baudisch. 2007. Earpod: eyes-free menu selection using touch input and reactive audio feedback. In Proceedings of the SIGCHI conference on Human factors in computing systems. ACM, 1395--1404. Google ScholarDigital Library
Index Terms
- “I Hear You”: Understanding Awareness Information Exchange in an Audio-only Workspace
Recommendations
Collaboard: a remote collaboration groupware device featuring an embodiment-enriched shared workspace
GROUP '10: Proceedings of the 2010 ACM International Conference on Supporting Group WorkIn this paper we present a mixed presence groupware device called "CollaBoard". The device improves collaboration between co-located and remote partners by providing a high level of workspace awareness. This is achieved by superimposing a life-size ...
A Descriptive Framework of Workspace Awareness for Real-Time Groupware
Supporting awareness of others is an idea that holds promise for improving the usability of real-time distributed groupware. However, there is little principled information available about awareness that can be used by groupware designers. In this ...
Lark: Coordinating Co-located Collaboration with Information Visualization
Large multi-touch displays are expanding the possibilities of multiple-coordinated views by allowing multiple people to interact with data in concert or independently. We present Lark, a system that facilitates the coordination of interactions with ...
Comments