Skip to main content
Top
Published in: Journal on Multimodal User Interfaces 2/2018

13-11-2017 | Original Paper

Studying gesture-based interaction on a mobile augmented reality application for co-design activity

Author: Leman Figen Gül

Published in: Journal on Multimodal User Interfaces | Issue 2/2018

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Multi-touch user interfaces (MTUIs) of mobile devices can represent a valuable tool for enhancing co-design practice. In particular, mobile augmented reality (AR) technology that enhanced with MTUIs can offer new possibilities to designers to work and collaborate. This paper describes a series of user studies that took place in the Department of Architecture, at the Istanbul Technical University in January 2016. The users tested the developed AR application. The task of the participants was to design mass volumes of buildings in the given contexts. In the first study, the designer worked solo using analogue tools and two different MTUIs of the AR applications. In the second study, the designers collaborated using analogue tools and an enhanced mobile augmented reality environment. The goal of the study is to understand the affordances of the interfaces and the changes onto designers’ behaviour when they are using the mobile AR applications. The particular focus of the paper is on the characterization of the co-design cognition and interaction behaviour of the designers. The collected data from the empirical studies is analysed with the protocol analysis method using a coding scheme. The results show that the studied AR interfaces afford different modelling actions and design behaviour. The design context was broad conceptual and high-level; the intensity of the actions was also different in the AR sessions. We consider that this knowledge would be informative for the development of the innovative augmented reality applications for supporting the design activity and be guidance for the further developments.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Azuma RT (1997) A survey of augmented reality. Presence Tele-oper Virtual Environ 6(4):355–385CrossRef Azuma RT (1997) A survey of augmented reality. Presence Tele-oper Virtual Environ 6(4):355–385CrossRef
2.
go back to reference Kim M, Maher ML (2005) Comparison of designers using a tangible user interface & graphical user interface and impact on spatial cognition. Proc Human Behav Des 5:14 Kim M, Maher ML (2005) Comparison of designers using a tangible user interface & graphical user interface and impact on spatial cognition. Proc Human Behav Des 5:14
3.
go back to reference Ko CH, Chang TC (2011) Evaluation and student perception of augmented reality based design collaboration. Management 6(6):6 Ko CH, Chang TC (2011) Evaluation and student perception of augmented reality based design collaboration. Management 6(6):6
4.
go back to reference Visser W, Maher ML (2011) The role of gesture in designing. Artif Intell Eng Des Anal Manuf 25:213–220CrossRef Visser W, Maher ML (2011) The role of gesture in designing. Artif Intell Eng Des Anal Manuf 25:213–220CrossRef
5.
go back to reference Fiorella D, Sanna A, Lamberti F (2010) Multi-touch user interface evaluation for 3D object manipulation on mobile devices. J Multimodal User Interfaces 4:3–10CrossRef Fiorella D, Sanna A, Lamberti F (2010) Multi-touch user interface evaluation for 3D object manipulation on mobile devices. J Multimodal User Interfaces 4:3–10CrossRef
6.
go back to reference Gaver WW (1991) Technology affordances. In: Proceedings of the SIGCHI conference on Human factors in computing systems: reaching through technology. ACM Press, New Orleans, pp 79-84 Gaver WW (1991) Technology affordances. In: Proceedings of the SIGCHI conference on Human factors in computing systems: reaching through technology. ACM Press, New Orleans, pp 79-84
7.
go back to reference Ericsson KA, Simon HA (1993) Protocol analysis. MIT Press, Cambridge Ericsson KA, Simon HA (1993) Protocol analysis. MIT Press, Cambridge
8.
go back to reference Gabriel GC (2000) Computer mediated collaborative design in architecture: the effects of communication channels on collaborative design communication. Doctoral Dissertation, University of Sydney Gabriel GC (2000) Computer mediated collaborative design in architecture: the effects of communication channels on collaborative design communication. Doctoral Dissertation, University of Sydney
9.
go back to reference Gül LF (2007) Understanding collaborative design in different environments: comparing face to face sketching to remote sketching and 3D virtual worlds. Key Centre for Design Computing and Cognition. Doctoral Dissertation, University of Sydney Gül LF (2007) Understanding collaborative design in different environments: comparing face to face sketching to remote sketching and 3D virtual worlds. Key Centre for Design Computing and Cognition. Doctoral Dissertation, University of Sydney
10.
go back to reference Gül LF, Maher ML (2009) Co-creating external design representations: comparing face to face sketching to designing in virtual environments. Co-Design 5(2):117–138 Gül LF, Maher ML (2009) Co-creating external design representations: comparing face to face sketching to designing in virtual environments. Co-Design 5(2):117–138
11.
go back to reference Gibson J (1977) The theory of affordances. In: Shaw R, Bransford J (eds) Perceiving, acting and knowing: toward an ecological psychology. Erlbaum Associates, Hillsdale, NJ, pp 67–82 Gibson J (1977) The theory of affordances. In: Shaw R, Bransford J (eds) Perceiving, acting and knowing: toward an ecological psychology. Erlbaum Associates, Hillsdale, NJ, pp 67–82
12.
go back to reference Norman DA (1988) The psychology of everyday things. Basic Books, New York Norman DA (1988) The psychology of everyday things. Basic Books, New York
13.
go back to reference Bærentsen K, Trettvik J (2002) An activity theory approach to affordance. In: Proceedings of the second Nordi conference on Human-computer interaction. ACM Press, New York, pp 51–60 Bærentsen K, Trettvik J (2002) An activity theory approach to affordance. In: Proceedings of the second Nordi conference on Human-computer interaction. ACM Press, New York, pp 51–60
14.
go back to reference Vyas D, Chisalita CM, Veer GCV (2006) Affordance in interaction. In: Proceedings of the 13th European conference on Cognitive ergonomics: trust and control in complex socio-technical systems. ACM Press, Zurich, pp 92–99 Vyas D, Chisalita CM, Veer GCV (2006) Affordance in interaction. In: Proceedings of the 13th European conference on Cognitive ergonomics: trust and control in complex socio-technical systems. ACM Press, Zurich, pp 92–99
15.
go back to reference Gross DC (2004) Affordances in the design of virtual environments. University of Central Florida, Florida Gross DC (2004) Affordances in the design of virtual environments. University of Central Florida, Florida
16.
go back to reference Hans I, Hubers JC (2009) The COLAB project tested. In: Carrara G, Fioravanti A, Kalay YE (eds) Collaborative working environments for architectural design. Palombi Editori Hans I, Hubers JC (2009) The COLAB project tested. In: Carrara G, Fioravanti A, Kalay YE (eds) Collaborative working environments for architectural design. Palombi Editori
17.
go back to reference Wang J, Wang X, Shou W, Xu B (2014) Integrating BIM and augmented reality for interactive architectural visualization. Constr Innov 14(4):453–476CrossRef Wang J, Wang X, Shou W, Xu B (2014) Integrating BIM and augmented reality for interactive architectural visualization. Constr Innov 14(4):453–476CrossRef
18.
go back to reference Porter T, Neale J (2000) Architectural supermodels. Architectural Press, Oxford Porter T, Neale J (2000) Architectural supermodels. Architectural Press, Oxford
19.
go back to reference Kvan T, Thilakaratne R (2003) Models in the design conversation: architectural vs engineering. In: Newton et al. (eds) Proceedings of AASA conference. Association of Architecture Schools of Australia, Melbourne, ISSN:14491737 Kvan T, Thilakaratne R (2003) Models in the design conversation: architectural vs engineering. In: Newton et al. (eds) Proceedings of AASA conference. Association of Architecture Schools of Australia, Melbourne, ISSN:14491737
20.
go back to reference Achten H, Joosen G (2003) The digital design process-reflections on a single design case. In: Digital design, 21st eCAADe conference proceedings. Graz, pp 269–274 Achten H, Joosen G (2003) The digital design process-reflections on a single design case. In: Digital design, 21st eCAADe conference proceedings. Graz, pp 269–274
21.
go back to reference Seichter H (2003) Sketchand+ A collaborative augmented reality sketching application. In: Proceedings of the 8th international conference on computer aided architectural design research in Asia. Bangkok Seichter H (2003) Sketchand+ A collaborative augmented reality sketching application. In: Proceedings of the 8th international conference on computer aided architectural design research in Asia. Bangkok
22.
go back to reference Yee B, Ning Y, Lipson H (2009) Augmented reality in-situ 3D sketching of physical objects. In: Intelligent UI workshop on sketch recognition Yee B, Ning Y, Lipson H (2009) Augmented reality in-situ 3D sketching of physical objects. In: Intelligent UI workshop on sketch recognition
23.
go back to reference Seichter H (2004) BenchWorks augmented reality urban design. In: Proceedings of the 9th international conference on computer aided architectural design research in Asia Seoul. Korea, pp 937–946 Seichter H (2004) BenchWorks augmented reality urban design. In: Proceedings of the 9th international conference on computer aided architectural design research in Asia Seoul. Korea, pp 937–946
24.
go back to reference Riera SA, Redondo E, Fonseca D (2014) Geo-located teaching using handheld augmented reality: good practices to improve the motivation and qualifications of architecture. Univers Access Inf Soc 14(3):363–374CrossRef Riera SA, Redondo E, Fonseca D (2014) Geo-located teaching using handheld augmented reality: good practices to improve the motivation and qualifications of architecture. Univers Access Inf Soc 14(3):363–374CrossRef
25.
go back to reference Janke R (1978) Architectural models. Academic Editions, London Janke R (1978) Architectural models. Academic Editions, London
26.
go back to reference Goldschmidt G (1988) Interpretation: its role in architectural design. Des Stud 9(4):235–245CrossRef Goldschmidt G (1988) Interpretation: its role in architectural design. Des Stud 9(4):235–245CrossRef
27.
go back to reference Schön DA (1985) The design studio: an exploration of its traditions and potentials. RIBA, London, pp 30–32 Schön DA (1985) The design studio: an exploration of its traditions and potentials. RIBA, London, pp 30–32
28.
go back to reference Ward T (1987) Design archetypes from group processes. Des Stud 8(3):157–169CrossRef Ward T (1987) Design archetypes from group processes. Des Stud 8(3):157–169CrossRef
29.
go back to reference Wagner D, Schmalstieg D (2007) Artoolkitplus for pose tracking on mobile devices. In: Proceedings of 12th computer vision winter workshop (CVWW’07). Sankt Lambrecht, pp 139–146 Wagner D, Schmalstieg D (2007) Artoolkitplus for pose tracking on mobile devices. In: Proceedings of 12th computer vision winter workshop (CVWW’07). Sankt Lambrecht, pp 139–146
30.
go back to reference Wagner D, Langlotz T, Schmalstieg D (2008) Robust und unobtrusive marker tracking on mobile phones. In: Proceedings of ISMAR’08, pp 121–124 Wagner D, Langlotz T, Schmalstieg D (2008) Robust und unobtrusive marker tracking on mobile phones. In: Proceedings of ISMAR’08, pp 121–124
32.
go back to reference Goldschmidt G (1995) The designer as a team of one. Des Stud 16(2):189–209CrossRef Goldschmidt G (1995) The designer as a team of one. Des Stud 16(2):189–209CrossRef
33.
go back to reference Gero JS, McNeill T (1998) An approach to the analysis of design protocols. Des Stud 19(1):21–61CrossRef Gero JS, McNeill T (1998) An approach to the analysis of design protocols. Des Stud 19(1):21–61CrossRef
34.
go back to reference Eastman CM (1968) Explorations of the cognitive processes in design. In: Department of computer science report. Carnegie Mellon University, Pittsburgh Eastman CM (1968) Explorations of the cognitive processes in design. In: Department of computer science report. Carnegie Mellon University, Pittsburgh
35.
go back to reference Cross N (2001) Design cognition: results from protocol and other empirical studies of design activity. In: Eastman C et al (eds) Design knowing and learning: cognition in design education. Elsevier, Amsterdam, pp 79–103CrossRef Cross N (2001) Design cognition: results from protocol and other empirical studies of design activity. In: Eastman C et al (eds) Design knowing and learning: cognition in design education. Elsevier, Amsterdam, pp 79–103CrossRef
36.
go back to reference Suwa M, Tversky B (1997) What do architects and students perceive in their design sketches? A protocol analysis. Des Stud 18(4):385–404CrossRef Suwa M, Tversky B (1997) What do architects and students perceive in their design sketches? A protocol analysis. Des Stud 18(4):385–404CrossRef
37.
go back to reference Schön DA (1984) Problems, frames and perspectives on designing. Des Stud 5(3):132–136CrossRef Schön DA (1984) Problems, frames and perspectives on designing. Des Stud 5(3):132–136CrossRef
38.
go back to reference Cross AC, Cross N (1996) Observations of teamwork and social processes in design. In: Cross N, Christiaans H, Dorst K (eds) Analyzing design activity. John Wiley & Sons Ltd, West Sussex, pp 91–317 Cross AC, Cross N (1996) Observations of teamwork and social processes in design. In: Cross N, Christiaans H, Dorst K (eds) Analyzing design activity. John Wiley & Sons Ltd, West Sussex, pp 91–317
39.
go back to reference Maher ML, Bilda Z, Gu N, Gül LF, Huang Y, Kim MJ, Maher ML, Marchant D, Namprempree K (2005) Collaborative processes: research report on use of virtual environment. The University of Sydney, Sydney Maher ML, Bilda Z, Gu N, Gül LF, Huang Y, Kim MJ, Maher ML, Marchant D, Namprempree K (2005) Collaborative processes: research report on use of virtual environment. The University of Sydney, Sydney
40.
go back to reference Asimow M (1962) Introduction to design. Prentice-Hall Inc, Englewood Cliffs Asimow M (1962) Introduction to design. Prentice-Hall Inc, Englewood Cliffs
42.
go back to reference Vera AH, Kvan T, West RL, Lai S (1998) Expertise, collaboration and bandwidth. In: CHI’98. ACM SIGCHI, Los Angeles, pp 502–510 Vera AH, Kvan T, West RL, Lai S (1998) Expertise, collaboration and bandwidth. In: CHI’98. ACM SIGCHI, Los Angeles, pp 502–510
43.
go back to reference Gül LF (2014) The impact of digital design representations on synchronous collaborative behavior. J Inf Technol Constr 19:47–71 Gül LF (2014) The impact of digital design representations on synchronous collaborative behavior. J Inf Technol Constr 19:47–71
Metadata
Title
Studying gesture-based interaction on a mobile augmented reality application for co-design activity
Author
Leman Figen Gül
Publication date
13-11-2017
Publisher
Springer International Publishing
Published in
Journal on Multimodal User Interfaces / Issue 2/2018
Print ISSN: 1783-7677
Electronic ISSN: 1783-8738
DOI
https://doi.org/10.1007/s12193-017-0252-0

Other articles of this Issue 2/2018

Journal on Multimodal User Interfaces 2/2018 Go to the issue

Premium Partner