Skip to main content
Top
Published in: International Journal on Interactive Design and Manufacturing (IJIDeM) 4/2020

28-08-2020 | Original Paper

Real-time coding method and tool for artefact-centric interaction analysis in co-design situations assisted by augmented reality

Authors: C. Masclet, M. Poulin, J. F. Boujut, N. Becattini

Published in: International Journal on Interactive Design and Manufacturing (IJIDeM) | Issue 4/2020

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This paper presents and discusses a fast and efficient method to study artefact-centric interactions in co-design sessions. The method is particularly useful for exploring the introduction of augmented reality (AR) environments since AR application representations combine both digital content and physical content, transforming the way users interact with the design object. Although protocol analysis is extensively used in cognitive studies of design, it is a time-consuming and cumbersome method and hence unsuitable for extensive analysis in industrial environments. Our real-time coding method makes it possible to perform “on-the-fly” coding of physical interactions in co-design sessions. Focusing on quantifying interaction occurrences, our results are consistent with those obtained with post-session coding. Internal validity was assessed using relevant statistical tests. Based on the data collected in co-design sessions we show how aggregate results, especially timelines and interaction densities, can be displayed rapidly at the end of each session. This research paves the way for a more general implementation of real-time coding of collaborative work sessions in industrial situations.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
These companies are part of the SPARK consortium. Artefice specialises in brand design while Stimulo designs innovative products.
 
Literature
1.
go back to reference Caridà, A., Melia, M., Colurcio, M.: Business model design and value co-creation: Looking for a new pattern. In: Russo-Spena, T., Mele, C., Nuutinen, M. (eds.) Innovating in Practice. Springer, Cham (2017) Caridà, A., Melia, M., Colurcio, M.: Business model design and value co-creation: Looking for a new pattern. In: Russo-Spena, T., Mele, C., Nuutinen, M. (eds.) Innovating in Practice. Springer, Cham (2017)
2.
go back to reference Ardito, C., Buono, P., Costabile, F., Lanzilotti, R., Piccinno, A.: End users as co-designers of their own tools and products. J. Vis. Lang. Comput. 23(2), 78–90 (2012)CrossRef Ardito, C., Buono, P., Costabile, F., Lanzilotti, R., Piccinno, A.: End users as co-designers of their own tools and products. J. Vis. Lang. Comput. 23(2), 78–90 (2012)CrossRef
3.
go back to reference Steiner, I. D.: Group Process and Productivity. New York, NY: Academic Press (1972) Cited by Kvan, T.: Collaborative design: what is it? Automation in Construction, vol. 9, pp. 409–415 (2000) Steiner, I. D.: Group Process and Productivity. New York, NY: Academic Press (1972) Cited by Kvan, T.: Collaborative design: what is it? Automation in Construction, vol. 9, pp. 409–415 (2000)
4.
go back to reference Verlinden, J., Horváth, I., Nam, T.-J.: Recording augmented reality experiences to capture design reviews. Int. J Interact. Des. Manuf. (IJIDeM) 3(3), 189–200 (2009)CrossRef Verlinden, J., Horváth, I., Nam, T.-J.: Recording augmented reality experiences to capture design reviews. Int. J Interact. Des. Manuf. (IJIDeM) 3(3), 189–200 (2009)CrossRef
5.
go back to reference Maurya, S., Arai, K., Moriya, K., Arrighi, P.A., Mougenot, C.: A mixed reality tool for end-users participation in early creative design tasks. Int. J. Interact. Des. Manuf. 13(1), 163–182 (2019)CrossRef Maurya, S., Arai, K., Moriya, K., Arrighi, P.A., Mougenot, C.: A mixed reality tool for end-users participation in early creative design tasks. Int. J. Interact. Des. Manuf. 13(1), 163–182 (2019)CrossRef
6.
go back to reference Schifferstein, H.N.J., Desmet, P.M.A.: Tools facilitating multi-sensory product design. Des. J. 11(2), 137–158 (2008) Schifferstein, H.N.J., Desmet, P.M.A.: Tools facilitating multi-sensory product design. Des. J. 11(2), 137–158 (2008)
7.
go back to reference Raskar, R., Welch, G., Fuchs, H.: Spatially augmented reality. In: Proceeding of the First IEEE Workshop on Augmented Reality; 1998 November 1; San Francisco, CA; pp. 63–72 (1998) Raskar, R., Welch, G., Fuchs, H.: Spatially augmented reality. In: Proceeding of the First IEEE Workshop on Augmented Reality; 1998 November 1; San Francisco, CA; pp. 63–72 (1998)
8.
go back to reference Park, M.K., Lim, K.J., Seo, M.K., Jung, S.J., Lee, K.H.: Spatial augmented reality for product appearance design evaluation. J. Comput. Des. Eng. 2(1), 38–46 (2015) Park, M.K., Lim, K.J., Seo, M.K., Jung, S.J., Lee, K.H.: Spatial augmented reality for product appearance design evaluation. J. Comput. Des. Eng. 2(1), 38–46 (2015)
9.
go back to reference Hannah, R., Joshi, S., Summers, J.D.: A user study of interpretability of engineering design representations. J. Eng. Des. 23, 443–468 (2012)CrossRef Hannah, R., Joshi, S., Summers, J.D.: A user study of interpretability of engineering design representations. J. Eng. Des. 23, 443–468 (2012)CrossRef
10.
go back to reference Ericsson, K.A., Simon, H.A.: Protocol Analysis: Verbal Reports as Data. MIT Press, Cambridge (1993)CrossRef Ericsson, K.A., Simon, H.A.: Protocol Analysis: Verbal Reports as Data. MIT Press, Cambridge (1993)CrossRef
11.
go back to reference Cross, N., Christiaans, H., Dorst, K. (eds.): Analysing Design Activity. Wiley, Chichester (1996) Cross, N., Christiaans, H., Dorst, K. (eds.): Analysing Design Activity. Wiley, Chichester (1996)
12.
go back to reference Mondada, L.: Video Recording as the Reflexive Preservation and Configuration of Phenomenal Features for Analysis. In: Knoblauch, H., Raab, J., Soeffner, H.-G., Schnettler, B. (eds.) Video Analysis. Lang, Bern (2006) Mondada, L.: Video Recording as the Reflexive Preservation and Configuration of Phenomenal Features for Analysis. In: Knoblauch, H., Raab, J., Soeffner, H.-G., Schnettler, B. (eds.) Video Analysis. Lang, Bern (2006)
13.
go back to reference Eastman, C.M.: Cognitive processes and ill-defined problems: a case study from design. In: Proceedings of the First Joint International Conference on Artificial Intelligence. Bedford, MA: MITRE (1969) Eastman, C.M.: Cognitive processes and ill-defined problems: a case study from design. In: Proceedings of the First Joint International Conference on Artificial Intelligence. Bedford, MA: MITRE (1969)
14.
go back to reference Visser, W.: Use of episodic knowledge and information in design problem solving. Design Studies, Elsevier, 1995, Analysing Design Activity, 16(2), 171–187 (1995) Visser, W.: Use of episodic knowledge and information in design problem solving. Design Studies, Elsevier, 1995, Analysing Design Activity, 16(2), 171–187 (1995)
15.
go back to reference Lloyd, P.: Can concurrent verbalization reveal design cognition? Des. Stud. 16, 237–259 (1995)CrossRef Lloyd, P.: Can concurrent verbalization reveal design cognition? Des. Stud. 16, 237–259 (1995)CrossRef
16.
go back to reference Jaspers, M.W.M., Steen, T., Bos, C., Geenen, M.: The think aloud method: a guide to user interface design. Int. J. Med. Inform. 73(11–12), 781–795 (2004)CrossRef Jaspers, M.W.M., Steen, T., Bos, C., Geenen, M.: The think aloud method: a guide to user interface design. Int. J. Med. Inform. 73(11–12), 781–795 (2004)CrossRef
17.
go back to reference Hay, L., Duffy, A. H. B., McTeague C., Pidgeon L. M., Vuletic T., Grealy, M.: A systematic review of protocol studies on conceptual design cognition: design as search and exploration. Des. Sci. 3 (2017) Hay, L., Duffy, A. H. B., McTeague C., Pidgeon L. M., Vuletic T., Grealy, M.: A systematic review of protocol studies on conceptual design cognition: design as search and exploration. Des. Sci. 3 (2017)
18.
go back to reference Gero, J.: Design prototypes: a knowledge representation schema for design. Artif. Intell. Mag. 11(4), 26 (1990) Gero, J.: Design prototypes: a knowledge representation schema for design. Artif. Intell. Mag. 11(4), 26 (1990)
19.
go back to reference Purcell, A.T., Gero, J.S., Edwards, H., Matka, E.: Design fixation and intelligent design assistants. In: Gero, J.S., Sudweeks, F. (eds.) Artificial Intelligence in Design ‘94, pp. 483–496. Kluwer, Dordrecht (1994)CrossRef Purcell, A.T., Gero, J.S., Edwards, H., Matka, E.: Design fixation and intelligent design assistants. In: Gero, J.S., Sudweeks, F. (eds.) Artificial Intelligence in Design ‘94, pp. 483–496. Kluwer, Dordrecht (1994)CrossRef
20.
go back to reference Amhed, S., Hansen, C.T.: A decision making model for engineering designers. In: Sahin, T.M.M. (ed) Computer based design, EDC2002, Cambridge, pp. 217–227 (2002) Amhed, S., Hansen, C.T.: A decision making model for engineering designers. In: Sahin, T.M.M. (ed) Computer based design, EDC2002, Cambridge, pp. 217–227 (2002)
21.
go back to reference Girod, M., Elliot, A.C., Wright, I.C., Burns, N.D.: Decision making in conceptual engineering design: an empirical investigation. Proc. Inst. Mech. Eng. Part B J. Eng. Manuf. 217(9), 1215–1228 (2003)CrossRef Girod, M., Elliot, A.C., Wright, I.C., Burns, N.D.: Decision making in conceptual engineering design: an empirical investigation. Proc. Inst. Mech. Eng. Part B J. Eng. Manuf. 217(9), 1215–1228 (2003)CrossRef
22.
go back to reference Tang, J.C., Leifer, L.J.: A framework for understanding the workspace activity of design teams. In: Proceedings of ACM Conference on Computer-supported cooperative work: ACM (1988) Tang, J.C., Leifer, L.J.: A framework for understanding the workspace activity of design teams. In: Proceedings of ACM Conference on Computer-supported cooperative work: ACM (1988)
23.
go back to reference Radcliffe, D.F., Lee, T.Y.: Design methods used by undergraduate engineering students. Des. Stud. 10(4), 199–207 (1989)CrossRef Radcliffe, D.F., Lee, T.Y.: Design methods used by undergraduate engineering students. Des. Stud. 10(4), 199–207 (1989)CrossRef
24.
go back to reference Olson, G.M., Olson, J.S.: Small group design meetings: an analysis of collaboration. Human–Comput. Interact. 7, 347–374 (1992)CrossRef Olson, G.M., Olson, J.S.: Small group design meetings: an analysis of collaboration. Human–Comput. Interact. 7, 347–374 (1992)CrossRef
25.
go back to reference Cross, N., Cross, A.C.: Observations of teamwork and social processes in design. Des. Stud. 16, 145–170 (1995) Cross, N., Cross, A.C.: Observations of teamwork and social processes in design. Des. Stud. 16, 145–170 (1995)
26.
go back to reference Wiltschnig, S., Christensen, B.T., Ball, L.J.: Collaborative problem-solution co-evolution in creative design. Des. Stud. 34(2013), 515–545 (2013)CrossRef Wiltschnig, S., Christensen, B.T., Ball, L.J.: Collaborative problem-solution co-evolution in creative design. Des. Stud. 34(2013), 515–545 (2013)CrossRef
27.
go back to reference Waldron, M.B., Waldron, K.J.: Methods of studying mechanical design. In: Waldron, M.B., Waldron, K.J. (eds.) Mechanical Design: Theory and Methodology, pp. 21–34. Springer, New York (1996)MATHCrossRef Waldron, M.B., Waldron, K.J.: Methods of studying mechanical design. In: Waldron, M.B., Waldron, K.J. (eds.) Mechanical Design: Theory and Methodology, pp. 21–34. Springer, New York (1996)MATHCrossRef
28.
go back to reference Jiang, H. & Yen, C.-C.: Protocol analysis in design research: a review. In: Rigor and Relevance in Design: IASDR 2009, Seoul, Korea October 18–22, Seoul, pp. 147–156. International Association of Societies of Design Research (2009) Jiang, H. & Yen, C.-C.: Protocol analysis in design research: a review. In: Rigor and Relevance in Design: IASDR 2009, Seoul, Korea October 18–22, Seoul, pp. 147–156. International Association of Societies of Design Research (2009)
29.
go back to reference Perry, M.: Coordinating joint design work: the role of communication and artefacts. Des. Stud. 19(3), 273–288 (1998)MathSciNetCrossRef Perry, M.: Coordinating joint design work: the role of communication and artefacts. Des. Stud. 19(3), 273–288 (1998)MathSciNetCrossRef
30.
go back to reference Visser, W.: Function and Form of Gestures in a Collaborative Design Meeting. In: Kopp, S., Wachsmuth, I. (eds.) Gesture in Embodied Communication and Human–Computer Interaction, vol. 5934, pp. 61–72. Springer, Berlin (2010)CrossRef Visser, W.: Function and Form of Gestures in a Collaborative Design Meeting. In: Kopp, S., Wachsmuth, I. (eds.) Gesture in Embodied Communication and Human–Computer Interaction, vol. 5934, pp. 61–72. Springer, Berlin (2010)CrossRef
31.
go back to reference Härkki, T., Seitamaa-Hakkarainen, P., Hakkarainen, K.: Hands on design: comparing the use of sketching and gesturing in collaborative designing. J. Des. Res. 16(1), 24–46 (2018) Härkki, T., Seitamaa-Hakkarainen, P., Hakkarainen, K.: Hands on design: comparing the use of sketching and gesturing in collaborative designing. J. Des. Res. 16(1), 24–46 (2018)
32.
go back to reference Eris, O., Martelaro, N.: Badke-Schaube, P: a comparative analysis of multimodal communication during design sketching in co-located and distributed environments. Des. Stud. 35, 559–592 (2014)CrossRef Eris, O., Martelaro, N.: Badke-Schaube, P: a comparative analysis of multimodal communication during design sketching in co-located and distributed environments. Des. Stud. 35, 559–592 (2014)CrossRef
33.
go back to reference McNeill, D.: Hand and Mind: What Gestures Reveal About Thought. University of Chicago Press, Chicago (1992) McNeill, D.: Hand and Mind: What Gestures Reveal About Thought. University of Chicago Press, Chicago (1992)
34.
go back to reference Kang, S., Tversky, B., Black, J.B.: Coordinating gesture, word, and diagram: explanations for experts and novices. Spat. Cognit. Comput. 15, 1–26 (2015)CrossRef Kang, S., Tversky, B., Black, J.B.: Coordinating gesture, word, and diagram: explanations for experts and novices. Spat. Cognit. Comput. 15, 1–26 (2015)CrossRef
35.
go back to reference Jeantet, A.: Les objets intermédiaires dans les processus de conception des produits. Sociologie du travail 3, 291–316 (1998)CrossRef Jeantet, A.: Les objets intermédiaires dans les processus de conception des produits. Sociologie du travail 3, 291–316 (1998)CrossRef
36.
go back to reference Vinck, D.: Taking intermediary objects and equipping work into account in the study of engineering practices. Eng. Stud. 3(1), 25–44 (2011)CrossRef Vinck, D.: Taking intermediary objects and equipping work into account in the study of engineering practices. Eng. Stud. 3(1), 25–44 (2011)CrossRef
37.
go back to reference Boujut, J.F., Blanco, E.: Intermediary objects as a means to foster co-operation in engineering design. Comput. Support. Coop. Work 12, 205–219 (2003)CrossRef Boujut, J.F., Blanco, E.: Intermediary objects as a means to foster co-operation in engineering design. Comput. Support. Coop. Work 12, 205–219 (2003)CrossRef
38.
go back to reference Becattini, N., Masclet, C., Ben-Guefrache, F., Prudhomme, G., Cascini, G., Dekoninck, E.: Characterisation of a co-creative design session through the analysis of multi-modal interactions. In: Proceeding of the International Conference on Engineering Design ICED2017, pp. 479–488 (2017) Becattini, N., Masclet, C., Ben-Guefrache, F., Prudhomme, G., Cascini, G., Dekoninck, E.: Characterisation of a co-creative design session through the analysis of multi-modal interactions. In: Proceeding of the International Conference on Engineering Design ICED2017, pp. 479–488 (2017)
39.
go back to reference Ahmed, S., Wallace, K.M., Blessing, L.T.: Understanding the differences between how novice and experienced designers approach design tasks. Res. Eng. Des. 14(1), 1–11 (2003)CrossRef Ahmed, S., Wallace, K.M., Blessing, L.T.: Understanding the differences between how novice and experienced designers approach design tasks. Res. Eng. Des. 14(1), 1–11 (2003)CrossRef
40.
go back to reference Dorst, K.: Analysing design activity: new directions in protocol analysis. Des. Stud. 16(2), 139–142 (1995)CrossRef Dorst, K.: Analysing design activity: new directions in protocol analysis. Des. Stud. 16(2), 139–142 (1995)CrossRef
41.
Metadata
Title
Real-time coding method and tool for artefact-centric interaction analysis in co-design situations assisted by augmented reality
Authors
C. Masclet
M. Poulin
J. F. Boujut
N. Becattini
Publication date
28-08-2020
Publisher
Springer Paris
Published in
International Journal on Interactive Design and Manufacturing (IJIDeM) / Issue 4/2020
Print ISSN: 1955-2513
Electronic ISSN: 1955-2505
DOI
https://doi.org/10.1007/s12008-020-00683-8

Other articles of this Issue 4/2020

International Journal on Interactive Design and Manufacturing (IJIDeM) 4/2020 Go to the issue

Premium Partner