Skip to main content
Erschienen in: International Journal on Interactive Design and Manufacturing (IJIDeM) 4/2020

28.08.2020 | Original Paper

Real-time coding method and tool for artefact-centric interaction analysis in co-design situations assisted by augmented reality

verfasst von: C. Masclet, M. Poulin, J. F. Boujut, N. Becattini

Erschienen in: International Journal on Interactive Design and Manufacturing (IJIDeM) | Ausgabe 4/2020

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper presents and discusses a fast and efficient method to study artefact-centric interactions in co-design sessions. The method is particularly useful for exploring the introduction of augmented reality (AR) environments since AR application representations combine both digital content and physical content, transforming the way users interact with the design object. Although protocol analysis is extensively used in cognitive studies of design, it is a time-consuming and cumbersome method and hence unsuitable for extensive analysis in industrial environments. Our real-time coding method makes it possible to perform “on-the-fly” coding of physical interactions in co-design sessions. Focusing on quantifying interaction occurrences, our results are consistent with those obtained with post-session coding. Internal validity was assessed using relevant statistical tests. Based on the data collected in co-design sessions we show how aggregate results, especially timelines and interaction densities, can be displayed rapidly at the end of each session. This research paves the way for a more general implementation of real-time coding of collaborative work sessions in industrial situations.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
These companies are part of the SPARK consortium. Artefice specialises in brand design while Stimulo designs innovative products.
 
Literatur
1.
Zurück zum Zitat Caridà, A., Melia, M., Colurcio, M.: Business model design and value co-creation: Looking for a new pattern. In: Russo-Spena, T., Mele, C., Nuutinen, M. (eds.) Innovating in Practice. Springer, Cham (2017) Caridà, A., Melia, M., Colurcio, M.: Business model design and value co-creation: Looking for a new pattern. In: Russo-Spena, T., Mele, C., Nuutinen, M. (eds.) Innovating in Practice. Springer, Cham (2017)
2.
Zurück zum Zitat Ardito, C., Buono, P., Costabile, F., Lanzilotti, R., Piccinno, A.: End users as co-designers of their own tools and products. J. Vis. Lang. Comput. 23(2), 78–90 (2012)CrossRef Ardito, C., Buono, P., Costabile, F., Lanzilotti, R., Piccinno, A.: End users as co-designers of their own tools and products. J. Vis. Lang. Comput. 23(2), 78–90 (2012)CrossRef
3.
Zurück zum Zitat Steiner, I. D.: Group Process and Productivity. New York, NY: Academic Press (1972) Cited by Kvan, T.: Collaborative design: what is it? Automation in Construction, vol. 9, pp. 409–415 (2000) Steiner, I. D.: Group Process and Productivity. New York, NY: Academic Press (1972) Cited by Kvan, T.: Collaborative design: what is it? Automation in Construction, vol. 9, pp. 409–415 (2000)
4.
Zurück zum Zitat Verlinden, J., Horváth, I., Nam, T.-J.: Recording augmented reality experiences to capture design reviews. Int. J Interact. Des. Manuf. (IJIDeM) 3(3), 189–200 (2009)CrossRef Verlinden, J., Horváth, I., Nam, T.-J.: Recording augmented reality experiences to capture design reviews. Int. J Interact. Des. Manuf. (IJIDeM) 3(3), 189–200 (2009)CrossRef
5.
Zurück zum Zitat Maurya, S., Arai, K., Moriya, K., Arrighi, P.A., Mougenot, C.: A mixed reality tool for end-users participation in early creative design tasks. Int. J. Interact. Des. Manuf. 13(1), 163–182 (2019)CrossRef Maurya, S., Arai, K., Moriya, K., Arrighi, P.A., Mougenot, C.: A mixed reality tool for end-users participation in early creative design tasks. Int. J. Interact. Des. Manuf. 13(1), 163–182 (2019)CrossRef
6.
Zurück zum Zitat Schifferstein, H.N.J., Desmet, P.M.A.: Tools facilitating multi-sensory product design. Des. J. 11(2), 137–158 (2008) Schifferstein, H.N.J., Desmet, P.M.A.: Tools facilitating multi-sensory product design. Des. J. 11(2), 137–158 (2008)
7.
Zurück zum Zitat Raskar, R., Welch, G., Fuchs, H.: Spatially augmented reality. In: Proceeding of the First IEEE Workshop on Augmented Reality; 1998 November 1; San Francisco, CA; pp. 63–72 (1998) Raskar, R., Welch, G., Fuchs, H.: Spatially augmented reality. In: Proceeding of the First IEEE Workshop on Augmented Reality; 1998 November 1; San Francisco, CA; pp. 63–72 (1998)
8.
Zurück zum Zitat Park, M.K., Lim, K.J., Seo, M.K., Jung, S.J., Lee, K.H.: Spatial augmented reality for product appearance design evaluation. J. Comput. Des. Eng. 2(1), 38–46 (2015) Park, M.K., Lim, K.J., Seo, M.K., Jung, S.J., Lee, K.H.: Spatial augmented reality for product appearance design evaluation. J. Comput. Des. Eng. 2(1), 38–46 (2015)
9.
Zurück zum Zitat Hannah, R., Joshi, S., Summers, J.D.: A user study of interpretability of engineering design representations. J. Eng. Des. 23, 443–468 (2012)CrossRef Hannah, R., Joshi, S., Summers, J.D.: A user study of interpretability of engineering design representations. J. Eng. Des. 23, 443–468 (2012)CrossRef
10.
Zurück zum Zitat Ericsson, K.A., Simon, H.A.: Protocol Analysis: Verbal Reports as Data. MIT Press, Cambridge (1993)CrossRef Ericsson, K.A., Simon, H.A.: Protocol Analysis: Verbal Reports as Data. MIT Press, Cambridge (1993)CrossRef
11.
Zurück zum Zitat Cross, N., Christiaans, H., Dorst, K. (eds.): Analysing Design Activity. Wiley, Chichester (1996) Cross, N., Christiaans, H., Dorst, K. (eds.): Analysing Design Activity. Wiley, Chichester (1996)
12.
Zurück zum Zitat Mondada, L.: Video Recording as the Reflexive Preservation and Configuration of Phenomenal Features for Analysis. In: Knoblauch, H., Raab, J., Soeffner, H.-G., Schnettler, B. (eds.) Video Analysis. Lang, Bern (2006) Mondada, L.: Video Recording as the Reflexive Preservation and Configuration of Phenomenal Features for Analysis. In: Knoblauch, H., Raab, J., Soeffner, H.-G., Schnettler, B. (eds.) Video Analysis. Lang, Bern (2006)
13.
Zurück zum Zitat Eastman, C.M.: Cognitive processes and ill-defined problems: a case study from design. In: Proceedings of the First Joint International Conference on Artificial Intelligence. Bedford, MA: MITRE (1969) Eastman, C.M.: Cognitive processes and ill-defined problems: a case study from design. In: Proceedings of the First Joint International Conference on Artificial Intelligence. Bedford, MA: MITRE (1969)
14.
Zurück zum Zitat Visser, W.: Use of episodic knowledge and information in design problem solving. Design Studies, Elsevier, 1995, Analysing Design Activity, 16(2), 171–187 (1995) Visser, W.: Use of episodic knowledge and information in design problem solving. Design Studies, Elsevier, 1995, Analysing Design Activity, 16(2), 171–187 (1995)
15.
Zurück zum Zitat Lloyd, P.: Can concurrent verbalization reveal design cognition? Des. Stud. 16, 237–259 (1995)CrossRef Lloyd, P.: Can concurrent verbalization reveal design cognition? Des. Stud. 16, 237–259 (1995)CrossRef
16.
Zurück zum Zitat Jaspers, M.W.M., Steen, T., Bos, C., Geenen, M.: The think aloud method: a guide to user interface design. Int. J. Med. Inform. 73(11–12), 781–795 (2004)CrossRef Jaspers, M.W.M., Steen, T., Bos, C., Geenen, M.: The think aloud method: a guide to user interface design. Int. J. Med. Inform. 73(11–12), 781–795 (2004)CrossRef
17.
Zurück zum Zitat Hay, L., Duffy, A. H. B., McTeague C., Pidgeon L. M., Vuletic T., Grealy, M.: A systematic review of protocol studies on conceptual design cognition: design as search and exploration. Des. Sci. 3 (2017) Hay, L., Duffy, A. H. B., McTeague C., Pidgeon L. M., Vuletic T., Grealy, M.: A systematic review of protocol studies on conceptual design cognition: design as search and exploration. Des. Sci. 3 (2017)
18.
Zurück zum Zitat Gero, J.: Design prototypes: a knowledge representation schema for design. Artif. Intell. Mag. 11(4), 26 (1990) Gero, J.: Design prototypes: a knowledge representation schema for design. Artif. Intell. Mag. 11(4), 26 (1990)
19.
Zurück zum Zitat Purcell, A.T., Gero, J.S., Edwards, H., Matka, E.: Design fixation and intelligent design assistants. In: Gero, J.S., Sudweeks, F. (eds.) Artificial Intelligence in Design ‘94, pp. 483–496. Kluwer, Dordrecht (1994)CrossRef Purcell, A.T., Gero, J.S., Edwards, H., Matka, E.: Design fixation and intelligent design assistants. In: Gero, J.S., Sudweeks, F. (eds.) Artificial Intelligence in Design ‘94, pp. 483–496. Kluwer, Dordrecht (1994)CrossRef
20.
Zurück zum Zitat Amhed, S., Hansen, C.T.: A decision making model for engineering designers. In: Sahin, T.M.M. (ed) Computer based design, EDC2002, Cambridge, pp. 217–227 (2002) Amhed, S., Hansen, C.T.: A decision making model for engineering designers. In: Sahin, T.M.M. (ed) Computer based design, EDC2002, Cambridge, pp. 217–227 (2002)
21.
Zurück zum Zitat Girod, M., Elliot, A.C., Wright, I.C., Burns, N.D.: Decision making in conceptual engineering design: an empirical investigation. Proc. Inst. Mech. Eng. Part B J. Eng. Manuf. 217(9), 1215–1228 (2003)CrossRef Girod, M., Elliot, A.C., Wright, I.C., Burns, N.D.: Decision making in conceptual engineering design: an empirical investigation. Proc. Inst. Mech. Eng. Part B J. Eng. Manuf. 217(9), 1215–1228 (2003)CrossRef
22.
Zurück zum Zitat Tang, J.C., Leifer, L.J.: A framework for understanding the workspace activity of design teams. In: Proceedings of ACM Conference on Computer-supported cooperative work: ACM (1988) Tang, J.C., Leifer, L.J.: A framework for understanding the workspace activity of design teams. In: Proceedings of ACM Conference on Computer-supported cooperative work: ACM (1988)
23.
Zurück zum Zitat Radcliffe, D.F., Lee, T.Y.: Design methods used by undergraduate engineering students. Des. Stud. 10(4), 199–207 (1989)CrossRef Radcliffe, D.F., Lee, T.Y.: Design methods used by undergraduate engineering students. Des. Stud. 10(4), 199–207 (1989)CrossRef
24.
Zurück zum Zitat Olson, G.M., Olson, J.S.: Small group design meetings: an analysis of collaboration. Human–Comput. Interact. 7, 347–374 (1992)CrossRef Olson, G.M., Olson, J.S.: Small group design meetings: an analysis of collaboration. Human–Comput. Interact. 7, 347–374 (1992)CrossRef
25.
Zurück zum Zitat Cross, N., Cross, A.C.: Observations of teamwork and social processes in design. Des. Stud. 16, 145–170 (1995) Cross, N., Cross, A.C.: Observations of teamwork and social processes in design. Des. Stud. 16, 145–170 (1995)
26.
Zurück zum Zitat Wiltschnig, S., Christensen, B.T., Ball, L.J.: Collaborative problem-solution co-evolution in creative design. Des. Stud. 34(2013), 515–545 (2013)CrossRef Wiltschnig, S., Christensen, B.T., Ball, L.J.: Collaborative problem-solution co-evolution in creative design. Des. Stud. 34(2013), 515–545 (2013)CrossRef
27.
Zurück zum Zitat Waldron, M.B., Waldron, K.J.: Methods of studying mechanical design. In: Waldron, M.B., Waldron, K.J. (eds.) Mechanical Design: Theory and Methodology, pp. 21–34. Springer, New York (1996)MATHCrossRef Waldron, M.B., Waldron, K.J.: Methods of studying mechanical design. In: Waldron, M.B., Waldron, K.J. (eds.) Mechanical Design: Theory and Methodology, pp. 21–34. Springer, New York (1996)MATHCrossRef
28.
Zurück zum Zitat Jiang, H. & Yen, C.-C.: Protocol analysis in design research: a review. In: Rigor and Relevance in Design: IASDR 2009, Seoul, Korea October 18–22, Seoul, pp. 147–156. International Association of Societies of Design Research (2009) Jiang, H. & Yen, C.-C.: Protocol analysis in design research: a review. In: Rigor and Relevance in Design: IASDR 2009, Seoul, Korea October 18–22, Seoul, pp. 147–156. International Association of Societies of Design Research (2009)
29.
Zurück zum Zitat Perry, M.: Coordinating joint design work: the role of communication and artefacts. Des. Stud. 19(3), 273–288 (1998)MathSciNetCrossRef Perry, M.: Coordinating joint design work: the role of communication and artefacts. Des. Stud. 19(3), 273–288 (1998)MathSciNetCrossRef
30.
Zurück zum Zitat Visser, W.: Function and Form of Gestures in a Collaborative Design Meeting. In: Kopp, S., Wachsmuth, I. (eds.) Gesture in Embodied Communication and Human–Computer Interaction, vol. 5934, pp. 61–72. Springer, Berlin (2010)CrossRef Visser, W.: Function and Form of Gestures in a Collaborative Design Meeting. In: Kopp, S., Wachsmuth, I. (eds.) Gesture in Embodied Communication and Human–Computer Interaction, vol. 5934, pp. 61–72. Springer, Berlin (2010)CrossRef
31.
Zurück zum Zitat Härkki, T., Seitamaa-Hakkarainen, P., Hakkarainen, K.: Hands on design: comparing the use of sketching and gesturing in collaborative designing. J. Des. Res. 16(1), 24–46 (2018) Härkki, T., Seitamaa-Hakkarainen, P., Hakkarainen, K.: Hands on design: comparing the use of sketching and gesturing in collaborative designing. J. Des. Res. 16(1), 24–46 (2018)
32.
Zurück zum Zitat Eris, O., Martelaro, N.: Badke-Schaube, P: a comparative analysis of multimodal communication during design sketching in co-located and distributed environments. Des. Stud. 35, 559–592 (2014)CrossRef Eris, O., Martelaro, N.: Badke-Schaube, P: a comparative analysis of multimodal communication during design sketching in co-located and distributed environments. Des. Stud. 35, 559–592 (2014)CrossRef
33.
Zurück zum Zitat McNeill, D.: Hand and Mind: What Gestures Reveal About Thought. University of Chicago Press, Chicago (1992) McNeill, D.: Hand and Mind: What Gestures Reveal About Thought. University of Chicago Press, Chicago (1992)
34.
Zurück zum Zitat Kang, S., Tversky, B., Black, J.B.: Coordinating gesture, word, and diagram: explanations for experts and novices. Spat. Cognit. Comput. 15, 1–26 (2015)CrossRef Kang, S., Tversky, B., Black, J.B.: Coordinating gesture, word, and diagram: explanations for experts and novices. Spat. Cognit. Comput. 15, 1–26 (2015)CrossRef
35.
Zurück zum Zitat Jeantet, A.: Les objets intermédiaires dans les processus de conception des produits. Sociologie du travail 3, 291–316 (1998)CrossRef Jeantet, A.: Les objets intermédiaires dans les processus de conception des produits. Sociologie du travail 3, 291–316 (1998)CrossRef
36.
Zurück zum Zitat Vinck, D.: Taking intermediary objects and equipping work into account in the study of engineering practices. Eng. Stud. 3(1), 25–44 (2011)CrossRef Vinck, D.: Taking intermediary objects and equipping work into account in the study of engineering practices. Eng. Stud. 3(1), 25–44 (2011)CrossRef
37.
Zurück zum Zitat Boujut, J.F., Blanco, E.: Intermediary objects as a means to foster co-operation in engineering design. Comput. Support. Coop. Work 12, 205–219 (2003)CrossRef Boujut, J.F., Blanco, E.: Intermediary objects as a means to foster co-operation in engineering design. Comput. Support. Coop. Work 12, 205–219 (2003)CrossRef
38.
Zurück zum Zitat Becattini, N., Masclet, C., Ben-Guefrache, F., Prudhomme, G., Cascini, G., Dekoninck, E.: Characterisation of a co-creative design session through the analysis of multi-modal interactions. In: Proceeding of the International Conference on Engineering Design ICED2017, pp. 479–488 (2017) Becattini, N., Masclet, C., Ben-Guefrache, F., Prudhomme, G., Cascini, G., Dekoninck, E.: Characterisation of a co-creative design session through the analysis of multi-modal interactions. In: Proceeding of the International Conference on Engineering Design ICED2017, pp. 479–488 (2017)
39.
Zurück zum Zitat Ahmed, S., Wallace, K.M., Blessing, L.T.: Understanding the differences between how novice and experienced designers approach design tasks. Res. Eng. Des. 14(1), 1–11 (2003)CrossRef Ahmed, S., Wallace, K.M., Blessing, L.T.: Understanding the differences between how novice and experienced designers approach design tasks. Res. Eng. Des. 14(1), 1–11 (2003)CrossRef
40.
Zurück zum Zitat Dorst, K.: Analysing design activity: new directions in protocol analysis. Des. Stud. 16(2), 139–142 (1995)CrossRef Dorst, K.: Analysing design activity: new directions in protocol analysis. Des. Stud. 16(2), 139–142 (1995)CrossRef
41.
Metadaten
Titel
Real-time coding method and tool for artefact-centric interaction analysis in co-design situations assisted by augmented reality
verfasst von
C. Masclet
M. Poulin
J. F. Boujut
N. Becattini
Publikationsdatum
28.08.2020
Verlag
Springer Paris
Erschienen in
International Journal on Interactive Design and Manufacturing (IJIDeM) / Ausgabe 4/2020
Print ISSN: 1955-2513
Elektronische ISSN: 1955-2505
DOI
https://doi.org/10.1007/s12008-020-00683-8

Weitere Artikel der Ausgabe 4/2020

International Journal on Interactive Design and Manufacturing (IJIDeM) 4/2020 Zur Ausgabe