Skip to main content
Top

2024 | OriginalPaper | Chapter

Integrating Virtual and Real: A Holistic Framework for Mixed Reality Interactive Design in Museum Exhibitions

Authors : Jingyu Liu, Guoyu Sun, Mohammad Shidujaman

Published in: Human-Computer Interaction

Publisher: Springer Nature Switzerland

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This paper proposes a framework for interaction design in museums that utilizes Mixed Reality (MR) technology. The framework combines virtual and real exhibition spaces to improve the connection between exhibit information and the user. The framework includes creating immersive environments with virtual-physical integration, designing for multi-temporal and spatial interactive narratives, and developing multimodal sensory interactions. This framework aims to bridge research gaps in the characteristics of mixed reality technology and museum interaction design, while strengthening the relationship between the exhibition space and its theme. These elements have already been examined individually. The ‘Chuanmei Guiding’ case study demonstrates the effectiveness of the proposed interaction design framework and the potential of MR technology to improve the interactivity and educational functions of museum exhibits.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
6.
go back to reference Azuma, R., Baillot, Y., Behringer, R., Feiner, S., Julier, S., MacIntyre, B.: Recent advances in augmented reality. IEEE Comput. Graphics Appl. 21(6), 34–47 (2001)CrossRef Azuma, R., Baillot, Y., Behringer, R., Feiner, S., Julier, S., MacIntyre, B.: Recent advances in augmented reality. IEEE Comput. Graphics Appl. 21(6), 34–47 (2001)CrossRef
7.
go back to reference Azuma, R.T.: A survey of augmented reality. Presence: Teleoperators Virtual Environ. 6(4), 355–385 (1997) Azuma, R.T.: A survey of augmented reality. Presence: Teleoperators Virtual Environ. 6(4), 355–385 (1997)
8.
go back to reference Banfi, F., Pontisso, M., Paolillo, F.R., Roascio, S., Spallino, C., Stanga, C.: Interactive and immersive digital representation for virtual museum: Vr and ar for semantic enrichment of museo nazionale romano, antiquarium di lucrezia romana and antiquarium di villa dei quintili. ISPRS Int. J. Geo Inf. 12(2), 28 (2023)CrossRef Banfi, F., Pontisso, M., Paolillo, F.R., Roascio, S., Spallino, C., Stanga, C.: Interactive and immersive digital representation for virtual museum: Vr and ar for semantic enrichment of museo nazionale romano, antiquarium di lucrezia romana and antiquarium di villa dei quintili. ISPRS Int. J. Geo Inf. 12(2), 28 (2023)CrossRef
9.
go back to reference Bowman, D.A., Kruijff, E., LaViola, J.J., Poupyrev, I.: An introduction to 3-d user interface design. Presence 10(1), 96–108 (2001)CrossRef Bowman, D.A., Kruijff, E., LaViola, J.J., Poupyrev, I.: An introduction to 3-d user interface design. Presence 10(1), 96–108 (2001)CrossRef
10.
go back to reference Cafaro, F.: Using embodied allegories to design gesture suites for human-data interaction. In: Proceedings of the 2012 ACM Conference on Ubiquitous Computing, pp. 560–563 (2012) Cafaro, F.: Using embodied allegories to design gesture suites for human-data interaction. In: Proceedings of the 2012 ACM Conference on Ubiquitous Computing, pp. 560–563 (2012)
11.
go back to reference Choi, H.s., Kim, S.h.: A content service deployment plan for metaverse museum exhibitions—centering on the combination of beacons and HMDs. Int. J. Inf. Manage. 37(1), 1519–1527 (2017) Choi, H.s., Kim, S.h.: A content service deployment plan for metaverse museum exhibitions—centering on the combination of beacons and HMDs. Int. J. Inf. Manage. 37(1), 1519–1527 (2017)
12.
go back to reference Danks, M., Goodchild, M., Rodriguez-Echavarria, K., Arnold, D.B., Griffiths, R.: interactive storytelling and gaming environments for museums: the interactive storytelling exhibition project. In: Hui, K., Pan, Z., Chung, R.C., Wang, C.C.L., Jin, X., Göbel, S., Li, E.C.-L. (eds.) Edutainment 2007. LNCS, vol. 4469, pp. 104–115. Springer, Heidelberg (2007). https://doi.org/10.1007/978-3-540-73011-8_13CrossRef Danks, M., Goodchild, M., Rodriguez-Echavarria, K., Arnold, D.B., Griffiths, R.: interactive storytelling and gaming environments for museums: the interactive storytelling exhibition project. In: Hui, K., Pan, Z., Chung, R.C., Wang, C.C.L., Jin, X., Göbel, S., Li, E.C.-L. (eds.) Edutainment 2007. LNCS, vol. 4469, pp. 104–115. Springer, Heidelberg (2007). https://​doi.​org/​10.​1007/​978-3-540-73011-8_​13CrossRef
13.
go back to reference FL, Z.: A study on the natural Human-computer Interaction in Museum Exhibitions (Ph.D. dissertation). Ph.D. thesis, Zhejiang University (2021) FL, Z.: A study on the natural Human-computer Interaction in Museum Exhibitions (Ph.D. dissertation). Ph.D. thesis, Zhejiang University (2021)
14.
go back to reference Goodman, C.: The future of museums: the post-pandemic transformation of experiences and expectations. In: Transitioning Media in a Post Covid World: Digital Transformation, Immersive Technologies, and Consumer Behavior, pp. 115–127. Springer (2022) Goodman, C.: The future of museums: the post-pandemic transformation of experiences and expectations. In: Transitioning Media in a Post Covid World: Digital Transformation, Immersive Technologies, and Consumer Behavior, pp. 115–127. Springer (2022)
15.
go back to reference Graf, H., Keil, J., Pagano, A., Pescarin, S.: A contextualized educational museum experience connecting objects, places and themes through mobile virtual museums. In: 2015 Digital Heritage, vol. 1, pp. 337–340. IEEE (2015) Graf, H., Keil, J., Pagano, A., Pescarin, S.: A contextualized educational museum experience connecting objects, places and themes through mobile virtual museums. In: 2015 Digital Heritage, vol. 1, pp. 337–340. IEEE (2015)
16.
go back to reference Hammady, R., Ma, M., Strathearn, C.: Ambient information visualisation and visitors’ technology acceptance of mixed reality in museums. J. Comput. Cultural Heritage (JOCCH) 13(2), 1–22 (2020)CrossRef Hammady, R., Ma, M., Strathearn, C.: Ambient information visualisation and visitors’ technology acceptance of mixed reality in museums. J. Comput. Cultural Heritage (JOCCH) 13(2), 1–22 (2020)CrossRef
17.
go back to reference Hammady, R., Ma, M., Strathern, C., Mohamad, M.: Design and development of a spatial mixed reality touring guide to the Egyptian museum. Multimed. Tools Appl. 79, 3465–3494 (2020)CrossRef Hammady, R., Ma, M., Strathern, C., Mohamad, M.: Design and development of a spatial mixed reality touring guide to the Egyptian museum. Multimed. Tools Appl. 79, 3465–3494 (2020)CrossRef
18.
19.
go back to reference Jacob, R.J., et al.: Reality-based interaction: a framework for post-wimp interfaces. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 201–210 (2008) Jacob, R.J., et al.: Reality-based interaction: a framework for post-wimp interfaces. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 201–210 (2008)
20.
go back to reference Jeffery-Clay, K.R.: Constructivism in museums: how museums create meaningful learning environments. J. Museum Educ. 23(1), 3–7 (1998)CrossRef Jeffery-Clay, K.R.: Constructivism in museums: how museums create meaningful learning environments. J. Museum Educ. 23(1), 3–7 (1998)CrossRef
21.
go back to reference Jin, H., Han, D., Chen, Y., et al.: A survey on human-computer interaction in mixed reality. J. Comput.-Aided Des. Comput. Graph. 28(6), 869–880 (2016) Jin, H., Han, D., Chen, Y., et al.: A survey on human-computer interaction in mixed reality. J. Comput.-Aided Des. Comput. Graph. 28(6), 869–880 (2016)
22.
go back to reference Martinez, M.M., Sears, E.L., Sieg, L.: Contextualizing museum collections at the smithsonian institution: the relevance of collections-based research in the twenty-first century (2022) Martinez, M.M., Sears, E.L., Sieg, L.: Contextualizing museum collections at the smithsonian institution: the relevance of collections-based research in the twenty-first century (2022)
23.
go back to reference Milgram, P., Kishino, F.: A taxonomy of mixed reality visual displays. IEICE Trans. Inf. Syst. 77(12), 1321–1329 (1994) Milgram, P., Kishino, F.: A taxonomy of mixed reality visual displays. IEICE Trans. Inf. Syst. 77(12), 1321–1329 (1994)
24.
go back to reference Packer, J., Ballantyne, R.: Motivational factors and the visitor experience: a comparison of three sites. Curator Museum J. 45(3), 183–198 (2002) Packer, J., Ballantyne, R.: Motivational factors and the visitor experience: a comparison of three sites. Curator Museum J. 45(3), 183–198 (2002)
25.
go back to reference Pekarik, A.J., Doering, Z.D., Karns, D.A.: Exploring satisfying experiences in museums. Curator Museum J. 42(2), 152–173 (1999) Pekarik, A.J., Doering, Z.D., Karns, D.A.: Exploring satisfying experiences in museums. Curator Museum J. 42(2), 152–173 (1999)
26.
go back to reference Price, S., Sakr, M., Jewitt, C.: Exploring whole-body interaction and design for museums. Interact. Comput. 28(5), 569–583 (2016)CrossRef Price, S., Sakr, M., Jewitt, C.: Exploring whole-body interaction and design for museums. Interact. Comput. 28(5), 569–583 (2016)CrossRef
27.
go back to reference Ridel, B., Reuter, P., Laviole, J., Mellado, N., Couture, N., Granier, X.: The revealing flashlight: interactive spatial augmented reality for detail exploration of cultural heritage artifacts. J. Comput. Cultural Heritage (JOCCH) 7(2), 1–18 (2014)CrossRef Ridel, B., Reuter, P., Laviole, J., Mellado, N., Couture, N., Granier, X.: The revealing flashlight: interactive spatial augmented reality for detail exploration of cultural heritage artifacts. J. Comput. Cultural Heritage (JOCCH) 7(2), 1–18 (2014)CrossRef
28.
go back to reference Schott, E., et al.: Unitexr: joint exploration of a real-world museum and its digital twin. In: Proceedings of the 29th ACM Symposium on Virtual Reality Software and Technology, pp. 1–10 (2023) Schott, E., et al.: Unitexr: joint exploration of a real-world museum and its digital twin. In: Proceedings of the 29th ACM Symposium on Virtual Reality Software and Technology, pp. 1–10 (2023)
29.
go back to reference Seifi, M., Schauer, S., Fadzila Abd Rahman, H.: Experiencing the architectural evolution of a heritage museum in extended reality application. In: Proceedings of the 20th International Conference on Culture and Computer Science: Code and Materiality, pp. 1–7 (2023) Seifi, M., Schauer, S., Fadzila Abd Rahman, H.: Experiencing the architectural evolution of a heritage museum in extended reality application. In: Proceedings of the 20th International Conference on Culture and Computer Science: Code and Materiality, pp. 1–7 (2023)
30.
go back to reference Thompson, C.: The role of the museum in interpretation: the problem of context. Int. J. Herit. Stud. 1(1), 40–51 (1994)CrossRef Thompson, C.: The role of the museum in interpretation: the problem of context. Int. J. Herit. Stud. 1(1), 40–51 (1994)CrossRef
31.
go back to reference Trajkova, M., Alhakamy, A., Cafaro, F., Mallappa, R., Kankara, S.R.: Move your body: engaging museum visitors with human-data interaction. In: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, pp. 1–13 (2020) Trajkova, M., Alhakamy, A., Cafaro, F., Mallappa, R., Kankara, S.R.: Move your body: engaging museum visitors with human-data interaction. In: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, pp. 1–13 (2020)
32.
go back to reference Weiser, M., Brown, J.S.: Designing calm technology. PowerGrid J. 1(1), 75–85 (1996) Weiser, M., Brown, J.S.: Designing calm technology. PowerGrid J. 1(1), 75–85 (1996)
33.
go back to reference Wigdor, D., Wixon, D.: Brave NUI world: designing natural user interfaces for touch and gesture. Elsevier (2011) Wigdor, D., Wixon, D.: Brave NUI world: designing natural user interfaces for touch and gesture. Elsevier (2011)
34.
go back to reference Zancanaro, M., Stock, O., Alfaro, I.: Using cinematic techniques in a multimedia museum guide (2003) Zancanaro, M., Stock, O., Alfaro, I.: Using cinematic techniques in a multimedia museum guide (2003)
Metadata
Title
Integrating Virtual and Real: A Holistic Framework for Mixed Reality Interactive Design in Museum Exhibitions
Authors
Jingyu Liu
Guoyu Sun
Mohammad Shidujaman
Copyright Year
2024
DOI
https://doi.org/10.1007/978-3-031-60449-2_25