nach oben

Erschienen in:

2025 | OriginalPaper | Buchkapitel

Context-Based Annotation Visualisation in Virtual Reality: A Use Case in Archaeological Data Exploration

verfasst von : Michele De Bonis, Huyen Nguyen, Patrick Bourdot

Erschienen in: Virtual Reality and Mixed Reality

Verlag: Springer Nature Switzerland

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config

KI-gestützte Suche

Aus

Abstract

In this paper we present a Virtual Reality (VR) tool that facilitates the visualisation and exploration of context-based, multi-level annotations in archaeology. Indeed, thanks to photogrammetry and laser scanning techniques, archaeologists can capture and reconstruct almost faithfully ruins and excavations in 3D. Thus, they can maximise their work performance on the field within their limited excavation time and leave deep, but often slow, analysis tasks at later stages offsite. Using VR, we can enrich 3D captured and reconstructed environments by adding extra information for ex situ analysis of archaeological data. This approach can also help the archaeologists speed up their collaboration with other experts or easily share the information with the public. We aim to assist the exploration of numerous annotations and information at disposal that can be densely clustered in a 3D reconstructed world. We collaborated closely with archaeologists at AOROC in the process of designing annotations that convey information with increasing Levels of Detail (LoDs), reflecting the complexity of the contained data. We then developed different interaction techniques that allow users to explore the annotations by switching between LoDs, including active selection by clicking, proximity approach, and the combination of both. Additionally, we proposed and evaluated the effectiveness of annotation grouping mechanism to enhance visual clarity by aggregating annotations in close spatial proximity. The results of our user study with non-experts, aggregated with a qualitative study with the archaeologists, showed user preference for the combination of the interaction techniques, but evidenced some limitations for the grouping of annotations.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Vorheriges Kapitel Contrast and Hue in Depth Perception for Virtual Reality: An Experimental Study

Nächstes Kapitel 3-2-3 Multi-AI Segmentation Framework: LoD-Based, Incremental Segmentation of 3D Scan Data Using Any 2D AI

Assenmacher, I., Hentschel, B., Ni, C., Kuhlen, T., Bischof, C.: Interactive data annotation in virtual environments. In: Eurographics Symposium on Virtual Environments, pp. 119–126. The Eurographics Association (2006)

Attene, M., Robbiano, F., Spagnuolo, M., Falcidieno, B.: Characterization of 3D shape parts for semantic annotation. Comput. Aided Des. 41(10), 756–763 (2009)CrossRef

Aubry, S., Thouvenin, I., Lenne, D., Olive, J.: A knowledge model to read 3D annotations on a virtual mock-up for collaborative design. In: 2007 11th International Conference on Computer Supported Cooperative Work in Design, pp. 669–674 (2007)

Bach, B., Sicat, R., Beyer, J., Cordeil, M., Pfister, H.: The hologram in my hand: How effective is interactive exploration of 3D visualizations in immersive tangible augmented reality? IEEE Trans. Vis. Comput. Graphics 24(1), 457–467 (2018)CrossRef

Ballendat, T., Marquardt, N., Greenberg, S.: Proxemic interaction: designing for a proximity and orientation-aware environment. In: ACM International Conference on Interactive Tabletops and Surfaces, pp. 121–130. ITS ’10, Association for Computing Machinery, New York, NY, USA (2010). https://doi.org/10.1145/1936652.1936676

Barbier, J., Kenny, P., Young, J., Normand, J.M., Keane, M.T., O’Sullivan, M., Ventresque, A.: MAAP annotate: When archaeology meets augmented reality for annotation of megalithic art. In: 2017 23rd International Conference on Virtual System and Multimedia (VSMM), pp. 1–8 (2017)

Boletsis, C., Cedergren, J.: VR locomotion in the new era of virtual reality: an empirical comparison of prevalent techniques. Adv. Hum. Comput. Interaction 2019, 1–15 (2019)CrossRef

Boletsis, C., Kongsvik, S.: Controller-based text-input techniques for virtual reality: an empirical comparison. Int. J. Virtual Real. 19, (2019). https://doi.org/10.20870/IJVR.2019.19.3.2917

Boren, T., Ramey, J.: Thinking aloud: reconciling theory and practice. IEEE Trans. Prof. Commun. 43, 261–278 (2000). https://doi.org/10.1109/47.867942CrossRef

10.

Borhani, Z., Sharma, P., Ortega, F.R.: Survey of annotations in extended reality systems. IEEE Trans. Vis. Comput. Graph., 1–20 (2023). https://doi.org/10.1109/TVCG.2023.3288869

11.

Bowman, D., Wingrave, C., Campbell, J., Ly, V.: Using pinch gloves for both natural and abstract interaction techniques in virtual environments. In: Proceedings of HCI International, pp. 1–5 (2001)

12.

Bruno, F., Barbieri, L., Marino, E., Muzzupappa, M., D’Oriano, L., Colacino, B.: An augmented reality tool to detect and annotate design variations in an Industry 4.0 approach. Int. J. Adv. Manuf. Technol. 105, 1–13 (2019)CrossRef

13.

Clark, J.H.: Hierarchical geometric models for visible surface algorithms. Commun. ACM 19(10), 547–554 (1976)CrossRef

14.

Clergeaud, D., Guitton, P.: Design of an annotation system for taking notes in virtual reality. In: 2017 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video (3DTV-CON), pp. 1–4 (2017)

15.

Cockburn, A., Karlson, A., Bederson, B.B.: A review of overview+detail, zooming, and focus+context interfaces. ACM Comput. Surv. 41(1), 1–31 (2009)CrossRef

16.

Cordeil, M., Cunningham, A., Dwyer, T., Thomas, B.H., Marriott, K.: ImAxes: immersive axes as embodied affordances for interactive multivariate data visualisation. In: Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology, pp. 71–83. UIST ’17 (2017)

17.

De Luca, L.: Aïoli, une plateforme d’annotation sémantique 3D pour la documentation collaborative d’objets patrimoniaux. Culture et recherche (May 2018)

18.

Doerr, M., et al.: Definition of the CRMarchaeo. An Extension of CIDOC CRM to Support the Archaeological Excavation Process (2018)

19.

Doerr, M., Ore, C.E., Stead, S.: The CIDOC conceptual reference model-a new standard for knowledge sharing ER2007 tutorial. In: 26th International Conference on Conceptual Modeling (ER 2007) (2007)

20.

Dominic, J., Robb, A.: Exploring effects of screen-fixed and world-fixed annotation on navigation in virtual reality. In: 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), pp. 607–615 (2020)

21.

Dongxing, C., Sangwook, K.: Augmented reality annotation for real-time collaboration system. J. Korea Multimed. Soc. 23(3), 483–489 (2020)

22.

Du, J., Zou, Z., Shi, Y., Zhao, D.: Zero latency: real-time synchronization of BIM data in virtual reality for collaborative decision-making. Autom. Constr. 85, 51–64 (2018). https://doi.org/10.1016/j.autcon.2017.10.009CrossRef

23.

Engelke, U., Hutson, H., Nguyen, H., de Souza, P.: MelissAR: towards augmented visual analytics of honey bee behaviour. In: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems, pp. 2057–2063. CHI EA ’16 (2016)

24.

Fanini, B., Ferdani, D., Demetrescu, E., Berto, S., d’Annibale, E.: ATON: an open-source framework for creating immersive, collaborative and liquid web-apps for cultural heritage. Appl. Sci. 11(22), (2021). https://doi.org/10.3390/app112211062

25.

Feick, M., Kleer, N., Tang, A., Krüger, A.: The Virtual Reality Questionnaire Toolkit. UIST ’20 Adjunct, Association for Computing Machinery, New York, NY, USA (2020). https://doi.org/10.1145/3379350.3416188

26.

Frécon, E., Nöu, A.A.: Building distributed virtual environments to support collaborative work. In: Proceedings of the ACM Symposium on Virtual Reality Software and Technology, pp. 105–113. VRST ’98 (1998)

27.

García-Pereira, I., Gimeno, J., Morillo Tena, P., Casanova-Salas, P.: A Taxonomy of Augmented Reality Annotations, pp. 412–419 (2020).https://doi.org/10.5220/0009193404120419

28.

Gauglitz, S., Nuernberger, B., Turk, M., Höllerer, T.: World-Stabilized Annotations and Virtual Scene Navigation for Remote Collaboration. In: Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology, pp. 449–459. UIST ’14, Association for Computing Machinery, New York, NY, USA (2014). https://doi.org/10.1145/2642918.2647372

29.

Guerreiro, J., Medeiros, D., Mendes, D., Sousa, M., Jorge, J., Raposo, A., Santos, I.: Beyond Post-It: Structured Multimedia Annotations for Collaborative VEs (2014)

30.

Harmon, R., Patterson, W., Ribarsky, W., Bolter, J.: The virtual annotation system. In: Proceedings of the IEEE 1996 Virtual Reality Annual International Symposium, pp. 239–245 (1996)

31.

Hart, S.G., Staveland, L.E.: Development of NASA-TLX (task load index): results of empirical and theoretical research. In: Hancock, P.A., Meshkati, N. (eds.) Human Mental Workload, Advances in Psychology, vol. 52, pp. 139–183. North-Holland (1988).https://doi.org/10.1016/S0166-4115(08)62386-9

32.

Hoksza, D., Gawron, P., Ostaszewski, M., Schneider, R.: MolArt: a molecular structure annotation and visualization tool. Bioinformatics 34(23), 4127–4128 (2018). https://doi.org/10.1093/bioinformatics/bty489CrossRef

33.

Hunter, J., Gerber, A.: Harvesting community annotations on 3D models of museum artefacts to enhance knowledge, discovery and re-use. J. Cult. Herit. 11, (2010). https://doi.org/10.1016/j.culher.2009.04.004

34.

Jung, T., Gross, M.D., Do, E.Y.L.: Annotating and sketching on 3D web models. In: Proceedings of the 7th International Conference on Intelligent User Interfaces, pp. 95–102. IUI ’02 (2002)

35.

Kalkofen, D., Sandor, C., White, S., Schmalstieg, D.: Visualization Techniques for Augmented Reality, pp. 65–98. Springer, New York (2011)

36.

Kaptein, M., Robertson, J.: Modern Statistical Methods for HCI (2016). https://doi.org/10.1007/978-3-319-26633-6

37.

Koppel, T., Eduard Groller, M., Wu, H.Y.: Context-responsive labeling in augmented reality. In: 2021 IEEE 14th Pacific Visualization Symposium (PacificVis). IEEE (2021). https://doi.org/10.1109/pacificvis52677.2021.00020

38.

Krus, M., Bourdot, P., Guisnel, F., Thibault, G.: Levels of detail polygonal simplification. XRDS 3(4), 13–19 (1997). https://doi.org/10.1145/270955.270966CrossRef

39.

Lenne, D., Thouvenin, I., Aubry, S.: Supporting design with 3D-annotations in a collaborative virtual environment. Res. Eng. Des. 20, 149–155 (2009). https://doi.org/10.1007/s00163-009-0071-8CrossRef

40.

Lercari, N., Shiferaw, E., Forte, M., Kopper, R.: Immersive Visualization and Curation of Archaeological Heritage Data: Çatalhöyük and the Dig@IT App, vol. 25 (2018). https://doi.org/10.1007/s10816-017-9340-4

41.

Lewis, J.R.: The system usability scale: past, present, and future. Int. J. Hum. Comput. Interaction 34(7), 577–590 (2018). https://doi.org/10.1080/10447318.2018.1455307CrossRef

42.

Loughlin, M., Hughes, J.: An annotation system for 3D fluid flow isualization. In: Proceedings Visualization ’94, pp. 273–279 (1994)

43.

Luo, W., Lehmann, A., Widengren, H., Dachselt, R.: Where should we put it? Layout and placement strategies of documents in augmented reality for collaborative sensemaking. In: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. CHI ’22, Association for Computing Machinery, New York, NY, USA (2022). https://doi.org/10.1145/3491102.3501946

44.

Manferdini, A.M., Remondino, F.: Reality-based 3D Modeling, Segmentation and Web-Based Visualization, pp. 110–124 (2010). https://doi.org/10.1007/978-3-642-16873-4_9

45.

Manuel, A., M’Darhri, A., Abergel, V., Rozar, F., Luca, L.: A semi-automatic 2D/3D annotation framework for the geometric analysis of heritage artefacts. In: 3rd Digital Heritage International Congress (DigitalHERITAGE) Held Jointly with 2018 24th International Conference on Virtual Systems and Multimedia (VSMM 2018), pp. 1–7 (2018). https://doi.org/10.1109/DigitalHeritage.2018.8810114

46.

Manuel, A., Véron, P., De Luca, L.: 2D/3D semantic annotation of spatialized images for the documentation and analysis of cultural heritage. In: Catalano, C.E., Luca, L.D. (eds.) Eurographics Workshop on Graphics and Cultural Heritage. The Eurographics Association (2016).https://doi.org/10.2312/gch.20161391

47.

Nabiyouni, M., Saktheeswaran, A., Bowman, D., Karanth, A.: Comparing the Performance of Natural, Semi-natural, and Non-natural Locomotion Techniques in Virtual Reality (2015). https://doi.org/10.1109/3DUI.2015.7131717

48.

Nuernberger, B., Lien, K.C., Höllerer, T., Turk, M.: Interpreting 2D gesture annotations in 3D augmented reality. In: 2016 IEEE Symposium on 3D User Interfaces (3DUI), pp. 149–158 (2016). https://doi.org/10.1109/3DUI.2016.7460046

49.

Pagé, C., Bernier, P.M., Trempe, M.: Using video simulations and virtual reality to improve decision-making skills in basketball. J. Sports Sci. 37(21), 2403–2410 (2019). https://doi.org/10.1080/02640414.2019.1638193CrossRef

50.

Pedersen, E., McCall, K., Moran, T., Halasz, F.: Tivoli: An Electronic Whiteboard for Informal Workgroup Meetings, pp. 391–398 (1993). https://doi.org/10.1145/169059.169309

51.

Pick, S., Gebhardt, S., Weyers, B., Hentschel, B., Kuhlen, T.: A 3D collaborative virtual environment to integrate immersive virtual reality into factory planning processes. In: 2014 International Workshop on Collaborative Virtual Environments (3DCVE), pp. 1–6 (2014)

52.

Pick, S., Weyers, B., Hentschel, B., Kuhlen, T.W.: Design and evaluation of data annotation workflows for CAVE-like virtual environments. IEEE Trans. Vis. Comput. Graph. 22(4), 1452–1461 (2016)CrossRef

53.

Pittarello, F.: An architecture and a visual interface for tagging the 3D web. In: Proceedings of the International Conference on Advanced Visual Interfaces, pp. 311–315. AVI ’10, Association for Computing Machinery, New York, NY, USA (2010). https://doi.org/10.1145/1842993.1843049

54.

Rehring, K., Greulich, M., Bredenfeld, L., Ahlemann, F.: Let’s get in touch - decision making about enterprise architecture using 3D visualization in augmented reality. In: Proceedings of the 52nd Annual Hawaii International Conference on System Sciences, pp. 8–11 (2019).https://doi.org/10.24251/HICSS.2019.215

55.

Rijnsburger, W., Kratz, S.: Personalized presentation annotations using optical HMDs. Multimed. Tools Appl. 76, (2017).https://doi.org/10.1007/s11042-016-4064-0

56.

Shneiderman, B.: The eyes have it: a task by data type taxonomy for information visualizations. In: Proceedings 1996 IEEE Symposium on Visual Languages, pp. 336–343 (1996)

57.

Tatzgern, M., Orso, V., Kalkofen, D., Jacucci, G., Gamberini, L., Schmalstieg, D.: Adaptive information density for augmented reality displays. In: 2016 IEEE Virtual Reality (VR), pp. 83–92 (2016). https://doi.org/10.1109/VR.2016.7504691

58.

Tudhope, D., Binding, C., Jeffrey, S., May, K., Vlachidis, A.: A STELLAR role for knowledge organization systems in digital archaeology. Bull. Am. Soc. Inf. Sci. Technol. 37(4), 15–18 (2011)CrossRef

59.

Verlinden, J., Bolter, J., Mast, C.: Virtual Annotation: Verbal Communication in Virtual Reality. NASA STI/Recon Technical Report N (1993)

60.

Wharton, C., Rieman, J., Lewis, C., Polson, P.: The Cognitive Walkthrough Method: a Practitioner’s Guide, pp. 105–140. John Wiley & Sons, Inc., USA (1994)

61.

Wilcoxon, F.: Individual comparisons by ranking methods. In: Breakthroughs in Statistics: Methodology and Distribution, pp. 196–202. Springer ( (1992)

62.

Xi, N., Chen, J., Gama, F., Riar, M., Hamari, J.: The challenges of entering the metaverse: an experiment on the effect of extended reality on workload. Inf. Syst. Front. (2022). https://doi.org/10.1007/s10796-022-10244-xCrossRef

63.

Yu, C.H., Hunter, J.: Documenting and Sharing Comparative Analyses of 3D Digital Museum Artifacts through Semantic Web Annotations, vol. 6. Association for Computing Machinery, New York, NY, USA (2013).https://doi.org/10.1145/2532630.2532634

Titel: Context-Based Annotation Visualisation in Virtual Reality: A Use Case in Archaeological Data Exploration
verfasst von: Michele De Bonis
Huyen Nguyen
Patrick Bourdot
Verlag: Springer Nature Switzerland
Buch: Virtual Reality and Mixed Reality
Print ISBN: 978-3-031-78592-4

Electronic ISBN: 978-3-031-78593-1

Copyright-Jahr: 2025
DOI: https://doi.org/10.1007/978-3-031-78593-1_7

Springer Professional

Abstract

Bitte loggen Sie sich ein, um Zugang zu Ihrer Lizenz zu erhalten.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"