Top

Published in:

2022 | OriginalPaper | Chapter

An Approach Based on Linked Open Data and Augmented Reality for Cultural Heritage Content-Based Information Retrieval

Authors : Antonio M. Rinaldi, Cristiano Russo, Cristian Tommasino

Published in: Computational Science and Its Applications – ICCSA 2022

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

Nowadays, many technologies are changing our way of life, including those related to extended reality. One of the most interesting is Augmented Reality (AR). Today, even if this technology seems to be discovered yet, it is widely applied in several contexts, including the fruition and conservation of cultural heritage. Such spread is mainly offered by the new and more powerful mobile devices, allowing museums and art exhibitions to use AR to offer new experiences to visitors. In this paper, we present an augmented reality mobile system based on content-based image analysis techniques and Linked Open Data to improve the user knowledge about cultural heritage. We use different image analysis techniques, and we present several experimental results to show the performance of our system.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

previous chapter Acoustic Wavefields Simulation by the Ray Method with Approximation of a Broadband Signal Propagation

next chapter Effectively and Efficiently Supporting Visual Big Data Analytics over Big Sequential Data: An Innovative Data Science Approach

Affleck, J., Kalay, Y., Kvan, T.: New Heritage: New Media and Cultural Heritage. Routledge, London (2007)

Bay, H., Tuytelaars, T., Van Gool, L.: SURF: speeded up robust features. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3951, pp. 404–417. Springer, Heidelberg (2006). https://doi.org/10.1007/11744023_32CrossRef

Berners-Lee, T., Hendler, J., Lassila, O.: The semantic web. Sci. Am. 284(5), 34–43 (2001)CrossRef

Bres, S., Tellez, B.: Localisation and augmented reality for mobile applications in culture heritage. Computer (Long. Beach. Calif), pp. 1–5. INSA, Lyon (2006)

Calonder, M., Lepetit, V., Strecha, C., Fua, P.: BRIEF: binary robust independent elementary features. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010. LNCS, vol. 6314, pp. 778–792. Springer, Heidelberg (2010). https://doi.org/10.1007/978-3-642-15561-1_56CrossRef

Candan, K.S., Liu, H., Suvarna, R.: Resource description framework: metadata and its applications. ACM SIGKDD Explor. Newsl. 3(1), 6–19 (2001)CrossRef

Capuano, A., Rinaldi, A.M., Russo, C.: An ontology-driven multimedia focused crawler based on linked open data and deep learning techniques. Multimed. Tools Appl. 79(11), 7577–7598 (2020). https://doi.org/10.1007/s11042-019-08252-2CrossRef

Clini, P., Frontoni, E., Quattrini, R., Pierdicca, R.: Augmented reality experience: from high-resolution acquisition to real time augmented contents. Adv. MultiMedia 2014 (2014). https://doi.org/10.1155/2014/597476

Cranmer, E., Jung, T.: Augmented reality (AR): business models in urban cultural heritage tourist destinations. In: APacCHRIE Conference, pp. 21–24 (2014)

10.

Dastageeri, H., Storz, M., Koukofikis, A., Knauth, S., Coors, V.: Approach and evaluation of a mobile video-based and location-based augmented reality platform for information brokerage. In: ISPRS - International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, vol. XLII-4/W1, pp. 151–157, September 2016. https://doi.org/10.5194/isprs-archives-XLII-4-W1-151-2016

11.

Valle, E.D., Ceri, S.: Querying the semantic web: SPARQL. In: Domingue, J., Fensel, D., Hendler, J.A. (eds.) Handbook of Semantic Web Technologies. Springer, Heidelberg (2011). https://doi.org/10.1007/978-3-540-92913-0_8CrossRef

12.

Fritz, F., Susperregui, A., Linaza, M.T.: Enhancing cultural tourism experiences with augmented reality technologies. In: The 6th International Symposium on Virtual Reality, Archaeology and Cultural Heritage VAST (2005)

13.

Ghouaiel, N., Garbaya, S., Cieutat, J.M., Jessel, J.P.: Mobile augmented reality in museums: towards enhancing visitor’s learning experience. Int. J. Virtual Reality 17(1), 21–31 (2017)CrossRef

14.

Han, D., Leue, C., Jung, T.: A tourist experience model for augmented reality applications in the urban heritage context. In: APacCHRIE Conference, pp. 21–24 (2014)

15.

Han, D.-I.D., Weber, J., Bastiaansen, M., Mitas, O., Lub, X.: Virtual and augmented reality technologies to enhance the visitor experience in cultural tourism. In: tom Dieck, M.C., Jung, T. (eds.) Augmented Reality and Virtual Reality. PI, pp. 113–128. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-06246-0_9CrossRef

16.

Han, J.G., Park, K.W., Ban, K.J., Kim, E.K.: Cultural heritage sites visualization system based on outdoor augmented reality. AASRI Procedia 4, 64–71 (2013). https://doi.org/10.1016/j.aasri.2013.10.011. https://www.sciencedirect.com/science/article/pii/S2212671613000127. 2013 AASRI Conference on Intelligent Systems and Control

17.

Jing, C., Junwei, G., Yongtian, W.: Mobile augmented reality system for personal museum tour guide applications. In: IET International Communication Conference on Wireless Mobile and Computing (CCWMC 2011), pp. 262–265 (2011). https://doi.org/10.1049/cp.2011.0887

18.

Candan, K.S., Sapino, M.L.: Data Management for Multimedia Retrieval. Cambridge University Press, Cambridge (2010)CrossRef

19.

Lehmann, J., et al.: DBpedia-a large-scale, multilingual knowledge base extracted from Wikipedia. Semant. Web 6(2), 167–195 (2015)CrossRef

20.

Lowe, D.G.: Object recognition from local scale-invariant features. In: Proceedings of the Seventh IEEE International Conference on Computer Vision, vol. 2, pp. 1150–1157. IEEE (1999)

21.

Madani, K., Rinaldi, A.M., Russo, C.: Combining linked open data and multimedia knowledge base for digital cultural heritage robotic applications. In: 2021 IEEE International Symposium on Multimedia (ISM), pp. 196–203. IEEE (2021)

22.

Makantasis, K., Doulamis, A., Doulamis, N., Ioannides, M., Matsatsinis, N.: Content-based filtering for fast 3D reconstruction from unstructured web-based image data. In: Ioannides, M., Magnenat-Thalmann, N., Fink, E., Žarnić, R., Yen, A.-Y., Quak, E. (eds.) EuroMed 2014. LNCS, vol. 8740, pp. 91–101. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-13695-0_9CrossRef

23.

Mikolajczyk, K., Schmid, C.: A performance evaluation of local descriptors. IEEE Trans. Pattern Anal. Mach. Intell. 27(10), 1615–1630 (2005)CrossRef

24.

Moscato, V., Picariello, A., Rinaldi, A.M.: A recommendation strategy based on user behavior in digital ecosystems. In: Proceedings of the International Conference on Management of Emergent Digital EcoSystems, pp. 25–32 (2010)

25.

Muscetti, M., Rinaldi, A.M., Russo, C., Tommasino, C.: Multimedia ontology population through semantic analysis and hierarchical deep features extraction techniques. Knowl. Inf. Syst. 64, 1283–1303 (2022). https://doi.org/10.1007/s10115-022-01669-6CrossRef

26.

Neuhofer, B., Buhalis, D., Ladkin, A.: A typology of technology-enhanced tourism experiences. Int. J. Tour. Res. 16(4), 340–350 (2014)CrossRef

27.

Olojede, A.: Investigating image processing algorithms for provision of information in rock art sites using mobile devices. Master’s thesis, University of Cape Town (2016)

28.

Purificato, E., Rinaldi, A.M.: Multimedia and geographic data integration for cultural heritage information retrieval. Multimed. Tools Appl. 77(20), 27447–27469 (2018). https://doi.org/10.1007/s11042-018-5931-7CrossRef

29.

Purificato, E., Rinaldi, A.M.: A multimodal approach for cultural heritage information retrieval. In: Gervasi, O., et al. (eds.) ICCSA 2018. LNCS, vol. 10960, pp. 214–230. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-95162-1_15CrossRef

30.

Rigby, J., Smith, S.P.: Augmented reality challenges for cultural heritage. Applied Informatics Research Group, University of Newcastle, Newcastle (2013)

31.

Rinaldi, A.M., Russo, C.: A semantic-based model to represent multimedia big data. In: Proceedings of the 10th International Conference on Management of Digital EcoSystems, pp. 31–38. ACM (2018)

32.

Rinaldi, A.M., Russo, C.: User-centered information retrieval using semantic multimedia big data. In: 2018 IEEE International Conference on Big Data (Big Data), pp. 2304–2313. IEEE (2018)

33.

Rinaldi, A.M., Russo, C.: Using a multimedia semantic graph for web document visualization and summarization. Multimed. Tools Appl. 80(3), 3885–3925 (2020). https://doi.org/10.1007/s11042-020-09761-1CrossRef

34.

Rinaldi, A.M., Russo, C., Madani, K.: A semantic matching strategy for very large knowledge bases integration. Int. J. Inf. Technol. Web Eng. (IJITWE) 15(2), 1–29 (2020)CrossRef

35.

Rinaldi, A.M., Russo, C., Tommasino, C.: A semantic approach for document classification using deep neural networks and multimedia knowledge graph. Expert Syst. Appl. 169, 114320 (2021)CrossRef

36.

Rinaldi, A.M., Russo, C., Tommasino, C.: A knowledge-driven multimedia retrieval system based on semantics and deep features. Future Internet 12(11), 183 (2020)CrossRef

37.

Rodrigues, J.M.F., et al.: Mobile augmented reality framework - MIRAR. In: Antona, M., Stephanidis, C. (eds.) UAHCI 2018. LNCS, vol. 10908, pp. 102–121. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-92052-8_9CrossRef

38.

Rublee, E., Rabaud, V., Konolige, K., Bradski, G.: ORB: an efficient alternative to SIFT or SURF. In: 2011 International Conference on Computer Vision, pp. 2564–2571. IEEE (2011)

39.

Russo, C., Madani, K., Rinaldi, A.M.: An unsupervised approach for knowledge construction applied to personal robots. IEEE Trans. Cogn. Dev. Syst. 13(1), 6–15 (2020)CrossRef

40.

Russo, C., Madani, K., Rinaldi, A.M.: Knowledge construction through semantic interpretation of visual information. In: Rojas, I., Joya, G., Catala, A. (eds.) IWANN 2019. LNCS, vol. 11507, pp. 246–257. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-20518-8_21CrossRef

41.

Shahi, D.: Apache Solr: An Introduction. In: Apache solr, pp. 1–9. Springer, Berkeley (2015). https://doi.org/10.1007/978-1-4842-1070-3_1CrossRef

42.

Shin, C., Hong, S.H., Yoon, H.: Enriching natural monument with user-generated mobile augmented reality mashup. J. Multimed. Inf. Syst. 7(1), 25–32 (2020)CrossRef

43.

Tam, D.C.C., Fiala, M.: A real time augmented reality system using GPU acceleration. In: 2012 Ninth Conference on Computer and Robot Vision, pp. 101–108 (2012). https://doi.org/10.1109/CRV.2012.21

44.

Titchen, S.M., et al.: On the construction of outstanding universal value: UNESCO’s world heritage convention (convention concerning the protection of the world cultural and natural heritage, 1972) and the identification and assessment of cultural places for inclusion in the world heritage list (1995)

45.

tom Dieck, M.C., Jung, T.H.: Value of augmented reality at cultural heritage sites: a stakeholder approach. J. Destination Mark. Manag. 6(2), 110–117 (2017). https://doi.org/10.1016/j.jdmm.2017.03.002. https://www.sciencedirect.com/science/article/pii/S2212571X16300774. Special edition on Digital Destinations

46.

Ufkes, A., Fiala, M.: A markerless augmented reality system for mobile devices. In: 2013 International Conference on Computer and Robot Vision, pp. 226–233 (2013). https://doi.org/10.1109/CRV.2013.51

47.

Vargo, S.L., Lusch, R.F.: From goods to service(s): divergences and convergences of logics. Ind. Mark. Manage. 37(3), 254–259 (2008)CrossRef

48.

Vi, S., da Silva, T.S., Maurer, F.: User experience guidelines for designing HMD extended reality applications. In: Lamas, D., Loizides, F., Nacke, L., Petrie, H., Winckler, M., Zaphiris, P. (eds.) INTERACT 2019. LNCS, vol. 11749, pp. 319–341. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-29390-1_18CrossRef

49.

Yovcheva, Z., Buhalis, D., Gatzidis, C.: Engineering augmented tourism experiences. In: Cantoni, L., Xiang, Z.P. (eds.) Information and Communication Technologies in Tourism 2013, pp. 24–35. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-36309-2_3CrossRef

50.

Yu, L.: Linked open data. In: Yu, L. (ed.) A Developer’s Guide to the Semantic Web, pp. 409–466. Springer, Heidelberg (2011). https://doi.org/10.1007/978-3-642-15970-1_11CrossRef

Title: An Approach Based on Linked Open Data and Augmented Reality for Cultural Heritage Content-Based Information Retrieval
Authors: Antonio M. Rinaldi
Cristiano Russo
Cristian Tommasino
Publisher: Springer International Publishing
Book: Computational Science and Its Applications – ICCSA 2022
Print ISBN: 978-3-031-10449-7

Electronic ISBN: 978-3-031-10450-3

Copyright Year: 2022
DOI: https://doi.org/10.1007/978-3-031-10450-3_8

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Premium Partner