Skip to main content

2018 | OriginalPaper | Buchkapitel

Explorable Representation of Interaction in VR/AR Environments

verfasst von : Jakub Flotyński, Adrian Nowak, Krzysztof Walczak

Erschienen in: Augmented Reality, Virtual Reality, and Computer Graphics

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Synthetic 3D content, which is the main element of virtual and augmented reality applications, typically includes objects, which react to interaction with users and other objects. Interaction may result in changes of the objects’ geometry, structure and appearance. Representation of 3D content covering temporal properties can be useful in application domains that benefit from analysis of users’ and objects’ behavior, such as education, training, e-commerce, marketing and merchandising. However, the available approaches do not enable exploration of 3D content with regards to its time-dependent properties. The main contribution of this paper is temporal representation of interaction. The representation is based on semantic web standards and ontologies, which enable use of general as well as domain knowledge for exploration of content. The representation is discussed in the context of an immersive virtual car showroom implemented using headsets and motion tracking devices.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
7.
Zurück zum Zitat Albrecht, S., Wiemann, T., Günther, M., Hertzberg, J.: Matching CAD object models in semantic mapping. In: Proceedings ICRA 2011 Workshop: Semantic Perception, Mapping and Exploration, SPME (2011) Albrecht, S., Wiemann, T., Günther, M., Hertzberg, J.: Matching CAD object models in semantic mapping. In: Proceedings ICRA 2011 Workshop: Semantic Perception, Mapping and Exploration, SPME (2011)
12.
Zurück zum Zitat Berners-Lee, T., Hendler, J., Lassila, O., et al.: The semantic web. Sci. Am. 284(5), 28–37 (2001)CrossRef Berners-Lee, T., Hendler, J., Lassila, O., et al.: The semantic web. Sci. Am. 284(5), 28–37 (2001)CrossRef
13.
Zurück zum Zitat Catalano, C.E., Mortara, M., Spagnuolo, M., Falcidieno, B.: Semantics and 3D media: current issues and perspectives. Comput. Graph. 35(4), 869–877 (2011)CrossRef Catalano, C.E., Mortara, M., Spagnuolo, M., Falcidieno, B.: Semantics and 3D media: current issues and perspectives. Comput. Graph. 35(4), 869–877 (2011)CrossRef
14.
Zurück zum Zitat Chaudhuri, S., Kalogerakis, E., Giguere, S., Funkhouser, T.: Attribit: content creation with semantic attributes. In: Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology, UIST 2013, pp. 193–202. ACM, New York (2013) Chaudhuri, S., Kalogerakis, E., Giguere, S., Funkhouser, T.: Attribit: content creation with semantic attributes. In: Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology, UIST 2013, pp. 193–202. ACM, New York (2013)
15.
Zurück zum Zitat Ciptawilangga, Y.: Online merchandising and ecommerce with virtual reality simulation of an actual retail location, US Patent App. 12/474, 202, 2 December 2010 Ciptawilangga, Y.: Online merchandising and ecommerce with virtual reality simulation of an actual retail location, US Patent App. 12/474, 202, 2 December 2010
16.
Zurück zum Zitat De Floriani, L., Hui, A., Papaleo, L., Huang, M., Hendler, J.: A semantic web environment for digital shapes understanding. In: Falcidieno, B., Spagnuolo, M., Avrithis, Y., Kompatsiaris, I., Buitelaar, P. (eds.) SAMT 2007. LNCS, vol. 4816, pp. 226–239. Springer, Heidelberg (2007). https://doi.org/10.1007/978-3-540-77051-0_25CrossRef De Floriani, L., Hui, A., Papaleo, L., Huang, M., Hendler, J.: A semantic web environment for digital shapes understanding. In: Falcidieno, B., Spagnuolo, M., Avrithis, Y., Kompatsiaris, I., Buitelaar, P. (eds.) SAMT 2007. LNCS, vol. 4816, pp. 226–239. Springer, Heidelberg (2007). https://​doi.​org/​10.​1007/​978-3-540-77051-0_​25CrossRef
17.
Zurück zum Zitat De Troyer, O., Kleinermann, F., Pellens, B., Bille, W.: Conceptual modeling for virtual reality. In: Grundy, J., Hartmann, S., Laender, A.H.F., Maciaszek, L., Roddick, J.F. (eds.) Tutorials, Posters, Panels and Industrial Contributions at the 26th International Conference on Conceptual Modeling - ER 2007, CRPIT, Auckland, New Zealand, vol. 83, pp. 3–18. ACS (2007) De Troyer, O., Kleinermann, F., Pellens, B., Bille, W.: Conceptual modeling for virtual reality. In: Grundy, J., Hartmann, S., Laender, A.H.F., Maciaszek, L., Roddick, J.F. (eds.) Tutorials, Posters, Panels and Industrial Contributions at the 26th International Conference on Conceptual Modeling - ER 2007, CRPIT, Auckland, New Zealand, vol. 83, pp. 3–18. ACS (2007)
19.
Zurück zum Zitat Falcidieno, B., Spagnuolo, M., Alliez, P., Quak, E., Vavalis, E., Houstis, C.: Towards the semantics of digital shapes: the AIM@SHAPE approach. In: EWIMT (2004) Falcidieno, B., Spagnuolo, M., Alliez, P., Quak, E., Vavalis, E., Houstis, C.: Towards the semantics of digital shapes: the AIM@SHAPE approach. In: EWIMT (2004)
20.
Zurück zum Zitat Flotyński, J.: Semantic modelling of interactive 3D content with domain-specific ontologies. Procedia Comput. Sci. 35, 531–540 (2014). 18th International Conference on Knowledge-Based and Intelligent Information and Engineering SystemsCrossRef Flotyński, J.: Semantic modelling of interactive 3D content with domain-specific ontologies. Procedia Comput. Sci. 35, 531–540 (2014). 18th International Conference on Knowledge-Based and Intelligent Information and Engineering SystemsCrossRef
21.
Zurück zum Zitat Flotyński, J., Krzyszkowski, M., Walczak, K.: Semantic composition of 3D content behavior for explorable virtual reality applications. In: Barbic, J., D’Cruz, M., Latoschik, M.E., Slater, M., Bourdot, P. (eds.) EuroVR 2017. LNCS, vol. 10700, pp. 3–23. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-72323-5_1CrossRef Flotyński, J., Krzyszkowski, M., Walczak, K.: Semantic composition of 3D content behavior for explorable virtual reality applications. In: Barbic, J., D’Cruz, M., Latoschik, M.E., Slater, M., Bourdot, P. (eds.) EuroVR 2017. LNCS, vol. 10700, pp. 3–23. Springer, Cham (2017). https://​doi.​org/​10.​1007/​978-3-319-72323-5_​1CrossRef
22.
Zurück zum Zitat Flotyński, J., Walczak, K.: Semantic multi-layered design of interactive 3D presentations. In: Proceedings of the Federated Conference on Computer Science and Information Systems, Kraków, Poland, 8–11 September 2013, pp. 541–548. IEEE (2013) Flotyński, J., Walczak, K.: Semantic multi-layered design of interactive 3D presentations. In: Proceedings of the Federated Conference on Computer Science and Information Systems, Kraków, Poland, 8–11 September 2013, pp. 541–548. IEEE (2013)
23.
Zurück zum Zitat Flotyński, J., Walczak, K.: Conceptual knowledge-based modeling of interactive 3D content. Vis. Comput. 31, 1–20 (2014) Flotyński, J., Walczak, K.: Conceptual knowledge-based modeling of interactive 3D content. Vis. Comput. 31, 1–20 (2014)
25.
Zurück zum Zitat Flotyński, J., Walczak, K.: Customization of 3D content with semantic meta-scenes. Graph. Model. 88, 23–39 (2016)MathSciNetCrossRef Flotyński, J., Walczak, K.: Customization of 3D content with semantic meta-scenes. Graph. Model. 88, 23–39 (2016)MathSciNetCrossRef
26.
Zurück zum Zitat Flotyński, J., Walczak, K.: Knowledge-based representation of 3D content behavior in a service-oriented virtual environment. In: Proceedings of the 22nd International Conference on Web3D Technology, Brisbane, Australia, 5–7 June 2017, Article no. 14. ACM, New York (2017) Flotyński, J., Walczak, K.: Knowledge-based representation of 3D content behavior in a service-oriented virtual environment. In: Proceedings of the 22nd International Conference on Web3D Technology, Brisbane, Australia, 5–7 June 2017, Article no. 14. ACM, New York (2017)
27.
Zurück zum Zitat Flotyński, J., Walczak, K.: Ontology-based representation and modelling of synthetic 3D content: a state-of-the-art review. In: Computer Graphics Forum, pp. 1–25 (2017)CrossRef Flotyński, J., Walczak, K.: Ontology-based representation and modelling of synthetic 3D content: a state-of-the-art review. In: Computer Graphics Forum, pp. 1–25 (2017)CrossRef
30.
Zurück zum Zitat Gutiérrez, M., García-Rojas, A., Thalmann, D., Vexo, F., Moccozet, L., Magnenat-Thalmann, N., Mortara, M., Spagnuolo, M.: An ontology of virtual humans: Incorporating semantics into human shapes. Vis. Comput. 23(3), 207–218 (2007)CrossRef Gutiérrez, M., García-Rojas, A., Thalmann, D., Vexo, F., Moccozet, L., Magnenat-Thalmann, N., Mortara, M., Spagnuolo, M.: An ontology of virtual humans: Incorporating semantics into human shapes. Vis. Comput. 23(3), 207–218 (2007)CrossRef
31.
Zurück zum Zitat Hu, X., Liu, X., He, Z., Zhang, J.: Batch modeling of 3D city based on Esri cityengine. In: Smart and Sustainable City 2013, ICSSC 2013, IET International Conference on IET (2013) Hu, X., Liu, X., He, Z., Zhang, J.: Batch modeling of 3D city based on Esri cityengine. In: Smart and Sustainable City 2013, ICSSC 2013, IET International Conference on IET (2013)
32.
Zurück zum Zitat Jiang, H., Xu, W., Mao, T., Li, C., Xia, S., Wang, Z.: A semantic environment model for crowd simulation in multilayered complex environment. In: Proceedings of the 16th ACM Symposium on Virtual Reality Software and Technology, pp. 191–198. ACM (2009) Jiang, H., Xu, W., Mao, T., Li, C., Xia, S., Wang, Z.: A semantic environment model for crowd simulation in multilayered complex environment. In: Proceedings of the 16th ACM Symposium on Virtual Reality Software and Technology, pp. 191–198. ACM (2009)
33.
Zurück zum Zitat Kalogerakis, E., Christodoulakis, S., Moumoutzis, N.: Coupling ontologies with graphics content for knowledge driven visualization. In: VR 2006 Proceedings of the IEEE conference on Virtual Reality, Alexandria, Virginia, USA, 25–29 March 2006, pp. 43–50 (2006) Kalogerakis, E., Christodoulakis, S., Moumoutzis, N.: Coupling ontologies with graphics content for knowledge driven visualization. In: VR 2006 Proceedings of the IEEE conference on Virtual Reality, Alexandria, Virginia, USA, 25–29 March 2006, pp. 43–50 (2006)
36.
Zurück zum Zitat Kowalski, R.A., Sadri, F.: The situation calculus and event calculus compared. In: ILPS, vol. 94, pp. 539–553 (1994) Kowalski, R.A., Sadri, F.: The situation calculus and event calculus compared. In: ILPS, vol. 94, pp. 539–553 (1994)
37.
Zurück zum Zitat Latoschik, M.E., Blach, R.: Semantic modelling for virtual worlds - a novel paradigm for realtime interactive systems? In: Proceedings of the ACM VRST 2008, pp. 17–20 (2008) Latoschik, M.E., Blach, R.: Semantic modelling for virtual worlds - a novel paradigm for realtime interactive systems? In: Proceedings of the ACM VRST 2008, pp. 17–20 (2008)
38.
Zurück zum Zitat Lugrin, J.L., Cavazza, M.: Making sense of virtual environments: action representation, grounding and common sense. In: Proceedings of the 12th International Conference on Intelligent User Interfaces, IUI 2007, pp. 225–234. ACM, New York (2007) Lugrin, J.L., Cavazza, M.: Making sense of virtual environments: action representation, grounding and common sense. In: Proceedings of the 12th International Conference on Intelligent User Interfaces, IUI 2007, pp. 225–234. ACM, New York (2007)
43.
Zurück zum Zitat Otto, K.: Semantic virtual environments. In: Special Interest Tracks and Posters of the 14th International Conference on World Wide Web, Chiba, Japan, 10–14 May 2005, pp. 1036–1037 (2005) Otto, K.: Semantic virtual environments. In: Special Interest Tracks and Posters of the 14th International Conference on World Wide Web, Chiba, Japan, 10–14 May 2005, pp. 1036–1037 (2005)
44.
Zurück zum Zitat Pellens, B., De Troyer, O., Kleinermann, F.: CoDePA: a conceptual design pattern approach to model behavior for X3D worlds. In: Proceedings of the 13th International Symposium on 3D web technology, Los Angeles, 09–10 August 2008, pp. 91–99 (2008) Pellens, B., De Troyer, O., Kleinermann, F.: CoDePA: a conceptual design pattern approach to model behavior for X3D worlds. In: Proceedings of the 13th International Symposium on 3D web technology, Los Angeles, 09–10 August 2008, pp. 91–99 (2008)
45.
Zurück zum Zitat Pellens, B., Kleinermann, F., De Troyer, O.: A development environment using behavior patterns to facilitate building 3D/VR applications. In: Proceedings of the 6th Australasian Conference on Interactive Entertainment, IE 2009, pp. 8:1–8:8. ACM (2009) Pellens, B., Kleinermann, F., De Troyer, O.: A development environment using behavior patterns to facilitate building 3D/VR applications. In: Proceedings of the 6th Australasian Conference on Interactive Entertainment, IE 2009, pp. 8:1–8:8. ACM (2009)
46.
Zurück zum Zitat Pittarello, F., De Faveri, A.: Semantic description of 3D environments: a proposal based on web standards. In: Proceedings of the Eleventh International Conference on 3D Web Technology, Web3D 2006, pp. 85–95. ACM, New York (2006) Pittarello, F., De Faveri, A.: Semantic description of 3D environments: a proposal based on web standards. In: Proceedings of the Eleventh International Conference on 3D Web Technology, Web3D 2006, pp. 85–95. ACM, New York (2006)
49.
Zurück zum Zitat Rumiński, D., Walczak, K.: Semantic contextual augmented reality environments. In: The 13th IEEE International Symposium on Mixed and Augmented Reality (ISMAR 2014), ISMAR 2014, pp. 401–404. IEEE (2014) Rumiński, D., Walczak, K.: Semantic contextual augmented reality environments. In: The 13th IEEE International Symposium on Mixed and Augmented Reality (ISMAR 2014), ISMAR 2014, pp. 401–404. IEEE (2014)
51.
Zurück zum Zitat Sikos, L.F.: 3D model indexing in videos for content-based retrieval via X3D-based semantic enrichment and automated reasoning. In: Proceedings of the 22nd International Conference on 3D Web Technology, Web3D 2017, pp. 19:1–19:7. ACM, New York (2017). https://doi.org/10.1145/3055624.3075943 Sikos, L.F.: 3D model indexing in videos for content-based retrieval via X3D-based semantic enrichment and automated reasoning. In: Proceedings of the 22nd International Conference on 3D Web Technology, Web3D 2017, pp. 19:1–19:7. ACM, New York (2017). https://​doi.​org/​10.​1145/​3055624.​3075943
53.
Zurück zum Zitat Spagnuolo, M., Falcidieno, B.: 3D media and the semantic web. IEEE Intell. Syst. 24(2), 90–96 (2009)CrossRef Spagnuolo, M., Falcidieno, B.: 3D media and the semantic web. IEEE Intell. Syst. 24(2), 90–96 (2009)CrossRef
55.
Zurück zum Zitat Trellet, M., Ferey, N., Baaden, M., Bourdot, P.: Interactive visual analytics of molecular data in immersive environments via a semantic definition of the content and the context. In: 2016 Workshop on Immersive Analytics (IA), pp. 48–53. IEEE (2016) Trellet, M., Ferey, N., Baaden, M., Bourdot, P.: Interactive visual analytics of molecular data in immersive environments via a semantic definition of the content and the context. In: 2016 Workshop on Immersive Analytics (IA), pp. 48–53. IEEE (2016)
56.
Zurück zum Zitat Tutenel, T., Bidarra, R., Smelik, R.M., De Kraker, K.J.: The role of semantics in games and simulations. Comput. Entertain. (CIE) 6(4), 57 (2008) Tutenel, T., Bidarra, R., Smelik, R.M., De Kraker, K.J.: The role of semantics in games and simulations. Comput. Entertain. (CIE) 6(4), 57 (2008)
57.
Zurück zum Zitat Van Gool, L., Leibe, B., Müller, P., Vergauwen, M., Weise, T.: 3D challenges and a non-in-depth overview of recent progress. In: 3DIM, pp. 118–132 (2007) Van Gool, L., Leibe, B., Müller, P., Vergauwen, M., Weise, T.: 3D challenges and a non-in-depth overview of recent progress. In: 3DIM, pp. 118–132 (2007)
64.
Zurück zum Zitat Walczak, K., Rumiński, D., Flotyński, J.: Building contextual augmented reality environments with semantics. In: Proceedings of the 20th International Conference on Virtual Systems and Multimedia, Hong Kong, 9–12 September 2014 (2014) Walczak, K., Rumiński, D., Flotyński, J.: Building contextual augmented reality environments with semantics. In: Proceedings of the 20th International Conference on Virtual Systems and Multimedia, Hong Kong, 9–12 September 2014 (2014)
66.
Zurück zum Zitat Wiebusch, D., Latoschik, M.E.: Enhanced decoupling of components in intelligent realtime interactive systems using ontologies. In: Software Engineering and Architectures for Realtime Interactive Systems (SEARIS), Proceedings of the IEEE Virtual Reality 2012 Workshop (2012) Wiebusch, D., Latoschik, M.E.: Enhanced decoupling of components in intelligent realtime interactive systems using ontologies. In: Software Engineering and Architectures for Realtime Interactive Systems (SEARIS), Proceedings of the IEEE Virtual Reality 2012 Workshop (2012)
67.
Zurück zum Zitat Zaid, L.A., Kleinermann, F., De Troyer, O.: Applying semantic web technology to feature modeling. In: Proceedings of the 2009 ACM Symposium on Applied Computing, SAC 2009, pp. 1252–1256. ACM (2009) Zaid, L.A., Kleinermann, F., De Troyer, O.: Applying semantic web technology to feature modeling. In: Proceedings of the 2009 ACM Symposium on Applied Computing, SAC 2009, pp. 1252–1256. ACM (2009)
Metadaten
Titel
Explorable Representation of Interaction in VR/AR Environments
verfasst von
Jakub Flotyński
Adrian Nowak
Krzysztof Walczak
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-319-95282-6_42