Top

Published in:

2022 | OriginalPaper | Chapter

Neural Network Visualization in Virtual Reality: A Use Case Analysis and Implementation

Authors : Dirk Queck, Annika Wohlan, Andreas Schreiber

Published in: Human Interface and the Management of Information: Visual and Information Design

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

Software systems and components increasingly rely on machine learning methods such as Artificial Neural Networks (ANNs) to provide intelligent functionality. Therefore, software developers and machine learning users should have a basic understanding of such methods. However, since ANNs are complex and thus challenging to grasp, novel visualization approaches can contribute to a better comprehension. We conducted an online survey to identify use cases and requirements for visualizing ANNs. Based on our results we designed and implemented an ANN visualization in virtual reality (VR) specifically targeted at machine learning users. Our approach is particularly suitable for teaching purposes and machine learning novices or non-experts who want to get an impression of the general functionality of neural networks.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

previous chapter Designing for Interaction: Determining the Most Influential Aesthetic Factors for Effective Visualisation of Uncertainty

next chapter Quantitative Progress Evaluation for Open Source Project with Application to Bullseye Chart

Bellgardt, M., Scheiderer, C., Kuhlen, T.W.: An immersive node-link visualization of artificial neural networks for machine learning experts. In: 2020 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR), pp. 33–36 (2020). https://doi.org/10.1109/AIVR50618.2020.00015

Carney, M., et al.: Teachable machine: approachable web-based tool for exploring machine learning classification. In: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems, pp. 1–8 (2020)

Chavez, B., Bayona, S.: Virtual reality in the learning process. In: Rocha, Á., Adeli, H., Reis, L.P., Costanzo, S. (eds.) WorldCIST’18 2018. AISC, vol. 746, pp. 1345–1356. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-77712-2_129CrossRef

Harley, A.W.: An interactive node-link visualization of convolutional neural networks. In: Bebis, G., et al. (eds.) ISVC 2015. LNCS, vol. 9474, pp. 867–877. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-27857-5_77CrossRef

LeCun, Y., Bottou, L., Bengio, Y., Haffner, P.: Gradient-based learning applied to document recognition. Proc. IEEE 86(11), 2278–2324 (1998). https://doi.org/10.1109/5.726791CrossRef

Mané, D., et al.: Tensorboard: tensorflow’s visualization toolkit (2015)

Mayring, P.: Qualitative Content Analysis - A Companion to Qualitative Research, vol. 1. Sage Publications, London Thousand Oaks (2004)

Meissler, N., Wohlan, A., Hochgeschwender, N., Schreiber, A.: Using visualization of convolutional neural networks in virtual reality for machine learning newcomers. In: 2019 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR), pp. 152–156. IEEE (2019)

Naraha, T., Akomoto, K., Yair, I.E.: Survey of the VR environment for deep learning model development. In: The 35th Annual Conference of the Japanese Society for Artificial Intelligence, vol. 35 (2021). https://doi.org/10.11517/pjsai.JSAI2021.0_2N3IS2b04

10.

Schreiber, A., Bock, M.: Visualization and exploration of deep learning networks in 3D and virtual reality. In: Stephanidis, C. (ed.) HCII 2019. CCIS, vol. 1033, pp. 206–211. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-23528-4_29CrossRef

11.

Someren, M.V., Barnard, Y., Sandberg, J.: The Think Aloud Method: A Practical Approach to Modelling Cognitive, vol. 11. Academic Press, London (1994)

12.

VanHorn, K., Çobanoğlu, M.C.: Democratizing AI in biomedical image classification using virtual reality. Virtual Real., 1–13 (2021)

13.

Wang, Z.J., et al.: CNN explainer: learning convolutional neural networks with interactive visualization. IEEE Trans. Vis. Comput. Graph. 27(2), 1396–1406 (2020)CrossRef

14.

Yosinski, J., Clune, J., Nguyen, A., Fuchs, T., Lipson, H.: Understanding neural networks through deep visualization. In: In ICML Workshop on Deep Learning (2015)

Title: Neural Network Visualization in Virtual Reality: A Use Case Analysis and Implementation
Authors: Dirk Queck
Annika Wohlan
Andreas Schreiber
Publisher: Springer International Publishing
Book: Human Interface and the Management of Information: Visual and Information Design
Print ISBN: 978-3-031-06423-4

Electronic ISBN: 978-3-031-06424-1

Copyright Year: 2022
DOI: https://doi.org/10.1007/978-3-031-06424-1_28

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"