Top

Journal of Visualization

Published in:

13-10-2022 | Regular Paper

Effect of display platforms on spatial knowledge acquisition and engagement: an evaluation with 3D geometry visualizations

Authors: Feiyu Lu, Vijayakumar Nanjappan, Paul Parsons, Lingyun Yu, Hai-Ning Liang

Published in: Journal of Visualization | Issue 3/2023

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

With the recent rapid development of display technologies, interactive visualizations have become increasingly important to enhance content exploration in various domains, including learning. Desktop displays, mobile tablet multi-touch displays, and, more recently, virtual reality head-mounted displays have become readily accessible devices for interacting with visualizations. Despite their widespread use, it is still unclear how the type of device can influence the presentation of, interaction with, and learning from interactive visualizations. In this research, we have designed and conducted an experiment to evaluate the effects of these types of devices in the exploration of mathematical visualizations. An interactive visualization tool is designed and implemented with 3D geometry as our testbed. Our goal is to gain a better understanding of the effects of device types on supporting analytical reasoning with interactive visualizations. In general, our results indicate that the tool in all three types of devices can be equally efficient and engaging in interactive learning activities. We discuss the findings and suggestions based on the experiment results in the discussion.

previous article ESRGAN-based visualization for large-scale volume data

next article MVST-SciVis: narrative visualization and analysis of compound events in scientific data

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Available only for authorised users

Allcoat D, van Mühlenen A (2018) Learning in virtual reality: effects on performance, emotion and engagement. Res Learn Technol. https://doi.org/10.25304/rlt.v26.2140CrossRef

Arms L, Cook D, Cruz-Neira C (1999) The benefits of statistical visualization in an immersive environment. In: Proceedings IEEE virtual reality (Cat. No. 99CB36316), IEEE. pp 88–95

Bach B, Sicat R, Beyer J, Cordeil M, Pfister H (2017) The hologram in my hand: how effective is interactive exploration of 3d visualizations in immersive tangible augmented reality? IEEE Trans Vis Comput Graph 24(1):457–467CrossRef

Baki A, Kosa T, Guven B (2011) A comparative study of the effects of using dynamic geometry software and physical manipulatives on the spatial visualisation skills of pre-service mathematics teachers. Br J Educ Technol 42(2):291–310CrossRef

Ballas JA, Heitmeyer CL, Pérez-Quiñones MA (1992) Evaluating two aspects of direct manipulation in advanced cockpits. In: Proceedings of the SIGCHI conference on human factors in computing systems. pp 127–134

Barab S, Thomas M, Dodge T, Carteaux R, Tuzun H (2005) Making learning fun: quest Atlantis, a game without guns. Educ Technol Res Dev 53(1):86–107CrossRef

Bergström J, Dalsgaard TS, Alexander J, Hornbæk K (2021) How to evaluate object selection and manipulation in vr? Guidelines from 20 years of studies. In: Proceedings of the 2021 CHI conference on human factors in computing systems, CHI ’21. Association for computing machinery, New York, NY, USA. https://doi.org/10.1145/3411764.3445193

Besancon L, Ynnerman A, Keefe DF, Yu L, Isenberg T (2021) The state of the art of spatial interfaces for 3d visualization. Comput Graph Forum 40(1):293–326. https://doi.org/10.1111/cgf.14189CrossRef

Bowman DA, McMahan RP (2007) Virtual reality: How much immersion is enough? Computer 40(7):36–43CrossRef

Bryson C, Hand L (2007) The role of engagement in inspiring teaching and learning. Innov Educ Teach Int 44(4):349–362CrossRef

Cai Y, Tay CT, Ngo BK (2013) Introduction to 3d immersive and interactive learning. In: Cai Y (ed) 3D immersive and interactive learning. Springer, Berlin, pp 1–16CrossRef

Card M (1999) Readings in information visualization: using vision to think. Morgan Kaufmann, Burlington

Chariker JH, Naaz F, Pani JR (2011) Computer-based learning of neuroanatomy: a longitudinal study of learning, transfer, and retention. J Educ Psychol 103(1):19CrossRef

Chen C (2004) Information visualization: beyond the horizon. Springer Science & Business Media, Berlin

Chen L, Liang HN, Lu F, Papangelis K, Man KL, Yue Y (2020) Collaborative behavior, performance and engagement with visual analytics tasks using mobile devices. Hum Cent Comput Inf Sci 10(1):1–24CrossRef

Chen L, Liang HN, Lu F, Wang J, Chen W, Yue Y (2021) Effect of collaboration mode and position arrangement on immersive analytics tasks in virtual reality: a pilot study. Appl Sci. https://doi.org/10.3390/app112110473CrossRef

Chen L, Liang HN, Wang J, Qu Y, Yue Y (2021) On the use of large interactive displays to support collaborative engagement and visual exploratory tasks. Sensors. https://doi.org/10.3390/s21248403CrossRef

Chittaro L (2006) Visualizing information on mobile devices. Computer 39(3):40–45CrossRef

Chuah MC, Roth SF (1996) On the semantics of interactive visualizations. In: Proceedings IEEE symposium on information visualization’96, IEEE. pp 29–36

Cobb SV, Nichols S, Ramsey A, Wilson JR (1999) Virtual reality-induced symptoms and effects (VRISE). Presence Teleoperators Virtual Environ 8(2):169–186CrossRef

Cohen CA, Hegarty M (2014) Visualizing cross sections: training spatial thinking using interactive animations and virtual objects. Learn Individ Differ 33:63–71CrossRef

Computer versus smartphone. https://www.computerhope.com/issues/ch001398.htm. Accessed 05 2022

Cruz-Neira C, Sandin DJ, DeFanti TA (1993) Surround-screen projection-based virtual reality: the design and implementation of the cave. In: Proceedings of the 20th annual conference on computer graphics and interactive techniques. pp 135–142

Elmqvist N, Tsigas P (2008) A taxonomy of 3d occlusion management for visualization. IEEE Trans Vis Comput Graph 14(5):1095–1109CrossRef

Gagatsis A, Shiakalli M (2004) Ability to translate from one representation of the concept of function to another and mathematical problem solving. Educ Psychol 24(5):645–657CrossRef

Garg AX, Norman GR, Eva KW, Spero L, Sharan S (2002) Is there any real virtue of virtual reality? The minor role of multiple orientations in learning anatomy from computers. Acad Med 77(10):S97–S99CrossRef

Gruchalla K (2004) Immersive well-path editing: investigating the added value of immersion. In: IEEE virtual reality, IEEE. pp 157–164

Hancock MS (2004) Improving menu placement strategies for pen input. PhD thesis, University of British Columbia

Heath TL et al (1956) The thirteen books of Euclid’s elements. Courier Corporation, North ChelmsfordMATH

Hoffman H, Vu D (1997) Virtual reality: Teaching tool of the twenty-first century? Acad Med J Assoc Am Med Coll 72(12):1076–1081CrossRef

HSM C (1991) Regular complex polytopes

Hundhausen CD, Douglas SA, Stasko JT (2002) A meta-study of algorithm visualization effectiveness. J Vis Lang Comput 13(3):259–290CrossRef

Hung YH, Parsons P (2017) Assessing user engagement in information visualization. In: Proceedings of the 2017 CHI conference extended abstracts on human factors in computing systems. pp 1708–1717

Hwang WY, Hu SS (2013) Analysis of peer learning behaviors using multiple representations in virtual reality and their impacts on geometry problem solving. Comput Educ 62:308–319CrossRef

Jonassen DH (2006) Modeling with technology: mindtools for conceptual change. Prentice Hall, Hoboken

Kasik DJ, Troy JJ, Amorosi SR, Murray MO, Swamy SN (2002) Evaluating graphics displays for complex 3d models. IEEE Comput Graph Appl 22(3):56–64CrossRef

Liang HN, Sedig K (2009) Characterizing navigation in interactive learning environments. Interact Learn Environ 17(1):53–75CrossRef

Liang HN, Sedig K (2010a) Can interactive visualization tools engage and support pre-university students in exploring non-trivial mathematical concepts? Comput Educ 54(4):972–991

Liang HN, Sedig K (2010b) Role of interaction in enhancing the epistemic utility of 3d mathematical visualizations. Int J Comput Math Learn 15:191–224. https://doi.org/10.1007/s10758-010-9165-7

Luo Y, Wang J, Shi R, Liang HN, Luo S (2022) In-device feedback in immersive head-mounted displays for distance perception during teleoperation of unmanned ground vehicles. IEEE Trans Haptics 15(1):79–84. https://doi.org/10.1109/TOH.2021.3138590CrossRef

Luo Y, Wang J, Liang HN, Luo S, Lim EG (2021) Monoscopic versus stereoscopic views and display types in the teleoperation of unmanned ground vehicles for object avoidance. In: 2021 30th IEEE international conference on robot human interactive communication (RO-MAN). pp 418–425. https://doi.org/10.1109/RO-MAN50785.2021.9515455

Lu F, Yu D, Liang HN, Chen W, Papangelis K, Ali NM (2018) Evaluating engagement level and analytical support of interactive visualizations in virtual reality environments. In: 2018 IEEE international symposium on mixed and augmented reality (ISMAR), pp 143–152. https://doi.org/10.1109/ISMAR.2018.00050

Monteiro D, Liang HN, Xu W, Brucker M, Nanjappan V, Yue Y (2018) Evaluating enjoyment, presence, and emulator sickness in vr games based on first- and third- person viewing perspectives. Computer Animation and Virtual Worlds, 29(3-4):e1830. e1830 cav.1830. https://doi.org/10.1002/cav.1830

Nanjappan V, Liang HN, Lu F, Papangelis K, Yue Y, Man KL (2018) User-elicited dual-hand interactions for manipulating 3d objects in virtual reality environments. Hum Centric Comput Inf Sci 8(1):1–16. https://doi.org/10.1186/s13673-018-0154-5CrossRef

Naps TL, Rößling G, Almstrum V, Dann W, Fleischer R, Hundhausen C, Korhonen A, Malmi L, McNally M, Rodger S, et al (2002) Exploring the role of visualization and engagement in computer science education. In: Working group reports from ITiCSE on Innovation and technology in computer science education. pp 131–152

Perlin K, Fox D (1993) Pad: an alternative approach to the computer interface. In: Proceedings of the 20th annual conference on Computer graphics and interactive techniques. pp 57–64

Petersson H, Sinkvist D, Wang C, Smedby Ö (2009) Web-based interactive 3d visualization as a tool for improved anatomy learning. Anat Sci Educ 2(2):61–68CrossRef

Portmann S, Lüthi HP (2000) Molekel: an interactive molecular graphics tool: computational chemistry column. Chimia 54(12):766–766CrossRef

Psotka J (1995) Immersive training systems: virtual reality and education and training. Instr Sci 23(5):405–431CrossRef

Pugh A (1976) Polyhedra: a visual approach. University of California Press, BerkeleyMATHCrossRef

Rauber PE, Fadel SG, Falcao AX, Telea AC (2016) Visualizing the hidden activity of artificial neural networks. IEEE Trans Vis Comput Graph 23(1):101–110CrossRef

Rheingold H (1991) Virtual reality: exploring the brave new technologies. Simon & Schuster Adult Publishing Group, New York

Roberts JC (2007) State of the art: coordinated & multiple views in exploratory visualization. In: Fifth international conference on coordinated and multiple views in exploratory visualization (CMV 2007), IEEE. pp 61–71

Roberts JC, Ritsos PD, Badam SK, Brodbeck D, Kennedy J, Elmqvist N (2014) Visualization beyond the desktop-the next big thing. IEEE Comput Graph Appl 34(6):26–34CrossRef

Ruddle RA, Payne SJ, Jones DM (1999) Navigating large-scale virtual environments: What differences occur between helmet-mounted and desk-top displays? Presence 8(2):157–168CrossRef

Scott DM (1992) Envisioning information

Sedig K, Liang HN (2006) Interactivity of visual mathematical representations: factors affecting learning and cognitive processes. J Interact Learn Res 17(2):179–212

Sedig K, Rowhani S, Morey J, Liang H-N (2003) Application of information visualization techniques to the design of a mathematical mindtool: a usability study. Inf Vis 2(3):142–159CrossRef

Sedig K, Rowhani S, Liang H-N (2005) Designing interfaces that support formation of cognitive maps of transitional processes: an empirical study. Interact Comput 17(4):419–452CrossRef

Sedig K, Parsons P, Liang HN, Morey J (2016) Supporting sensemaking of complex objects with visualizations: visibility and complementarity of interactions. Informatics. https://doi.org/10.3390/informatics3040020CrossRef

Sedig K, Parsons P, Liang HN, Morey J (2016) Supporting sensemaking of complex objects with visualizations: visibility and complementarity of interactions. In: Bryant A (ed) Informatics, vol 3. Multidisciplinary Digital Publishing Institute, Basel City, p 20

Sharples S, Cobb S, Moody A, Wilson JR (2008) Virtual reality induced symptoms and effects (VRISE): comparison of head mounted display (HMD), desktop and projection display systems. Displays 29(2):58–69CrossRef

Shneiderman B (1991) Touch screens now offer compelling uses. IEEE Softw 8(2):93–94CrossRef

Shneiderman B (2003) Why not make interfaces better than 3d reality? IEEE Comput Graph Appl 23(6):12–15CrossRef

Smallman HS, John MS, Oonk HM, Cowen MB (2001) Information availability in 2d and 3d displays. IEEE Comput Graph Appl 21(5):51–57CrossRef

Spence R (2007) Information visualization-design for interaction

Spence R (1999) A framework for navigation. Int J Hum Comput Stud 51(5):919–945CrossRef

Spence R (2001) Information visualization, vol 1. Springer, Berlin

St. John M, Cowen MB, Smallman HS, Oonk HM (2001) The use of 2d and 3d displays for shape-understanding versus relative-position tasks. Hum Factors 43(1):79–98CrossRef

Swindells C, Po BA, Hajshirmohammadi I, Corrie B, Dill JC, Fisher BD, and Booth KS (2004) Comparing cave, wall, and desktop displays for navigation and wayfinding in complex 3d models. In: Proceedings computer graphics international, IEEE. pp 420–427

Thomas BH, Demczuk V (2002) Which animation effects improve indirect manipulation? Interact Comput 14(3):211–229CrossRef

Tory M, Kirkpatrick AE, Atkins MS, Moller T (2005) Visualization task performance with 2d, 3d, and combination displays. IEEE Trans Vis Comput Graph 12(1):2–13CrossRef

Vogel D, Casiez G (2012) Hand occlusion on a multi-touch tabletop. In: Proceedings of the SIGCHI conference on human factors in computing systems. pp 2307–2316

Wang X, Monteiro D, Lee L-H, Hui P, Liang H-N (2022) Vibroweight: Simulating weight and center of gravity changes of objects in virtual reality for enhanced realism. In: 2022 IEEE haptics symposium (HAPTICS), pp 1–7. https://doi.org/10.1109/HAPTICS52432.2022.9765609

Wenz S (2009) Beyond-the-desktop interactive visualizations. Trends Inf Vis 54

Wilkinson L (2012) The grammar of graphics. In: Wilkinson L (ed) Handbook of computational statistics. Springer, Berlin, pp 375–414CrossRef

Xia J, Lin W, Jiang G, Wang Y, Chen W, Schreck T (2021) Visual clustering factors in scatterplots. IEEE Comput Graph Appl 41(5):79–89CrossRef

Xia J, Zhang Y, Song J, Chen Y, Wang Y, Liu S (2021) Revisiting dimensionality reduction techniques for visual cluster analysis: an empirical study. IEEE Trans Vis Comput Graph 28(1):529–539CrossRef

Xiao R, Benko H (2016) Augmenting the field-of-view of head-mounted displays with sparse peripheral displays. In: Proceedings of the 2016 CHI conference on human factors in computing systems. pp 1221–1232

Xu W,Liang HN, Yu K, Baghaei N (2021) Effect of gameplay uncertainty, display type, and age on virtual reality exergames. In: Proceedings of the 2021 CHI conference on human factors in computing systems, CHI ’21. Association for computing machinery, New York, NY, USA. https://doi.org/10.1145/3411764.3445801

Yeh AJC (2007) Knowledge construction of 3D geometry in virtual reality microworlds. PhD thesis, Queensland University of Technology

Yoo HY, Cheon SH (2006) Visualization by information type on mobile device. In: Proceedings of the 2006 Asia-Pacific symposium on information visualisation-volume 60, Citeseer. pp 143–146

Yu L, Ouwerling J, Svetachov P, van Hoesel F, van Ooijen P, Kosinka J (2022) Velight: a 3d virtual reality tool for CT based anatomy teaching and training. J Vis 25:293–306. https://doi.org/10.1007/s12650-021-00790-yCrossRef

Yuan J, Chen C, Yang W, Liu M, Xia J, Liu S (2021) A survey of visual analytics techniques for machine learning. Comput Vis Media 7(1):3–36CrossRef

Yu D, Lu X, Shi R, Liang HN, Dingler T, Velloso E, Goncalves J (2021) Gaze-supported 3d object manipulation in virtual reality. CHI ’21. Association for computing machinery, New York, NY, USA. https://doi.org/10.1145/3411764.3445343

Title: Effect of display platforms on spatial knowledge acquisition and engagement: an evaluation with 3D geometry visualizations
Authors: Feiyu Lu
Vijayakumar Nanjappan
Paul Parsons
Lingyun Yu
Hai-Ning Liang
Publication date: 13-10-2022
Publisher: Springer Berlin Heidelberg
Published in: Journal of Visualization / Issue 3/2023
Print ISSN: 1343-8875
Electronic ISSN: 1875-8975
DOI: https://doi.org/10.1007/s12650-022-00889-w

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Wirtschaft"

Springer Professional "Technik"

Other articles of this Issue 3/2023

Optical measurement and visualization of transonic airflow in a compressor blade cascade

Interactive similar patient retrieval for visual summary of patient outcomes

iHELP: interactive hierarchical linear projections for interpreting non-linear projections

Visual analytics of potential dropout behavior patterns in online learning based on counterfactual explanation

An intelligent approach to automatically discovering visual insights

Towards better pattern enhancement in temporal evolving set visualization

Premium Partner