Top

Empirical Software Engineering

Published in:

01-12-2022

The human experience of comprehending source code in virtual reality

Authors: James Dominic, Brock Tubre, Deborah Kunkel, Paige Rodeghero

Published in: Empirical Software Engineering | Issue 7/2022

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

Virtual reality (VR) is an emerging technology used in various domains such as medicine, psychotherapy, architecture, and gaming. Recently, software engineering researchers have started to explore virtual reality as a tool for programmers. However, few studies examine source code comprehension in VR. This paper explores the human experience of comprehending source code in VR and compares it to source code comprehension in a desktop environment. We conducted a study with 26 graduate student programmers. We measured actual productivity, perceived productivity and used the NASA Task Load Index (TLX) survey to measure various factors such as mental demand, physical demand, temporal demand, performance, effort, and frustration. We found that the programmers experienced more physical demand, effort, and overall task load when reading and comprehending code in VR. However, we did not observe any statistically significant differences in the programmers’ measured productivity or perceived productivity between VR and desktop comprehension.

previous article On the usage and development of deep learning compilers: an empirical study on TVM

next article Developing research questions in conversation with the literature: operationalization & tool support

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Abbes M, Khomh F, Gueheneuc YG, Antoniol G (2011) An empirical study of the impact of two antipatterns, blob and spaghetti code, on program comprehension. In: 2011 15Th european conference on software maintenance and reengineering. IEEE, pp 181–190

Afridi AH, Mengash HA (2020) NASA-TLX–based workload assessment for academic resource recommender system. Personal and Ubiquitous Computing, pp 1–19

Akbulut A, Catal C, Yıldız B (2018) On the effectiveness of virtual real- ity in the education of software engineering. Comput Appl Eng Educ 26(4):918–927CrossRef

Aleotti J, Caselli S, Reggiani M (2004) Leveraging on a virtual environment for robot programming by demonstration. Robot Auton Syst 47(2–3):153–161CrossRef

Al-Saiyd NA (2017) Source code comprehension analysis in software maintenance. In: 2017 2nd International Conference on Computer and Communication Systems (ICCCS). IEEE, pp 1–5

Arisholm E, Gallis H, Dyba T, Sjoberg DI (2007) Evaluating pair pro- gramming with respect to system complexity and programmer expertise. IEEE Trans Softw Eng 33(2):65–86CrossRef

Bacher I, Mac Namee B, Kelleher JD (2017) Scoped: visualising the scope chain within source code. In: EuroVis (Short Papers), pp 115–119

Baheti P, Gehringer E, Stotts D (2002) Exploring the efficacy of distributed pair programming. In: Conference on Extreme Programming and Agile Methods. Springer, Berlin, Heidelberg, pp 208–220

Beland L-P, Murphy R (2016) Ill communication: technology, distraction & student performance. Labour Econ 41:61–76CrossRef

Benjamini Y, Hochberg Y (1995) Controlling the false discovery rate: a prac- tical and powerful approach to multiple testing. J R Stat Soc Ser B Methodol 57(1):289–300MATH

Bierbaum A, Just C, Hartling P, Meinert K, Baker A, Cruz-Neira C (2001) VR Juggler: A virtual platform for virtual reality application development. In: Proceedings IEEE Virtual Reality 2001. IEEE, pp 89–96

Binet A (1904) Spearman the proof and measurement of association between two things; general intelligence objectively determined and measured. Lánnèe Psychologique 11(1):623–624

Blok M, De Korte E, Groenesteijn L, Formanoy M, Vink P (2009) The effects of a task facilitating working environment on office space use, communication, concentration, collaboration, privacy and distraction. In: Proceedings of the 17th World Congress on Ergonomics (IEA 2009), 9–14 August 2009. International Ergonomics Association, Beijing

Bordegoni M, Ferrise F (2013) Designing interaction with consumer prod- ucts in a multisensory virtual reality environment. Virtual and Physical Prototyping 8(1):51–64. https://doi.org/10.1080/17452759.2012.762612CrossRef

Boughzala I, de Vreede G-J, Limayem M (2012) Team collaboration in virtual worlds: editorial to the special issue. J Assoc Inf Syst 13(10):6

Bozgeyikli E, Raij A, Katkoori S, Dubey R (2016) Point & teleport locomotion technique for virtual reality. In: Proceedings of the 2016 annual symposium on computer-human interaction in play, pp 205–216

Brynjolfsson E, Horton JJ, Ozimek A, Rock D, Sharma G, TuYe HY (2020) COVID-19 and remote work: An early look at US data (No. w27344). National Bureau of Economic Research

Busjahn T, Bednarik R, Begel A, Crosby M, Paterson JH, Schulte C, Sharif B, Tamm S (2015) Eye movements in code reading: Relaxing the linear order. In: 2015 IEEE 23rd International Conference on Program Comprehension. IEEE, pp 255–265

Campbell GA (2017) Cognitive complexity-a new way of measuring under- standability. Technical Report. SonarSource SA, Switzerland

Castelhano J, Duarte IC, Ferreira C, Duraes J, Madeira H, Castelo-Branco M (2019) The role of the insula in intuitive expert bug detec- tion in computer code: an fmri study. Brain imaging and behavior 13(3):623–637CrossRef

Cecil J, Kauffman S, Gupta A, McKinney V, Pirela-Cruz MM (2021) Design of a human centered computing (HCC) based virtual reality simulator to train first responders involved in the Covid-19 pandemic. In: 2021 IEEE International Systems Conference (SysCon). IEEE, pp 1–7

Cohen J (2013) Statistical power analysis for the behavioral sciences. Routledge, Milton Park

DeLine R, Czerwinski M, Robertson G (2005) Easing program comprehension by sharing navigation data. In: 2005 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC'05). IEEE, pp 241–248

Dominic J, Tubre B, Houser J, Ritter C, Kunkel D, Rodeghero P (2020a) Program comprehension in virtual reality. In: Proceedings of the 28th International Conference on Program Comprehension, pp 391–395

Dominic J, Tubre B, Ritter C, Houser J, Smith C, Rodeghero P (2020b) Remote pair programming in virtual reality. In: 2020 IEEE International Conference on Software Maintenance and Evolution (ICSME). IEEE, pp 406–417

Elliott A, Peiris B, Parnin C (2015a) Virtual reality in software engineer- ing: Affordances, applications, and challenges. In: 2015 IEEE/ACM 37th IEEE International Conference on Software Engineering, vol 2, pp 547–550. https://doi.org/10.1109/ICSE.2015.191

Elliott A, Peiris B, Parnin C (2015b) Virtual reality in software engineering: Affordances, applications, and challenges. In: 2015 IEEE/ACM 37th IEEE International Conference on Software Engineering. IEEE, vol 2, pp 547–550

Fittkau F, Krause A, Hasselbring W (2015) Exploring software cities in virtual reality. In: 2015 ieee 3rd working conference on software visualization (vissoft). IEEE, pp 130–134

Floyd B, Santander T, Weimer W (2017) Decoding the representation of code in the brain: An fMRI study of code review and expertise. In: 2017 IEEE/ACM 39th International Conference on Software Engineering (ICSE). IEEE, pp 175–186

Freeman D, Reeve S, Robinson A, Ehlers A, Clark D, Spanlang B, Slater M (2017) Virtual reality in the assessment, understanding, and treatment of mental health disorders. Psychol Med 47(14):2393–2400CrossRef

Fritz T, Begel A, Müller SC, Yigit-Elliott S, Züger M (2014) Using psycho-physiological measures to assess task difficulty in software development. In: Proceedings of the 36th international conference on software engineering, pp 402–413

Furuyama T, Arai Y, Iio K (1996) Analysis of fault generation caused by stress during software development. In: Achieving Quality in Software. Springer, Boston, pp 14–28

Future of remote work? here’s the reality of working in the metaverse (2022). https://www.euronews.com/next/2022/02/16/what-s-remote-work-like-in-the-metaverse-these-companies-are-building-the-tools-t

Good, J., Brna, P. Program comprehension and authentic measure- ment:: a scheme for analysing descriptions of programs. International Journal of Human-Computer Studies 61(2), 169–185 (2004)

Graham K, Fai S, Dhanda A, Smith L, Tousant K, Wang E, Weigert A (2018) The VR kiosk. In: Digital Cultural Heritage. Springer, Cham, pp 324–336

Grubert J, Ofek E, Pahud M, Kristensson PO, Steinicke F, San-dor C (2018) The office of the future: Virtual, portable, and global. IEEE Comput Graph Appl 38(6):125–133CrossRef

Guerin K, Hager GD (2017) Robot control, training and collaboration in an immersive virtual reality environment. Google Patents US Patent 9:643–314

Gulec U, Yilmaz M, Isler V, O’Connor RV, Clarke P (2018) Adopting virtual reality as a medium for software development process education. In: Proceedings of the 2018 International Conference on Software and System Process, pp 71–75

Häfner P, Häfner V, Ovtcharova J (2013) Teaching methodology for vir- Tual reality practical course in engineering education. Procedia Computer Science 25:251–260CrossRef

Hart SG (2006) NASA-task load index (NASA-TLX); 20 years later. In: Proceedings of the human factors and ergonomics society annual meeting. Sage CA: Los Angeles, CA: Sage publications, vol 50, no. 9, pp 904–908

Hart SG, Staveland LE (1988) Development of nasa-tlx (task load index): results of empirical and theoretical research. In: Advances in Psychology 52:139–183

Hayes A, Johnson K (2019) Cultural embodiment in virtual reality education and training: A reflection on representation of diversity. In: Foundations and Trends in Smart Learning, pp 93–96

Hayes B, Chang Y, Riley G (2018) Controlled unfair adaptive 360 vr video delivery over an MPTCP/QUIC architecture. In: 2018 IEEE International Conference on Communications (ICC). IEEE, pp 1–6

Herz M, Rahe V (2020) Virtual reality becoming part of our lives—assessing consumers’ perceived applicability of virtual reality supported tasks and a critical reflection on the development. In: Augmented Reality and Virtual Reality. Springer, Cham, pp 113–122

Hodges LF, Kooper R, Meyer TC, Rothbaum BO, Opdyke D, Graaff JJD, Williford JS, North MM (1995) Virtual environments for treating the fear of heights. IEEE Comput 28(7):27–34CrossRef

Hoffmann M, Meisen T, Jeschke S (2016) Shifting virtual reality education to the next level–experiencing remote laboratories through mixed reality. In: Engineering Education 4.0:235–249

Hollander M, Wolfe DA, Chicken E (2013 Nonparametric statistical methods. John Wiley & Sons, Hoboken

Hoppe AH, Westerkamp K, Maier S, Camp FVD, Stiefelhagen R (2018) Multi-user collaboration on complex data in virtual and augmented reality. In: International Conference on Human-Computer Interaction. Springer, Cham, pp 258–265

Hossain E, Babar MA, Verner J (2009) How can agile practices minimize global software development co-ordination risks?. In: European Conference on Software Process Improvement. Springer, Berlin, Heidelberg, pp 81–92

HTC Vive Tracker: Vive United States (n.d.) https://www.vive.com/us/vive-tracker/

Jeon C (2015) The virtual flier: The link trainer, flight simulation, and pilot identity. Technol Cult 56:28–53

Johansson M, Roupè M, Viklund Tallgren M (2014) From BIM to VR-Integrating immersive visualizations in the current design process. In: Fusion-Proceedings of the 32nd eCAADe Conference-Volume 2 (eCAADe 2014), pp 261–269

Johnson PM, Kou H, Agustin J, Chan C, Moore C, Miglani J, Zhen S, Doane WE (2003) Beyond the personal software process: Metrics collection and analysis for the differently disciplined. In: 25th International Conference on Software Engineering, 2003. Proceedings. IEEE, pp 641–646

Keating GD (2008) Task effectiveness and word learning in a second language: the involvement load hypothesis on trial. Lang Teach Res 12(3):365–386CrossRef

Kennedy RS, Lane NE, Berbaum KS, Lilienthal MG (1993) Simulator sickness questionnaire: an enhanced method for quantifying simulator sickness. Int J Aviat Psychol 3(3):203–220CrossRef

Khomokhoana PJ, Nel L (2019) Decoding source code comprehension: bottlenecks experienced by senior computer science students. In: Annual Conference of the Southern African Computer Lecturers' Association. Springer, Cham, pp 17–32

Kiger DM (1989) Effects of music information load on a reading comprehen- Sion task. Percept Mot Skills 69(2):531–534CrossRef

Kircher M, Jain P, Corsaro A, Levine D (2001) Distributed extreme programming. Extreme Programming and Flexible Processes in Software Engineering, Italy, pp 66–71

Kreutzberg A (2015) Conveying architectural form and space with virtual reality. https://doi.org/10.52842/conf.ecaade.2015.1.117

Kuo W, Chien WTK, Kim T (1998) Reliability, yield, and stress burn-in: a unified approach for microelectronics systems manufacturing & software development. Springer Science & Business Media, Berlin

Kurumi MKY, Morikawa S (2016) Active and passive haptic training approaches in vr laparoscopic surgery training. Med Meets Virtual Reality 22: NextMed/MMVR22 220:215

LaToza TD, Garlan D, Herbsleb JD, Myers BA (2007) Program comprehension as fact finding. In: Proceedings of the the 6th joint meeting of the European software engineering conference and the ACM SIGSOFT symposium on The foundations of software engineering, pp 361–370

Laver KE, Lange B, George S, Deutsch JE, Saposnik G, Crotty M (2017) Virtual reality for stroke rehabilitation. Cochrane Database Syst Rev (11). https://doi.org/10.1002/14651858.CD008349.pub4

Lohse KR, Hilderman CGE, Cheung KL, Tatla S, Van der Loos HFM (2014) Virtual reality therapy for adults post-stroke: a systematic review and meta-analysis exploring virtual environments and commer- cial games in therapy. PLoS One 9(3):1–13. https://doi.org/10.1371/journal.pone.0093318CrossRef

Ma YF, Lu L, Zhang HJ, Li M (2002) A user attention model for video summarization. In: Proceedings of the tenth ACM international conference on Multimedia, pp 533–542

Martin-Gutierrez J, Martìn-Gutìerrez J, Mora CE, Añorbe-Dìaz B, González-Marrero A (2017) Learning strategies in engineering education using virtual and augmented reality technologies. Eurasia J Math Sci Technol Educ 13(2):297–300CrossRef

Matsas E, Vosniakos G-C (2017) Design of a virtual reality training sys- tem for human–robot collaboration in manufacturing tasks. International Journal on Interactive Design and Manufacturing (IJIDeM) 11(2):139–153CrossRef

Merino L, Bergel A, Nierstrasz O (2018) Overcoming issues of 3D software visualization through immersive augmented reality. In: 2018 IEEE Working Conference on Software Visualization (VISSOFT). IEEE, pp 54–64

Miller C, Rodeghero P, Storey MA, Ford D, Zimmermann T (2021) “How was your weekend?” software development teams working from home during covid-19. In: 2021 IEEE/ACM 43rd International Conference on Software Engineering (ICSE). IEEE, pp 624–636

Muñoz Barón M (2019) A validation of cognitive complexity as a measure of source code understandability. Bachelor's thesis, University of Stuttgart

Mystakidis S (2022) Metaverse. Encyclopedia 2(1):486–497CrossRef

Nazligul MD, Yilmaz M, Gulec U, Gozcu MA, O’Connor RV, Clarke PM (2017) Overcoming public speaking anxiety of software engineers using virtual reality exposure therapy. In European Conference on Software Process Improvement. Springer, Cham, pp 191–202

Nguyen-Duc A, Cruzes DS, Conradi R (2015) The impact of global dispersion on coordination, team performance and software quality–a systematic literature review. Inf Softw Technol 57:277–294CrossRef

O Connor M, Conboy K, Dennehy D (2022) COVID-19 affected remote workers: a temporal analysis of information system development during the pandemic. J Decis Syst 31(3):207–233

Oberhauser R, Lecon C (2017) Gamified Virtual Reality for Program Code Structure Comprehension. International Journal of Virtual Reality 17(2):79–88

Panas T, Berrigan R, Grundy J (2003) A 3d metaphor for software production visualization. In: Proceedings on Seventh International Conference on Information Visualization, 2003. IV 2003. IEEE, pp 314–319

Parsons S, Cobb S (2011) State-of-the-art of virtual reality technologies for children on the autism spectrum. Eur J Spec Needs Educ 26(3):355–366CrossRef

Pearlman DM, Gates NA (2010) Hosting business meetings and special events in virtual worlds: a fad or the future? In: journal of Convention & Event Tourism. Taylor & Francis 11:247–265

Peitek N, Apel S, Parnin C, Brechmann A, Siegmund J (2021) Program comprehension and code complexity metrics: An fmri study. In: 2021 IEEE/ACM 43rd International Conference on Software Engineering (ICSE). IEEE, pp 524–536

Peitek N, Siegmund J, Apel S, Kästner C, Parnin C, Bethmann A, Leich T, Saake G, Brechmann A (2018) A look into programmers’ heads. IEEE Transact Softw Eng 46(4):442–462

Pellas N, Dengel A, Christopoulos A (2020) A scoping review of immer- sive virtual reality in stem education. IEEE Trans Learn Technol 13(4):748–761CrossRef

Petermann F (2011) Frankfurter aufmerksamkeits-inventar 2 (fair-2). Z Psychiatr Psychol Psychother 59(4):325–326

Pimax Vision 8K X (2022). https://pimax.com/product/vision-8k-x/

Pourchera G, Micheletb D, Recanzonec T, Stitic S, Jolivetc E, Barréb J (2018) Interest of virtual reality (vr) simulation for surgical learning: Vr single port sleeve gastrectomy. In: Obesity surgery, vol. 28, pp. 531–531. Springer 233 Spring St, New York, NY 10013 USA

Racz A, Zilizi G (2018) VR aided architecture and interior design. In: 2018 International Conference on Advances in Computing and Communication Engineering (ICACCE). IEEE, pp 11–16

Ralph P, Baltes S, Adisaputri G et al (2020) Pandemic programming. Empir Software Eng 25:4927–4961. https://doi.org/10.1007/s10664-020-09875-y

Rastogi A, Thummalapenta S, Zimmermann T, Nagappan N, Czer-wonka J (2017) Ramp-up journey of new hires: Do strategic practices of software companies influence productivity?. In: Proceedings of the 10th Innovations in Software Engineering Conference, pp 107–111

Regenbrecht H, Schubert T (2002) Real and illusory interactions enhance presence in virtual environments. Presence: Teleoperators & Virtual Environments 11(4):425–434CrossRef

Rodeghero, P., McMillan, C., McBurney, P.W., Bosch, N., D’Mello, S. (2014a) Improving automated source code summarization via an eye-tracking study of programmers. In: Proceedings of the 36th International Confer- ence on Software Engineering. ICSE 2014, pp. 390–401. Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/2568225.2568247

Rodeghero P, McMillan C, McBurney PW, Bosch N, D'Mello S (2014) Improving automated source code summarization via an eye-tracking study of programmers. In: Proceedings of the 36th international conference on Software engineering, pp 390–401

Romano S, Capece N, Erra U, Scanniello G, Lanza M (2019a) On the use of virtual reality in software visualization: the case of the city metaphor. Inf Softw Technol 114:92–106CrossRef

Romano S, Capece N, Erra U, Scanniello G, Lanza M (2019b) The city metaphor in software visualization: feelings, emotions, and thinking. Multimed Tools Appl 78(23):33113–33149CrossRef

Ruvimova A, Kim J, Fritz T, Hancock M, Shepherd DC (2020) "Transport Me Away": Fostering flow in open offices through virtual reality. In: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, pp 1–14

Said S, Gozdzik M, Roche TR, Braun J, Rössler J, Kaserer A, Spahn DR, Nöthiger CB, Tscholl DW et al (2020) Validation of the raw national aeronautics and space administration task load index (nasa-tlx) questionnaire to assess perceived workload in patient monitoring tasks: pooled analysis study using mixed models. J Med Int Res 22(9):19472

Sampaio AZ (2018) Enhancing BIM methodology with VR technology. State of the Art Virtual Reality and Augmented Reality Knowhow, pp 59–79

Sattar MU, Palaniappan S, Lokman A, Shah N, Khalid U, Hasan R (2020) Motivating medical students using virtual reality based education. International Journal of Emerging Technologies in Learning (iJET) 15(02):160–174CrossRef

Schenk J (2018) Industrially usable distributed pair programming. Dissertation, Freie Universität Berlin

Schweizer K (Ed.) (2006) Leistung und Leistungsdiagnostik. Springer Berlin Heidelberg

Sharma VS, Mehra R, Kaulgud V, Podder S (2018) An immersive future for software engineering: avenues and approaches. In: Proceedings of the 40th International Conference on Software Engineering: New Ideas and Emerging Results, pp 105–108

Siegmund J, Kästner C, Apel S, Parnin C, Bethmann A, Leich T, Saake G, Brechmann A (2014) Understanding understanding source code with functional magnetic resonance imaging. In: Proceedings of the 36th international conference on software engineering, pp 378–389

Siegmund J, Peitek N, Parnin C, Apel S, Hofmeister J, Kästner C, Begel A, Bethmann A, Brechmann A (2017) Measuring neural efficiency of program comprehension. In: Proceedings of the 2017 11th Joint Meeting on Foundations of Software Engineering, pp 140–150

Sörqvist P, Dahlström Ö, Karlsson T, Rönnberg J (2016) Concentration: the neural underpinnings of how cognitive load shields against distraction. Front Hum Neurosci 10:221CrossRef

Steinmacher I, Conte TU, Treude C, GerosaMA (2016) Overcoming open source project entry barriers with a portal for newcomers. In: Proceedings of the 38th International Conference on Software Engineerin, pp 273–284

Takala TM (2014) RUIS: A toolkit for developing virtual reality applications with spatial interaction. In: Proceedings of the 2nd ACM symposium on Spatial user interaction, pp 94-103

Taxén G, Naeve A (2002) A system for exploring open issues in vr-based education. Comput Graph 26(4):593–598CrossRef

The world’s leading online programming learning platform (n.d.) https://leetcode.com/

TLX @ NASA Ames - NASA TLX App. NASA (n.d.) https://humansystems. arc.nasa.gov/groups/tlx/tlxapp.php

Tvarozek J, Konopka M, Navrat P, Bielikova M (2016) Studying various source code comprehension strategies in programming education. Eye Movements in Programming: Models to Data 23:25–26

Ullrich S, Kuhlen T (2012) Haptic palpation for medical simulation in vir- Tual environments. IEEE Trans Vis Comput Graph 18(4):617–625CrossRef

Ultraleap: Tracking: Leap Motion controller (n.d.) https://www.ultraleap. com/product/leap-motion-controller/

Upwork Study Finds 22% of American Workforce Will Be Remote by 2025: Upwork (2020) https://www.upwork.com/press/releases

van Berlo ZM, van Reijmersdal EA, Smit EG, van der Laan LN (2021) Brands in virtual reality games: affective processes within computer- mediated consumer experiences. J Bus Res 122:458–465CrossRef

Vincur J, Konopka M, Tvarozek J, Hoang M, Navrat P (2017) Cubely: virtual reality block-based programming environment. In: Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology, pp 1–2

Vive Pro 2 - the best VR headset in the metaverse: United States (n.d.) https://www.vive.com/us/product/vive-pro2/overview/

W3Schools free online web tutorials (n.d.) https://www.w3schools.com/

Wang P, Wu P, Wang J, Chi H-L, Wang X (2018) A critical review of the use of virtual reality in construction engineering education and training. Int J Environ Res Public Health 15(6):1204CrossRef

Wiese ES, Rafferty AN, Fox A (2019) Linking code readability, structure, and comprehension among novices: it's complicated. In: 2019 IEEE/ACM 41st International Conference on Software Engineering: Software Engineering Education and Training (ICSE-SEET). IEEE, pp 84–94

Williams L, Kessler RR, Cunningham W, Jeffries R (2000) Strengthening the case for pair programming. IEEE Softw 17(4):19–25CrossRef

Wolfgramm C, Suter N, Göksel E (2016) Examining the role of concentra- tion, vocabulary and self-concept in listening and reading comprehen- sion. Int J Listen 30(1–2):25–46CrossRef

Workrooms: VR for business meetings (n.d.) https://www.oculus.com/workrooms/

Yekutieli D, Benjamini Y (1999) Resampling-based false discovery rate con- trolling multiple test procedures for correlated test statistics. Journal of Statistical Planning and Inference 82(1–2):171–196MathSciNetMATHCrossRef

Zirkelbach C, Krause A, Hasselbring W (2019) Hands-on: experiencing software architecture in virtual reality

Title: The human experience of comprehending source code in virtual reality
Authors: James Dominic
Brock Tubre
Deborah Kunkel
Paige Rodeghero
Publication date: 01-12-2022
Publisher: Springer US
Published in: Empirical Software Engineering / Issue 7/2022
Print ISSN: 1382-3256
Electronic ISSN: 1573-7616
DOI: https://doi.org/10.1007/s10664-022-10196-5

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Springer Professional "Technik"

Springer Professional "Wirtschaft+Technik"

Other articles of this Issue 7/2022

An empirical study of Android behavioural code smells detection

Static test flakiness prediction: How Far Can We Go?

StateAFL: Greybox fuzzing for stateful network servers

The role of bug report evolution in reliable fixing estimation

Developers’ perception matters: machine learning to detect developer-sensitive smells

Sources of software development task friction

Premium Partner