Top

TechTrends

Published in:

20-01-2024 | Original Paper

The Museum of Instructional Design: an Examination of Learner Experiences & Usability in a Collaborative 3D Virtual Learning Environment

Authors: Noah Glaser, Mohan Yang, Shangman Eunice Li, K. Rende Mendoza

Published in: TechTrends | Issue 2/2024

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

This study examines learner experiences in the Museum of Instructional Design (MID), a 3D Virtual Learning Environment (VLE) developed using Mozilla Spoke and Hubs, focusing on Instructional Design and Technology (IDT) education. The MID utilizes a museum theme as a fundamental design element and allows learners to interact, converse, and develop exhibits to represent the IDT field. Leveraging a multi-phase, multi-method approach, we analyzed the usability and learner experiences within the MID, gathering data via expert evaluations and student interviews. The results highlight the engaging and immersive nature of the MID, while also addressing the technical challenges and varying levels of comfort with technology among learners. The study further proposes several recommendations for course design in 3D immersive environments, underscoring the importance of learner autonomy, clear expectations, tiered challenges, and responsive instruction. The implications of these findings emphasize the potential of 3D VLEs in transforming IDT education and other fields.

previous article Use of Visual Prompts as a Pedagogical Strategy to Reduce Digital Distraction in College Classes

next article The Teaching Methods Classroom Meets Virtual Reality: Insights for Pre-Service Teaching Methods Instructors

Available only for authorised users

Ashtari, N., Bunt, A., McGrenere, J., Nebeling, M., & Chilana, P. K. (2020). Creating augmented and virtual reality applications: Current practices, challenges, and opportunities. In Proceedings of the 2020 CHI conference on human factors in computing systems (pp. 1–13). https://doi.org/10.1145/3313831.3376722

Baceviciute, S., Terkildsen, T., & Makransky, G. (2021). Remediating learning from non-immersive to immersive media: Using EEG to investigate the effects of environmental embeddedness on reading in Virtual Reality. Computers & Education, 164, 104122. https://doi.org/10.1016/j.compedu.2020.104122

Bredikhina, L., Sakaguchi, T., & Shirai, A. (2020). Web3D Distance live workshop for children in Mozilla Hubs. The 25th International Conference on 3D Web Technology, 1–2. https://doi.org/10.1145/3424616.3424724

Brown, R., Habibi-Luevano, S., Robern, G., Wood, K., Perera, S., Uribe-Quevedo, A., ..., & Tokuhiro, A. (2021). Employing mozilla hubs as an alternative tool for student outreach: A design challenge use case. In Interactive Mobile Communication, Technologies and Learning (pp. 213–222). Cham: Springer International Publishing. https://doi.org/10.1007/978-3-030-96296-8_20

Caprara, L., & Caprara, C. (2022) Effects of virtual learning environments: A scoping review of literature. Education and Information Technologies 27, 3683–3722. https://doi.org/10.1007/s10639-021-10768-w

Cecotti, H. (2022). Cultural heritage in fully immersive virtual reality. In Virtual Worlds, 1(1), 82–102. MDPI. https://doi.org/10.3390/virtualworlds1010006

Cheng, Y., & Wang, S.-H. (2011). Applying a 3D virtual learning environment to facilitate student’s application ability – The case of marketing. Computers in Human Behavior, 27(1), 576–584. https://doi.org/10.1016/j.chb.2010.10.008CrossRef

Chessa, M., & Solari, F. (2021). The sense of being there during online classes: Analysis of usability and presence in web-conferencing systems and virtual reality social platforms. Behaviour & Information Technology, 40(12), 1237–1249. https://doi.org/10.1080/0144929X.2021.1957017CrossRef

Chong, H. T., Lim, C. K., Ahmed, M. F., Tan, K. L., & Mokhtar, M. B. (2021). Virtual reality usability and accessibility for cultural heritage practices: Challenges mapping and recommendations. Electronics, 10(12), 1430.CrossRef

Cook, M., Lischer-Katz, Z., Hall, N., Hardesty, J., Johnson, J., McDonald, R., & Carlisle, T. (2019). Challenges and strategies for educational virtual reality. Information Technology and Libraries, 38(4), 25–48.CrossRef

Dalgarno, B., & Lee, M. J. W. (2010). What are the learning affordances of 3-D virtual environments? British Journal of Educational Technology, 41(1), 10–32. https://doi.org/10.1111/j.1467-8535.2009.01038.xCrossRef

Dengel, A., & Mägdefrau, J. (2018). Immersive learning explored: Subjective and objective factors influencing learning outcomes in immersive educational virtual environments. In 2018 IEEE international conference on teaching, assessment, and learning for engineering (TALE) (pp. 608–615). IEEE. https://doi.org/10.1109/TALE.2018.8615281

Denoyelles, A., & Seo, K.K.-J. (2012). Inspiring equal contribution and opportunity in a 3d multi-user virtual environment: Bringing together men gamers and women non-gamers in Second Life®. Computers & Education, 58(1), 21–29.CrossRef

Eriksson, T. (2021). Failure and success in using Mozilla Hubs for online teaching in a movie production course. https://doi.org/10.23919/iLRN52045.2021.9459321

Fowler, C. (2015). Virtual reality and learning: Where is the pedagogy? British Journal of Educational Technology, 46(2), 412–422. https://doi.org/10.1111/bjet.12135

Glaser, N., & Schmidt, M. (2022). Systematic literature review of virtual reality intervention design patterns for individuals with autism spectrum disorders. International Journal of Human–Computer Interaction, 38(8), 753–788. https://doi.org/10.1080/10447318.2021.1970433

Glaser, N., AlZoubi, D., Earnshaw, Y., Shaffer, E. L., & Yang, M. (2022). Formative design and development of a three-dimensional collaborative virtual learning environment through learning experience design methods. Journal of Formative Design in Learning. https://doi.org/10.1007/s41686-022-00072-2

Glaser, N., Schmidt, M., Schmidt, C., Palmer, H., & Beck, D. (2021). The centrality of interdisciplinarity for overcoming design and development constraints of a multi-user virtual reality intervention for adults with autism: A design case. In B. Hokanson, M. Exter, A. Grincewicz, M. Schmidt, & A. A. Tawfik (Eds.), Intersections across disciplines: Interdisciplinarity and learning (pp. 157–171). Springer International Publishing. https://doi.org/10.1007/978-3-030-53875-0_13CrossRef

Grady, D. J. (2017). A critical review of the application of Kolb’s experiential learning theory applied through the use of computer based simulations within virtual environments 2000–2016. State University of New York at Albany.

Hammond, T., Watson, K., Brumbelow, K., Fields, S., Shryock, K., Chamberland, J. F., ..., & Herbert, B. (2020). A survey to measure the effects of forced transition to 100% online learning on community sharing, feelings of social isolation, equity, resilience, and learning content during the COVID-19 pandemic. https://hdl.handle.net/1969.1/187835

Herman, K., Shifflett, J. S., Schoolmaster, C. W., Thull, C., & Glaser, N. (2022). Past precedent: Reconciling established multimedia principles in 3D virtual learning environments. The Journal of Applied Instructional Design, 11(4). https://edtechbooks.org/jaid_11_4/WnbVMBth

Honebein, P. C., & Reigeluth, C. M. (2021). To prove or improve, that is the question: The resurgence of comparative, confounded research between 2010 and 2019. Educational Technology Research and Development, 69(2), 465–496. https://doi.org/10.1007/s11423-021-09988-1CrossRef

Joyce, A. (2021). 10 usability heuristics applied to virtual reality. Nielsen Norman Group. https://www.nngroup.com/articles/usability-heuristics-virtual-reality/

Kauffman H. (2015). A review of predictive factors of student success in and satisfaction with online learning. Research in Learning Technology, 23. https://doi.org/10.3402/rlt.v23.26507

Kavanagh, S., Luxton-Reilly, A., Wuensche, B., & Plimmer, B. (2017). A systematic review of virtual reality in education. Themes in Science and Technology Education, 10(2), 85–119.

Khlaisang, J., & Mingsiritham, K. (2016). Engaging virtual learning environment system to enhance communication and collaboration skills among ASEAN higher education learners. International Journal of Emerging Technologies in Learning, 11(4). https://doi.org/10.3991/ijet.v11i04.5503

Krajčovič, M., Gabajová, G., Matys, M., Grznár, P., Dulina, Ľ, & Kohár, R. (2021). 3D interactive learning environment as a tool for knowledge transfer and retention. Sustainability, 13(14), 7916.CrossRef

Kushniruk, A. W., Borycki, E. M., Kuwata, S., & Ho, F. (2008). Emerging approaches to evaluating the usability of health information systems. Human, Social, and Organizational Aspects of Health Information Systems, 1–22. https://doi.org/10.4018/978-1-59904-792-8.ch001

Le, D. A., Maclntyre, B., & Outlaw, J. (2020). Enhancing the experience of virtual conferences in social virtual environments. 2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), 485–494. https://doi.org/10.1109/VRW50115.2020.00101

Lee, K., Fanguy, M., Lu, X. S., & Bligh, B. (2021). Student learning during COVID-19: It was not as bad as we feared. Distance Education, 42(1), 164–172.CrossRef

Lege, R., & Bonner, E. (2020). Virtual reality in education: The promise, progress, and challenge. Jalt Call Journal, 16(3), 167–180.CrossRef

Lewis, J. R. (2018). Measuring perceived usability: The CSUQ, SUS, and UMUX. International Journal of Human-Computer Interaction, 34(12), 1148–1156.CrossRef

Lowenthal, P., Borup, J., West, R., & Archambault, L. (2020). Thinking beyond Zoom: Using asynchronous video to maintain connection and engagement during the COVID-19 pandemic. Journal of Technology and Teacher Education, 28(2), 383–391.

Lundgren, L., Stofer, K. A., Dunckel, B. A., Krieger, J., Lange, M., & James, V. (2019). Panel-based exhibit using participatory design elements may motivate behavior change. Journal of Science Communication, 18(2), 1.CrossRef

McInnerney, J. M., & Roberts, T. S. (2004). Online learning: Social interaction and the creation of a sense of community. Journal of Educational Technology & Society, 7(3), 73–81.

Miller, K., Capan, M., Weldon, D., Noaiseh, Y., Kowalski, R., Kraft, R., Schwartz, S., Weintraub, W. S., & Arnold, R. (2018). The design of decisions: Matching clinical decision support recommendations to Nielsen’s design heuristics. International Journal of Medical Informatics, 117, 19–25.CrossRefPubMedPubMedCentral

Nevelsteen, K. J. (2018). Virtual world, defined from a technological perspective and applied to video games, mixed reality, and the Metaverse. Computer Animation and Virtual Worlds, 29(1), e1752.CrossRef

Nielsen, J. (1994). 10 Usability Heuristics for User Interface Design. Nielsen Norman Group. https://www.nngroup.com/articles/ten-usability-heuristics/

Palvia, S., Aeron, P., Gupta, P., Mahapatra, D., Parida, R., Rosner, R., & Sindhi, S. (2018). Online education: Worldwide status, challenges, trends, and implications. Journal of Global Information Technology Management, 21(4), 233–241. https://doi.org/10.1080/1097198X.2018.1542262CrossRef

Petrina, S., & Zhao, J. J. (2021). 3D Virtual learning environment for acquisition of cultural competence: Experiences of instructional designers. In Handbook of research on teaching with virtual environments and AI (pp. 17–42). IGI Global.

Phillippi, J., & Lauderdale, J. (2018). A guide to field notes for qualitative research: Context and conversation. Qualitative Health Research, 28(3), 381–388.CrossRefPubMed

Pinelle, D., Wong, N., Stach, T., & Gutwin, C. (2009). Usability heuristics for networked multiplayer games. In Proceedings of the 2009 ACM International Conference on Supporting Group Work (pp. 169–178). https://doi.org/10.1145/1531674.1531700

Ritzhaupt, A. D., Kumar, S., & Martin, F. (2021). The competencies for instructional designers in higher education. A Practitioner's Guide to Instructional Design in Higher Education. EdTech Books. https://edtechbooks.org/-uYhb

Schmidt, M., & Glaser, N. (2021). Investigating the usability and learner experience of a virtual reality adaptive skills intervention for adults with autism spectrum disorder. Educational Technology Research and Development, 69(3), 1665–1699. ERIC.CrossRef

Schmidt, M. M., Lee, M., Francois, M.-S., Lu, J., Huang, R., Cheng, L., & Weng, Y. (2023). Learning experience design of project PHoENIX: Addressing the lack of autistic representation in extended reality design and development. Journal of Formative Design in Learning. https://doi.org/10.1007/s41686-023-00077-5CrossRefPubMedPubMedCentral

Scott, E., & Campo, M. (2023). An adaptive 3D virtual learning environment for training software developers in scrum. Interactive Learning Environments, 31(8), 5200–5218. https://doi.org/10.1080/10494820.2021.1999985

Seifert, A., & Schlomann, A. (2021). The use of virtual and augmented reality by older adults: Potentials and challenges. Frontiers in Virtual Reality, 2, 639718.CrossRef

Shelton, A. (2013). Critical museology: A manifesto. Museum Worlds, 1(1), 7–23.

Strauss, A., & Corbin, J. (1990). Basics of qualitative research. Sage Publications.

Suri, H. (2011). Purposeful sampling in qualitative research synthesis. Qualitative Research Journal, 11(2), 63–75. https://doi.org/10.3316/QRJ1102063CrossRef

Tam, M. (2000). Constructivism, instructional design, and technology: Implications for transforming distance learning. Journal of Educational Technology & Society, 3(2), 50–60.

Taylor, M., Taylor, D., Kulendran, M., Gately, P., & Darzi, A. (2013). Virtual worlds as a tool to facilitate weight management for young people. Journal of Virtual Worlds Research, 6(1). https://doi.org/10.4101/jvwr.v6i1.7026

Thompson, A., Elahi, F., Realpe, A., Birchwood, M., Taylor, D., Vlaev, I., ..., & Bucci, S. (2020). A feasibility and acceptability trial of social cognitive therapy in early psychosis delivered through a virtual world: The VEEP study. Frontiers in Psychiatry, 11, 219. https://doi.org/10.3389/fpsyt.2020.00219

Vermeeren, A. P., Law, E. L. C., Roto, V., Obrist, M., Hoonhout, J., & Väänänen-Vainio-Mattila, K. (2010). User experience evaluation methods: Current state and development needs. In Proceedings of the 6th Nordic conference on human-computer interaction: Extending boundaries (pp. 521–530). https://doi.org/10.1145/1868914.1868973

Wang, X., Chen, Y., Ritzhaupt, A. D., & Martin, F. (2021). Examining competencies for the instructional design professional: An exploratory job announcement analysis. International Journal of Training and Development, 25(2), 95–123.CrossRef

Warburton, S. (2009). Second Life in higher education: Assessing the potential for and the barriers to deploying virtual worlds in learning and teaching. British Journal of Educational Technology, 40(3), 414–426.CrossRef

Yoshimura, A., & Borst, C. W. (2020). Evaluation and comparison of desktop viewing and headset viewing of remote lectures in vr with mozilla hubs. In International Conference on Artificial Reality and Telexistence, and Eurographics Symposium on Virtual Environments (ICAT-EGVE), 2020. https://doi.org/10.2312/egve.20201259

Title: The Museum of Instructional Design: an Examination of Learner Experiences & Usability in a Collaborative 3D Virtual Learning Environment
Authors: Noah Glaser
Mohan Yang
Shangman Eunice Li
K. Rende Mendoza
Publication date: 20-01-2024
Publisher: Springer US
Published in: TechTrends / Issue 2/2024
Print ISSN: 8756-3894
Electronic ISSN: 1559-7075
DOI: https://doi.org/10.1007/s11528-024-00933-6

Springer Professional

The Museum of Instructional Design: an Examination of Learner Experiences & Usability in a Collaborative 3D Virtual Learning Environment

Abstract

Premium Partner

Springer Professional

Abstract

Please log in to get access to your license.

Other articles of this Issue 2/2024

Be Part of the Conversation

Understanding College Students’ Behavioral Patterns in a Blended Learning Class

Exploring Faculty Perceptions of Outsourced Professional Development for Online Teaching and Learning

Towards a Framework for a Nation-Wide Implementation of Augmented, Virtual and Mixed Reality in K-12 Technical and Vocational Education

ChatGPT in K-12 Education

Predicting Special Educators’ Use of Assistive Technology in Virtual & Hybrid Learning Environments