Abstract
Although AR technology seems to be promising for helping students learn complicated and abstract concepts, whether the positive effects of this new technology can be applied to the learning of three-dimensional geometric concepts, and what factors might mediate its effectiveness are questions worth further investigation. This study used the eye-tracking method to examine middle school students’ learning of three-dimensional geometric concepts with AR-based instruction in comparison with a group of students who learned via paper-based instruction. Motivation and conceptual achievements were assessed using the Instructional Materials Motivation Survey (IMMS) questionnaire and Geometry Achievement Test (GAT), respectively. The results showed that while AR learners performed the same as the paper-based learners in the post concept test, the two groups differed significantly in terms of their motivation orientations and visual attention patterns. AR students were more satisfied with and engaged more in the corresponding instruction. To explore in-depth the effectiveness of the AR system, the AR participants were divided into improved and unimproved learners. The former displayed higher confidence in and perceived greater relevance of the AR instruction. Their attention to and engagement in the simple geometric concepts was higher. Correlation and regression analyses indicated that the performance of paper-based learners was affected by their visual attention, while the performance of the AR learners was predicted by their beliefs in the relevance of the material to the learning goals. Noticeably, for the AR learners, their motivation was significantly associated with their visual attention.
Similar content being viewed by others
References
Altmeyer, K., Kapp, S., Thees, M., Malone, S., Kuhn, J., & Brunken, R. (2020). The use of augmented reality to foster conceptual knowledge acquisition in STEM laboratory courses—Theoretical backing and empirical results. British Journal of Educational Technology. https://doi.org/10.1111/bjet.12900
Amir, M. F., Fediyanto, N., Rudyanto, H. E., Afifah, D. S. N., & Tortop, H. S. (2020). Elementary students’ perceptions of 3Dmetric: A cross-sectional study. Heliyon, 6(6), e04052.
Arici, F., Yildirim, P., Caliklar, Ş, & Yilmaz, R. M. (2019). Research trends in the use of augmented reality in science education: Content and bibliometric mapping analysis. Computers & Education, 142, 103647. https://doi.org/10.1016/j.compedu.2019.103647
Arvanitaki, M., & Zaranis, N. (2020). The use of ICT in teaching geometry in primary school. Education and Inforamtion Technology, 25, 5003–5016. https://doi.org/10.1007/s10639-020-10210-7
Arvanitis, T. N., Petrou, A., Knight, J. F., Savas, S., Sotiriou, S., Gargalakos, M., & Gialouri, E. (2009). Human factors and qualitative pedagogical evaluation of a mobile augmented reality system for science education used by learners with physical disabilities. Personal and Ubiquitous Computing, 13(3), 243–250.
Avci, S. K., Stavroulia, K. E., & Lanitis, A. (2019). The effect of three dimensional virtual environments and augmented reality applications on the learning achievement: A meta-analysis study. Egitim Ve Bilim, 44, 149–182.
Azcona, D., Hsiao, I. H., & Smeaton, A. F. (2018). Modelling math learning on an open access intelligent tutor. In International conference on artificial intelligence in education (pp. 36–40). Springer.
Azuma, R. T. (1997). A survey of augmented reality. Presence—Teleoperators and Virtual Environments, 6(4), 355–385.
Barrett, P. (2001). Assessing the reliability of rating data. Retrieved May 29, 2019, from http://www.pbarrett.net/presentations/rater.pdf
Bhagat, K. K., & Chang, C.-Y. (2015). Incorporating GeoGebra into Geometry learning—A lesson from India. Eurasia Journal of Mathematics, Science & Technology Education, 11(1), 77–86.
Bhagat, K. K., Chang, C. N., & Chang, C. Y. (2016). The impact of the flipped classroom on mathematics concept learning in high school. Journal of Educational Technology & Society, 19(3), 134–142.
Bhagat, K. K., Liou, W.-K., Spector, J. M., & Chang, C.-Y. (2019). To use augmented reality or not in formative assessment: A comparative study. Interactive Learning Environments, 27(5–6), 830–840. https://doi.org/10.1080/10494820.2018.1489857
Biagi, F., & Loi, M. (2013). Measuring ICT use and learning outcomes: Evidence from recent econometric studies. European Journal of Education, 48(1), 28–42.
Cahyono, A. N., Sukestiyarno, Y. L., & Asikin, M. (2020). Learning mathematical modelling with augmented reality mobile math trails program: How can it work? Journal on Mathematics Education, 11(2), 181–192.
Cai, S., Liu, E., Yang, Y., & Liang, J.-C. (2019). Table-based AR technology: Impacts on students’ conceptions and approaches to learning mathematics according to their self-efficacy. British Journal of Educational Technology, 50, 248–263.
Chang, R.-C., Chung, L.-Y., & Huang, Y.-M. (2016). Developing an interactive augmented reality system as a complement to plant education and comparing its effectiveness with video learning. Interactive Learning Environments, 24(6), 1245–1264. https://doi.org/10.1080/10494820.2014.982131
Chen, Y. C., & Yang, F. Y. (2014). Probing the relationship between process of spatial problems solving and science learning: An eye tracking approach. International Journal of Science and Mathematics Education, 12(3), 579–603.
Chuang, H. H., & Liu, H. C. (2012). Effects of different multimedia presentations on viewers’ information-processing activities measured by eye-tracking technology. Journal of Science Education and Technology, 21(2), 276–286.
de Ravé, E. G., Jiménez-Hornero, F. J., Ariza-Villaverde, A. B., & Taguas-Ruiz, J. (2016). DiedricAR: A mobile augmented reality system designed for the ubiquitous descriptive geometry learning. Multimedia Tools and Applications, 75(16), 9641–9663.
Demitriadou, E., Stavroulia, K. E., & Lanitis, A. (2020). Comparative evaluation of virtual and augmented reality for teaching mathematics in primary education. Education and Information Technology, 25, 381–401.
Di Serio, A., Ibanez, M. B., & Kloos, C. D. (2013). Impact of an augmented reality system on students’ motivation for a visual art course. Computers & Education, 68, 586–596. https://doi.org/10.1016/j.compedu.2012.03.002
Dunn, T. J., & Kennedy, M. (2019). Technology Enhanced Learning in higher education; motivations, engagement and academic achievement. Computers & Education, 137, 104–113. https://doi.org/10.1016/j.compedu.2019.04.004
Ewais, A., & Troyer, O. D. (2019). A usability and acceptance evaluation of the use of augmented reality for learning atoms and molecules reaction by primary school female students in Palestine. Journal of Educational Computing Research, 57(7), 1643–1670. https://doi.org/10.1177/0735633119855609
Ferrer-Torregrosa, J., Jiménez-Rodríguez, M. Á., Torralba-Estelles, J., Garzón-Farinós, F., Pérez-Bermejo, M., & Fernández-Ehrling, N. (2016). Distance learning ECTS and flipped classroom in the anatomy learning: Comparative study of the use of augmented reality, video and notes. BMC Medical Education, 16(1), 230.
Fidan, M., & Tuncel, M. (2019). Integrating augmented reality into problem based learning: The effects on learning achievement and attitude in physics education. Computers & Education, 142, 103635. https://doi.org/10.1016/j.compedu.2019.103635
Freitas, R., & Campos, P. (2008). SMART: A SysteM of Augmented Reality for Teaching 2nd grade students. In Proceedings of the 22nd British HCI group annual conference on people and computers: Culture, creativity, interaction (Vol. 2, pp. 27–23), Swinton, UK.
Georgiou, Y., & Kyza, E. A. (2018). Relations between student motivation, immersion and learning outcomes in location-based augmented reality settings. Computers in Human Behavior, 89, 173–181. https://doi.org/10.1016/j.chb.2018.08.011
Guay, F., Chanal, J., Ratelle, C. F., Marsh, H. W., Larose, S., & Boivin, M. (2010). Intrinsic, identified, and controlled types of motivation for school subjects in young elementary school children. British Journal of Educational Psychology, 80, 711–735. https://doi.org/10.1348/000709910X499084
Gutierrez, A. (1996). Visualization in 3-dimensional geometry: In search of a framework. In L. Puig & A. Gutierrez (Eds.), Proceedings of the 20th conference of the International Group for the Psychology of Mathematics Education (Vol. 1, pp. 3–19). Universidad de Valencia.
Hauze, S., & Marshall, J. (2020). Validation of the instructional materials motivation survey: Measuring student motivation to learn via mixed reality nursing education simulation. International Journal on E-Learning, 19(1), 49–64.
Hsiao, H.-S., Chang, C.-S., Lin, C.-Y., & Wang, Y.-Z. (2016). Weather observers: A manipulative augmented reality system for weather simulations at home, in the classroom, and at a museum. Interactive Learning Environments, 24(1), 205–223. https://doi.org/10.1080/10494820.2013.834829
Hsieh, M.-C., & Chen, S.-H. (2019). Intelligence augmented reality tutoring system for mathematics teaching and learning. Journal of Internet Technology, 20, 1673–1681.
Ibáñez, M. B., & Delgado, K. C. (2018). Augmented reality for STEM learning: A systematic review. Computers & Education, 123, 109–123. https://doi.org/10.1016/j.compedu.2018.05.002
Ibáñez, M. B., Portillo, A. U., Cabada, R. Z., & Barrón, M. L. (2020). Impact of augmented reality technology on academic achievement and motivation of students from public and private Mexican schools. A case study in a middle-school geometry course. Computers & Education, 145, 103734.
Jagušt, T., Botički, I., & So, H.-J. (2018). Examining competitive, collaborative and adaptive gamification in young learners’ math learning. Computers & Education, 125, 444–457. https://doi.org/10.1016/j.compedu.2018.06.022
Just, M. A., & Carpenter, P. A. (1980). A theory of reading: From eye fixations to comprehension. Psychological Review, 87(4), 329.
Keller, J. M. (2010). Motivational design for learning and performance: The ARCS model approach. Springer.
Lai, M. L., Tsai, M. J., Yang, F. Y., Hsu, C. Y., Liu, T. C., Lee, S. W. Y., Lee, M. H., Ghiou, G. L., Liang, J. C., & Tsai, C. C. (2013). A review of using eye tracking technology in exploring learning. Educational Research Review, 10, 90–115.
Lenhard, W., Schroeders, U., & Lenhard, A. (2017). Equivalence of screen versus print reading comprehension depends on task complexity and proficiency. Discourse Processes, 54(5–6), 427–445. https://doi.org/10.1080/0163853X.2017.1319653
Liou, W.-K., Bhagat, K. K., & Chang, C.-Y. (2016). Beyond the flipped classroom: A highly interactive cloud-classroom (HIC) embedded into basic materials science courses. Journal of Science Education and Technology, 25(3), 460–473. https://doi.org/10.1007/s10956-016-9606-8
Loorbach, N., Peters, O., Karreman, J., & Steehouder, M. (2015). Validation of the Instructional Materials Motivation Survey (IMMS) in a self-directed instructional setting aimed at working with technology. British Journal of Educational Technology, 46(1), 204–218.
Mayer, R. E. (2019). How multimedia can improve learning and instruction. In J. Dunlosky & K. A. Rawson (Eds.), The Cambridge handbook of cognition and education (pp. 460–479). Cambridge University Press. https://doi.org/10.1017/9781108235631.019
Mayer, R. E. (2001). Multimedia learning. Cambridge University Press.
Milgram, P., Takemura, H., Utsumi, A., & Kishino, F. (1994). Augmented reality: A class of displays on the reality-virtuality continuum. Proceedings the SPIE: Telemanipulator and Telepresence Technologies, 2351, 282–292.
Molina, A. I., Navarro, Ó., Ortega, M., & Lacruz, M. (2018). Evaluating multimedia learning materials in primary education using eye tracking. Computer Standards & Interfaces, 59, 45–60.
National Council of Teachers of Mathematics. (2000). Principles and standards for school mathematics. Author.
Özerem, A. (2012). Misconceptions in geometry and suggested solutions for seventh grade students. Procedia—Social and Behavioral Sciences, 55, 720–729.
Radu, I. (2012). Why should my students use AR? A comparative review of the educational impacts of augmented-reality. In 2012 IEEE international symposium on mixed and augmented reality (ISMAR), Atlanta, GA, pp. 313–314.
Rayner, K. (1977). Visual attention in reading: Eye movements reflect cognitive processes. Memory & Cognition, 5(4), 443–448.
Rayner, K. (2009). Eye movements and attention in reading, scene perception, and visual search. Quarterly Journal of Experimental Psychology, 62(8), 1457–1506. https://doi.org/10.1080/17470210902816461
Roach, V. A., Fraser, G. M., Kryklywy, J. H., Mitchell, D. G., & Wilson, T. D. (2016). The eye of the beholder: Can patterns in eye movement reveal aptitudes for spatial reasoning? Anatomical Sciences Education, 9(4), 357–366. https://doi.org/10.1002/ase.158
Rossano, V., Lanzilotti, R., Cazzolla, A., & Roselli, T. (2020). Augmented reality to support geometry learning. IEEE Access, 8, 107772–107780.
Sahin, D., & Yilmaz, R. M. (2020). The effect of augmented reality technology on middle school students’ achievements and attitudes toward science education. Computers & Education. https://doi.org/10.1016/j.compedu.2019.103710
Salinas, P., & Pulido, R. (2017). Understanding the conics through augmented reality. Eurasia Journal of Mathematics, Science and Technology Education, 13, 341–355.
Salmi, H., Thuneberg, H., & Vainikainen, M. (2017). Making the invisible observable by augmented reality in informal science education context. International Journal of Science Education, 7(3), 253–268. https://doi.org/10.1080/21548455.2016.1254358
Schindler, M., & Lilienthal, A. J. (2019). Domain-specific interpretation of eye tracking data: Towards a refined use of the eye-mind hypothesis for the field of geometry. Educational Studies in Mathematics, 101(1), 123–139. https://doi.org/10.1007/s10649-019-9878-z
Schreyer-Bennethum, L., & Albright, L. (2011). Evaluating the incorporation of technology and application projects in the higher education mathematics classroom. International Journal of Mathematical Education in Science and Technology, 42(1), 53–63.
Shelton, B. E., & Hedley, N. R. (2004). Exploring a cognitive basis for learning spatial relationships with augmented reality. Technology, Instruction, Cognition and Learning, 1(4), 323.
Singer, L. M., & Alexander, P. A. (2017). Reading on paper and digitally: What the past decades of empirical research reveal. Review of Educational Research, 87(6), 1007–1041. https://doi.org/10.3102/0034654317722961
Sommerauer, P., & Müller, O. (2014). Augmented reality in informal learning environments: A field experiment in a mathematics exhibition. Computers & Education, 79, 59–68. https://doi.org/10.1016/j.compedu.2014.07.013
Tarng, W., Ou, K. L., Yu, C. S., Liou, F. L., & Liou, H. H. (2015). Development of a virtual butterfly ecological system based on augmented reality and mobile learning technologies. Virtual Reality, 19(3–4), 253–266. https://doi.org/10.1007/s10055-015-0265-5
Torff, B., & Tirotta, R. (2010). Interactive whiteboards produce small gains in elementary students’ self-reported motivation in mathematics. Computers & Education, 54, 379–383.
Tossavainen, T., & Juvonen, A. (2015). Finnish primary and secondary students’ interest in music and mathematics relating to enjoyment of the subject and perception of the importance and usefulness of the subject. Research Studies in Music Education, 37(1), 107–121.
Underwood, G., Jebbett, L., & Roberts, K. (2004). Inspecting pictures for information to verify a sentence: Eye movements in general encoding and in focused search. The Quarterly Journal of Experimental Psychology, 57(1), 165–182. https://doi.org/10.1080/02724980343000189
Verdine, B. N., Bunger, A., Athanasopoulou, A., Golinkoff, R. M., & Hirsh-Pasek, K. (2017). Shape up: An eye-tracking study of preschoolers’ shape name processing and spatial development. Developmental Psychology, 53(10), 1869.
Villena Taranilla, R., Cózar-Gutiérrez, R., González-Calero, J. A., & López Cirugeda, I. (2019). Strolling through a city of the Roman Empire: An analysis of the potential of virtual reality to teach history in Primary Education. Interactive Learning Environments. https://doi.org/10.1080/10494820.2019.1674886
Wang, T.-K., Huang, J., Liao, P.-C., & Piao, Y. (2018). Does augmented reality effectively foster visual learning process in construction? An eye-tracking study in steel installation. Advances in Civil Engineering, 2018, 12. https://doi.org/10.1155/2018/2472167
Wigfield, A., Eccles, J. S., Yoon, K. S., Harold, R. D., Arbreton, A., Freedman-Doan, K., & Blumenfeld, P. C. (1997). Changes in children’s competence beliefs and subjective task values across the elementary school years: A three-year study. Journal of Educational Psychology, 89, 451–469. https://doi.org/10.1037/0022-0663.89.3.451
Yang, F. Y. (2017). Examining the reasoning of conflicting science information from the information processing perspective—an eye movement analysis. Journal of Research in Science Teaching, 10, 1347–1372. https://doi.org/10.1002/tea.21408
Yang, F. Y., Chang, C. Y., Chien, W. R., Chien, Y. T., & Tseng, Y. H. (2013). Tracking learners’ visual attention during a multimedia presentation in a real classroom. Computers & Education, 62, 208–220.
Yang, F. Y., Huang, R. T., & Tsai, I. J. (2016). The effects of epistemic beliefs in science and gender difference on university students’ science-text reading: An eye-tracking study. International Journal of Science and Mathematics Education, 14, 473–498.
Yang, S. X., Mei, B., & Yue, X. Y. (2018). Mobile augmented reality assisted chemical education: Insights from elements 4D. Journal of Chemical Education, 95(6), 1060–1062.
Yousef, A. M. F. (2021). Augmented reality assisted learning achievement, motivation, and creativity for children of low-grade in primary school. Journal of Computer Assisted Learning. https://doi.org/10.1111/jcal.12536
Acknowledgements
This work was financially supported by the Ministry of Science and Technology in Taiwan (Grant No. 107-2511-H-003-013-MY3 and 109-2511-H-003-020-MY3) and the Institute for Research Excellence in Learning Sciences at the National Taiwan Normal University from the Featured Areas Research Center Program within the framework of the Higher Education Sprout Project by the Ministry of Education in Taiwan.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendix 1: Geometry Achievement Test (GAT)
Appendix 1: Geometry Achievement Test (GAT)
Rights and permissions
About this article
Cite this article
Bhagat, K.K., Yang, FY., Cheng, CH. et al. Tracking the process and motivation of math learning with augmented reality. Education Tech Research Dev 69, 3153–3178 (2021). https://doi.org/10.1007/s11423-021-10066-9
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11423-021-10066-9