Top

TechTrends

Published in:

11-11-2023 | Original Paper

Generative Artificial Intelligence in Education and Its Implications for Assessment

Authors: Jin Mao, Baiyun Chen, Juhong Christie Liu

Published in: TechTrends | Issue 1/2024

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

The abrupt emergence and rapid advancement of generative artificial intelligence (AI) technologies, transitioning from research labs to potentially all aspects of social life, has brought a profound impact on education, science, arts, journalism, and every facet of human life and communication. The purpose of this paper is to recapitulate the use of AI in education and examine potential opportunities and challenges of employing generative AI for educational assessment, with systems thinking in mind. Following a review of the opportunities and challenges, we discuss key issues and dilemmas associated with using generative AI for assessment and for education in general. We hope that the opportunities, challenges, and issues discussed in this paper could serve as a foundation for educators to harness the power of AI within the digital learning ecosystem.

previous article Prompting Change: Exploring Prompt Engineering in Large Language Model AI and Its Potential to Transform Education

next article Can ChatGPT Pass Graduate-Level Instructional Design assignments? Potential Implications of Artificial Intelligence in Education and a Call to Action

Archibald, A., Hudson, C., Heap, T., Thompson, R. R., Lin, L., DeMeritt, J., & Lucke, H. (2023). A validation of ai-enabled discussion platform metrics and relationships to student efforts. TechTrends, 67(2), 285–293. https://doi.org/10.1007/s11528-022-00825-7CrossRef

Armstrong, K. (2023). ChatGPT: US lawyer admits using AI for case research. BBC News. https://www.bbc.com/news/world-us-canada-65735769?via=aitoolzs. Accessed 10 June 2023

Baker, M. (2000). The roles of models in Artificial Intelligence and education research: A prospective view. International Journal of Artificial Intelligence in Education, 11, 122–143.

Bowen, J. A. (2012). Teaching naked: How moving technology out of your college classroom will improve student learning. John Wiley & Sons.

Cardon, P., Fleischmann, C., Aritz, J., Logemann, M., & Heidewald, J. (2023). The challenges and opportunities of AI-assisted writing: Developing AI literacy for the AI age. Business and Professional Communication Quarterly, 86(3), 257–295. https://doi.org/10.1177/23294906231176517CrossRef

Celik, I., Dindar, M., Muukkonen, H., & Järvelä, S. (2022). The promises and challenges of artificial intelligence for teachers: A systematic review of research. TechTrends, 66(4), 616–630. https://doi.org/10.1007/s11528-022-00715-yCrossRef

Chrisinger, B. (2023). It’s not just our students — ChatGPT is coming for faculty writing and there’s little agreement on the rules that should govern it. The Chronicle of Higher Education. https://www.chronicle.com/article/its-not-just-our-students-ai-is-coming-for-faculty-writing?cid=gen_sign_in. Accessed 20 Mar 2023

Cooper, G. (2023). Examining science education in ChatGPT: An exploratory study of generative artificial intelligence. Journal of Science Education and Technology, 32(3), 444–452. https://doi.org/10.1007/s10956-023-10039-yCrossRef

Cope, B., Kalantzis, M., & Searsmith, D. (2021). Artificial intelligence for education: Knowledge and its assessment in AI-enabled learning ecologies. Educational Philosophy and Theory, 53(12), 1229–1245.CrossRef

Darling-Hammond, L. (2017). Developing and measuring higher order skills: Models for state performance assessment systems. Learning Policy Institute and Council of Chief State School Officers.

von Davier, M. (2019). Training Optimus Prime, M.D.: Generating medical certification items by fine-tuning OpenAI’s GPT2 transformer model. arXiv Computer Science: Computation and Language. https://doi.org/10.48550/arXiv.1908.08594

Dhirani, L. L., Mukhtiar, N., Chowdhry, B. S., & Newe, T. (2023). Ethical dilemmas and privacy issues in emerging technologies: A review. Sensors, 23(3), 1151. https://doi.org/10.3390/s23031151CrossRef

Dwivedi, Y. K., Kshetri, N., Hughes, L., Slade, E. L., Jeyaraj, A., Kar, A. K., Baabdullah, A. M., Koohang, A., Raghavan, V., Ahuja, M., Hanaa Albanna, H., Albashrawi, M. A., Al-Busaidi, A. S., Janarthanan Balakrishnan, J., Barlette, Y., Basu, S., Bose, I., Brooks, L., Buhalis, D.,… Wright, R. (2023). “So what if ChatGPT wrote it?” Multidisciplinary perspectives on opportunities, challenges and implications of generative conversational AI for research, practice and policy. International Journal of Information Management, 71, 102642 https://doi.org/10.1016/j.ijinfomgt.2023.102642

Floridi, L. (2023). AI as agency without intelligence: On ChatGPT, large language models, and other generative models. Philosophy and Technology. https://doi.org/10.2139/ssrn.4358789CrossRef

Gamage, K. A., Silva, E. K. D., & Gunawardhana, N. (2020). Online delivery and assessment during COVID-19: Safeguarding academic integrity. Education Sciences, 10(11), 301. https://doi.org/10.3390/educsci10110301CrossRef

Gewirtz, D. (2023). Can AI detectors save us from ChatGPT? I tried 3 online tools to find out. ZDNET. https://www.zdnet.com/article/can-ai-detectors-save-us-from-chatgpt-i-tried-3-online-tools-to-find-out/. Accessed 4 Nov 2023

Hu, K. (2023). ChatGPT sets record for fastest-growing user base - analyst note. REUTERS. https://www.reuters.com/technology/chatgpt-sets-record-fastest-growing-user-base-analyst-note-2023-02-01/. Accessed 15 Feb 2023

Humble, N., & Mozelius, P. (2022). The threat, hype, and promise of artificial intelligence in education. Discover Artificial Intelligence, 2(22). https://doi.org/10.1007/s44163-022-00039-z

Ifenthaler, D., & Schumacher, C. (2016). Student perceptions of privacy principles for learning analytics. Educational Technology Research and Development, 64, 923–938. https://doi.org/10.1007/s11423-016-9477-yCrossRef

Ivarsson, J., & Lindwall, O. (2023). Suspicious minds: The problem of trust and conversational agents. Computer Supported Cooperative Work (CSCW)https://doi.org/10.1007/s10606-023-09465-8

Jones-Rooy, A. (2019). What does the data say? I’m a data scientist who is skeptical about data. Quartz. https://qz.com/1664575/is-data-science-legit. Accessed Mar 5 2023

Kaipa, R. M. (2021). Multiple choice questions and essay questions in curriculum. Journal of Applied Research in Higher Education, 13(1), 16–32. https://doi.org/10.1108/jarhe-01-2020-0011CrossRef

Kan, M. (2023). ChatGPT may be the fastest growing app of all time, beating TikTok. PCMag. https://www.pcmag.com/news/chatgpt-may-be-the-fastest-growing-app-of-all-time-beating-tiktok. Accessed March 5, 2023

Kaplan-Rakowski, R., Grotewold, K., Hartwick, P., & Papin, K. (2023). Generative AI and teachers’ perspectives on its implementation in education. Journal of Interactive Learning Research, 34(2), 313–338.

Kelley, K. J. (2023). Teaching actual student writing in an AI world. Inside Higher Ed. https://www.insidehighered.com/advice/2023/01/19/ways-prevent-students-using-ai-tools-their-classes-opinion. Accessed June 10, 2023

Kennedy, B., Tyson, A., & Saks, E. (2023). Public awareness of artificial intelligence in everyday activities: Limited enthusiasm in U.S. over AI’s growing influence in daily life. Pew Research Center. https://www.pewresearch.org/science/2023/02/15/public-awareness-of-artificial-intelligence-in-everyday-activities/. Accessed 1 Mar 2023

Kowch, E. G., & Liu, J. C. (2018). Principles for teaching, leading, and participatory learning with a new participant: AI. In2018 International Joint Conference on Information, Media and Engineering (ICIME) (pp. 320-325). IEEECrossRef

Lamb, R., Neumann, K., & Linder, K. A. (2022). Real-time prediction of science student learning outcomes using machine learning classification of hemodynamics during virtual reality and online learning sessions. Computers and Education: Artificial Intelligence, 3. https://doi.org/10.1016/j.caeai.2022.100078

Lee, V. R. (2023). Generative AI is forcing people to rethink what it means to be authentic. The Conversation. https://theconversation.com/generative-ai-is-forcing-people-to-rethink-what-it-means-to-be-authentic-204347?fbclid=IwAR2oio90vOzTQbXyPjaCrihKj7S5SYJ9lBsBHHnrN4PayQucLP7T1QCUzw4&mibextid=Zxz2cZ. Accessed 11 June 2023

Markauskaite, L., Marrone, R., Poquet, O., Knight, S., Martinez-Maldonado, R., Howard, S., Tondeur, J., De Laat, M., Shum, S. B., Gašević, D., & Siemens, G. (2022). Rethinking the entwinement between artificial intelligence and human learning: What capabilities do learners need for a world with AI?, Computers and Education: Artificial Intelligence, 3, https://doi.org/10.1016/j.caeai.2022.100056

Martinez, D., Malyska, N., Streilein, B., Caceres, R., Campbell, W., Dagli, C., Gadepally, V., Greenfield, K., Hall, R., King, A., Lippmann, R., Miller, B., Reynolds, D., Richardson, F., Sahin, C., Tran, A., Trepagnier, P., & Zipkin, J. (2019). Artificial intelligence: Short history, present developments, and future outlook. Massachusetts Institute of Technology.

McAdoo, T., (2023). How to cite ChatGPT? APA Style. https://apastyle.apa.org/blog/how-to-cite-chatgpt. Accessed 10 June 2023

McKinsey & Company (2023, January 19). What is generative AI? https://www.mckinsey.com/featured-insights/mckinsey-explainers/what-is-generative-ai. Accessed 11 June 2023

Metz, C. (2023). What makes A.I. chatbots go wrong? The curious case of the hallucinating software. The New York Times. https://www.nytimes.com/2023/03/29/technology/ai-chatbots-hallucinations.html. Accessed 10 June 2023

Mislevy, R. J., Behrens, J. T., Dicerbo, K. E., & Levy, R. (2012). Design and discovery in educational assessment: Evidence-centered design, psychometrics, and educational data mining. Journal of Educational Data Mining, 4(1), 11–48.

Mutimukwe, C., Viberg, O., Oberg, O. M., & Cerratto- Pargman, T. (2022). Students’ privacy concerns in learning analytics: Model development. British Journal of Educational Technology, 53, 932–951. https://doi.org/10.1111/bjet.13234CrossRef

Nelson, J. (2023). Italy welcomes ChatGPT back after ban over AI privacy concerns. Decrypt. https://decrypt.co/138362/italy-welcomes-chatgpt-back-after-ban-over-ai-privacy-concerns. Accessed 3 May 2023

Ntoutsi, E., Fafalios, P., Gadiraju, U., Iosifidis, V., Nejdl, W., Vidal, M. E., Ruggieri, S., Turini, F., Papadopoulos, S., Krasanakis, E., Kompatsiaris, I., Kinder-Kurlanda, K., Wagner, C., Karimi, F., Fernandez, M., Alani, H., Berendt, B., Kruegel, T., Heinze, C., … Staab, S. (2019). Bias in data-driven artificial intelligence systems—An introductory survey. WIREs Data Mining and Knowledge Discovery, 10(3). https://doi.org/10.1002/widm.1356

OpenAI. (2022). Introducing ChatGPT. https://openai.com/blog/chatgpt/. Accessed 1 June 2023

Oppy, G., & Dowe, D. (2021). The turing test, In: E. N. Zalta (Ed.), The Stanford Encyclopedia of Philosophy. https://plato.stanford.edu/archives/win2021/entries/turing-test/. Accessed 5 May 2023

Ouyang, F., Zheng, L., & Jiao, P. (2022). Artificial intelligence in online higher education: A systematic review of empirical research from 2011 to 2020. Education and Information Technologies, 27(6), 7893–7925. https://doi.org/10.1007/s10639-022-10925-9CrossRef

Pavlik, J. V. (2023). Collaborating with ChatGPT: Considering the implications of generative artificial intelligence for journalism and media education. Journalism & Mass Communication Educator. https://doi.org/10.1177/10776958221149577CrossRef

Pham, Y. K., Murray, C., & Gau, J. (2021). The inventory of teacher-student relationships: Factor structure and associations with school engagement among high-risk youth. Psychology in the Schools, 59(2), 413–429. https://doi.org/10.1002/pits.22617CrossRef

Popenici, S. A., & Kerr, S. (2017). Exploring the impact of artificial intelligence on teaching and learning in higher education. Research and Practice in Technology Enhanced Learning, 12(1), 1–13. https://doi.org/10.1186/s41039-017-0062-8CrossRef

Pressey, S. L. (1950). Development and appraisal of devices providing immediate automatic scoring of objective tests and concomitant self-instruction. The Journal of Psychology, 29(2), 417–447.CrossRef

Price, W. N., & Cohen, I. G. (2019). Privacy in the age of medical big data. Nature Medicine, 25, 37–43. https://doi.org/10.1038/s41591-018-0272-7CrossRef

Satariano, A. (2023). ChatGPT is banned in Italy over privacy concerns. The New York Times. https://www.nytimes.com/2023/03/31/technology/chatgpt-italy-ban.html. Accessed 1 April 2023

Selwyn, N. (2022). The future of AI and education: Some cautionary notes. European Journal of Education Research, Development, and Policy, 57(4), 620–631. https://doi.org/10.1111/ejed.12532CrossRef

Senge, P. M. (2006). The fifth discipline: The art & practice of the learning organization. Doubleday.

Shepard, L. A. (2000). The role of assessment in a learning culture. Educational Researcher, 29(7), 4–14.CrossRef

Stokel-Walker, C. (2023). January 18). ChatGPT listed as author on research papers: Many scientists disapprove. Nature, 613, 620–621. https://doi.org/10.1038/d41586-023-00107-zCrossRef

Surden, H. (2019). Artificial intelligence and law: An overview. Georgia State University Law Review 35(4). https://readingroom.law.gsu.edu/gsulr/vol35/iss4/8. Accessed 2 June 2023

Swiecki, Z., Khosravi, H., Chen, G.; Martinez-Maldonado, R., Lodge, J. M., Milligan, S., Selwyn, N., & Gašević, D. (2022). Assessment in the age of artificial intelligence. Computers and Education: Artificial Intelligence, 3. https://doi.org/10.1016/j.caeai.2022.100075

Terry, O. K. (2023). I’m a student. You have no idea how much we’re using ChatGPT. No professor or software could ever pick up on it. The Chronicle of Higher Education. https://www.chronicle.com/article/im-a-student-you-have-no-idea-how-much-were-using-chatgpt. Accessed 9 June 2023

The National Assessment of Educational Progress (NAEP) (2021). Technology based assessment project. https://nces.ed.gov/nationsreportcard/studies/tba/. Accessed 1 May 2023

Thorp, H. H. (2023). ChatGPT is fun, but not an author. Science, 379(6630), 313. https://doi.org/10.1126/science.adg78CrossRef

U.S. DOE Office of Educational Technology (2017). Reimagining the role of technology in education: 2017 National Education Technology Plan Update. Washington, D.C. https://tech.ed.gov/netp/. Accessed 3 Jan 2023

U.S. DOE Office of Educational Technology. (2023). Artificial intelligence and future of teaching and learning: Insights and recommendations, Washington, DC. https://tech.ed.gov/ai-future-of-teaching-and-learning/. Accessed 1 June 2023

Waller, C. (2023). The state of global digital accessibility: Current challenges and opportunities. Accessibility.com. https://www.accessibility.com/blog/the-state-of-global-digital-accessibility-current-challenges-and-opportunities. Accessed 13 June 2023

Wang, P. (2020). On defining artificial intelligence. Journal of Artificial General Intelligence, 11(2), 73–86.

Wiggins, G. (1998). Educative assessment: Designing assessments to inform and improve student performance. Jossey-Bass Publishers.

Xu, W., & Ouyang, F. (2022). A systematic review of AI role in the educational system based on a proposed conceptual framework. Education and Information Technologies, 1–29. https://doi.org/10.1007/s10639-021-10774-y

Yu, E. (2023). Intelligent enough? Artificial intelligence for online learners. Journal of Educators Online, 20(1). https://doi.org/10.9743/JEO.2023.20.1.16

Zhou, H., & Hunter, S. I. (2023). Guest post — Accessibility powered by AI: How artificial intelligence can help universalize access to digital content. The Scholarly Kitchen. https://scholarlykitchen.sspnet.org/2023/06/05/guest-post-accessibility-powered-by-ai-how-artificial-intelligence-can-help-universalize-access-to-digital-content/. Accessed 13 June 2023

Title: Generative Artificial Intelligence in Education and Its Implications for Assessment
Authors: Jin Mao
Baiyun Chen
Juhong Christie Liu
Publication date: 11-11-2023
Publisher: Springer US
Published in: TechTrends / Issue 1/2024
Print ISSN: 8756-3894
Electronic ISSN: 1559-7075
DOI: https://doi.org/10.1007/s11528-023-00911-4

Springer Professional

Generative Artificial Intelligence in Education and Its Implications for Assessment

Abstract

Premium Partner

Springer Professional

Abstract

Please log in to get access to your license.

Other articles of this Issue 1/2024

Prompting Change: Exploring Prompt Engineering in Large Language Model AI and Its Potential to Transform Education

In Consideration of Context: The Potential of Geographic Information Systems (GIS)

International Students' Unique Challenges and Reflections

Don’t put the Cart Before the Horse: Self-Study on Using VR in Education

The Implementation of Virtual Reality in Organizational Learning: Attitudes, challenges, side effects, and affordances

Innovation of Instructional Design and Assessment in the Age of Generative Artificial Intelligence