Top

TechTrends

Published in:

01-05-2024 | Original Paper

A Needs Assessment to Support Faculty Members’ Awareness of Generative AI Technologies to Support Instruction

Authors: Rita Mathew, Jill E. Stefaniak

Published in: TechTrends | Issue 4/2024

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

This paper provides an overview of a needs assessment study conducted in higher education to address the impact of generative AI, specifically ChatGPT, on faculty development and instructional strategies. The study acknowledges the disruptive effect of AI on academia and the varying responses from faculty members. It emphasizes the importance of equipping educators with the necessary knowledge and skills to effectively integrate generative AI into their teaching practices. The results of the needs assessment reveal various factors contributing to performance gaps, including policy and budget, knowledge, skills, competencies, information, and technological tools. The study suggests that faculty members need support in understanding the scope and implications of AI and AI-driven content creation, assessment, and personalized learning.

previous article Introduction to the Special Section on Integrating Generative AI in Education

next article Improving Writing Feedback for Struggling Writers: Generative AI to the Rescue?

Available only for authorised users

Abdullah, Z., & Zaid, N. (2023). Perception of generative artificial intelligence in higher education research. Innovative Teaching and Learning Journal, 7(2), 84–95. https://doi.org/10.11113/itlj.v7.137CrossRef

Alasadi, E., & Baiz, C. (2023). Generative AI in education and research: Opportunities, concerns, and solutions. Journal of Chemical Education, 100(8), 2965–2971. https://doi.org/10.1021/acs.jchemed.3c00323CrossRef

Alexander, S., Cunningham, W. J., Lanier, J., Smolin, L., Stanojevic, S., Toomey, M. W., & Wecker, D. (2021). The Autodidactic Universe. https://doi.org/10.48550/arXiv.2104.03902

Amani, S., White, L., Balart, T., Arora, L., Shryock, D. K. J., Brumbelow, D. K., & Watson, D. K. L. (2023). Generative AI perceptions: A survey to measure the perceptions of faculty, staff, and students on generative AI tools in academia. https://doi.org/10.48550/arXiv.2304.14415

Baidoo-Anu, D., & Ansah, L. O. (2023). Education in the era of generative artificial intelligence (AI): Understanding the potential benefits of ChatGPT in promoting teaching and learning. Journal of AI, 7(1), 52–62. https://doi.org/10.61969/jai.1337500CrossRef

Bender, E., & Koller, A., (2020). Climbing towards NLU: On Meaning, Form, and Understanding in the Age of Data. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp. 5185–5198. https://aclanthology.org/2020.acl-main.463

Berendt, B., Littlejohn, A., & Blakemore, M. (2020). AI in education: Learner choice and fundamental rights. Learning, Media and Technology, 45(3), 312–324. https://doi.org/10.1080/17439884.2020.1786399CrossRef

Bessette, L. S. (2023). This isn’t another piece on ChatGPT. National Teaching & Learning Forum, 32(2), 11–12. https://doi.org/10.1002/ntlf.30359CrossRef

Browning, J. & LeCun, Y. (2022). AI and the limits of language. Noema. The Berggruen Institute. https://www.noemamag.com/ai-and-the-limits-of-language/

Burns, J. (1978). Leadership. Harper & Row.

Chalmers, D. J. (2022). Reality+: virtual worlds and the problems of philosophy. W. W. Norton & Company.

Chignell, M., Wang, L., Zare, A., & Li, J. (2023). The evolution of HCI and human factors: Integrating human and artificial intelligence. ACM Transactions on Computer-Human Interaction, 30(2), 1–30. https://doi.org/10.1145/3557891CrossRef

COMEST (2019) World Commission on Ethics of Scientific Knowledge and Technology. Preliminary study on the ethics of artificial intelligence. Paris, France.

Cooper, G. (2023). Examining science education in ChatGPT: An exploratory study of generative artificial intelligence. Journal of Science Education and Technology, 32, 444–452. https://doi.org/10.1007/s10956-023-10039-yCrossRef

Corn, J. O. (2010). Investigating the quality of the school technology needs assessment (STNA) 3.0: A validity and reliability study. Educational Technology Research and Development, 58, 353–376. https://doi.org/10.1007/s11423-009-9140-yCrossRef

Cotton, D. R., Cotton, P. A., & Shipway, J. R. (2023). Chatting and cheating: Ensuring academic integrity in the era of ChatGPT. Innovations in Education and Teaching International, 1–12. https://doi.org/10.1080/14703297.2023.2190148

DeVellis, R. F., & Thorpe, C. T. (2022). Scale development : Theory and applications (5th ed.). Sage.

Duha, M. S. U. (2023). ChatGPT in education: An opportunity or a challenge for the future? TechTrends: Linking Research & Practice to Improve Learning, 67(3), 402–403. https://doi.org/10.1007/s11528-023-00844-yCrossRef

Dwivedi, Y. K., Kshetri, N., Hughes, L., Slade, E. L., Jeyaraj, A., Kar, A. K., … & Wright, R. (2023). “So what if ChatGPT wrote it?” Multidisciplinary perspectives on opportunities, challenges and implications of generative conversational AI for research, practice and policy. International Journal of Information Management, 71, 102642.

Farrokhnia, M., Banihashem, S. K., Noroozi, O., & Wals, A. (2023). A SWOT analysis of ChatGPT: Implications for educational practice and research. Innovations in Education and Teaching International. https://doi.org/10.1080/14703297.2023.2195846CrossRef

Faster, better, more productive. (2023 September 16). Economist.

Frith, K. H. (2023). ChatGPT: Disruptive educational technology. Nursing Education Perspectives, 44(3), 198–199. https://doi.org/10.1097/01.NEP.0000000000001129CrossRef

Ganesan, K. (2022). The business case for AI: A leader’s guide to AI strategies, best practices & real-world applications. Opinosis Analytics.

General Services Administration. (n.d.). Web Content Accessibility Guidelines. (GSA).

George, B. (2003). Authentic leadership : Rediscovering the secrets to creating lasting value. Jossey-Bass.

Goertzel, T. (2014). The path to more general artificial intelligence. Journal of Experimental & Theoretical Artificial Intelligence, 26(3), 343–354. https://doi.org/10.1080/0952813X.2014.895106CrossRef

Goertzel, B. (2023). Generative AI vs. AGI: The cognitive strengths and weaknesses of modern LLMs. https://doi.org/10.48550/arXiv.2309.10371

Government Accountability Office. (GAO). (2023) Science & Tech Spotlight: Generative AI. GAO-23–106782. https://www.gao.gov/products/gao-23-106782

Harris, T. & Raskin, A. (2023). The AI dilemma. Centre for Humane Technology. https://www.humanetech.com/podcast/the-ai-dilemma

Heifetz, R. A. (1994). Leadership without easy answers. Harvard University Press. https://doi.org/10.4159/9780674038479CrossRef

Hodges, C. B., & Kirschner, P. A. (2024). Innovation of instructional design and assessment in the age of generative artificial intelligence. TechTrends, 68(1), 195–199. https://doi.org/10.1007/s11528-023-00926-x

Holmes, W., Fadel, C., & Bialik, M. (2019). Artificial intelligence in education: Promises and implications for teaching and learning. The Center for Curriculum Redesign.

Hsu, Y. C., & Ching, Y. H. (2023). Generative artificial intelligence in education, part one: The dynamic frontier. TechTrends, 67(4), 603–607. https://doi.org/10.1007/s11528-023-00863-9CrossRef

International Society for Technology in Education. (n.d.). International society for technology in education standards: For educators. https://iste.org/standards/educators

Kaplan-Rakowski, R., Grotewold, K., Hartwick, P., & Papin, K. (2023). Generative AI and teachers’ perspectives on its implementation in education. Journal of Interactive Learning Research, 34(2), 313–338.

Kasneci, E., Sessler, K., Kuchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Gunnemann, S., Hullermeier, E., Krusche, S., Kutyniok, G., Michaeli, T., Nerdel, C., Pfeffer, J., Poquet, O., Sailer, M., Schmidt, A., Seidel, T., … Kasneci, G. (2023). ChatGPT for good? On opportunities and challenges of large language models for education. Learning and Individual Differences., 103(April), 102274. https://doi.org/10.1016/j.lindif.2023.102274CrossRef

Kelly, K. (2016). The Inevitable. Penguin.

Khemani, D. (2013). A first course in artificial intelligence. McGraw-Hill Education.

Lakoff, G., & Johnson, M. (1980). Metaphors we live by. The University of Chicago Press.

LeCun, Y., Bengio, Y., & Hinton, G. (2015). Deep learning. Nature, 521, 436–444. https://doi.org/10.1038/nature14539CrossRef

Li, T., Vorvoreanu, M., Debellis, D., & Amershi, S. (2023). Assessing human-AI interaction early through factorial surveys: A study on the guidelines for human-AI Interaction. ACM Transactions on Computer-Human Interaction, 30(5), 1–45. https://doi.org/10.1145/3511605CrossRef

Luckin, R., & Holmes, W. (2016). Intelligence unleashed: An argument for AI in education. Pearson.

Marshall, R., Pardo, A., Smith, D., & Watson, T. (2022). Implementing next generation privacy and ethics research in education technology. British Journal of Educational Technology, 53(4), 737–755. https://doi.org/10.1111/bjet.13224CrossRef

McCarthy, J. (1987). Generality in artificial intelligence. Communications of the ACM, 30(12), 1030–1035. https://doi.org/10.1145/33447.33448CrossRef

Miao, F., & Holmes, W. (2021). Artificial Intelligence and Education. Guidance for Policy-makers. United Nations Educational, Scientific and Cultural Organization (UNESCO).

Michel-Villarreal, R., Vilalta-Perdomo, E., Salinas-Navarro, D. E., Thierry-Aguilera, R., & Gerardou, F. S. (2023). Challenges and opportunities of generative ai for higher education as explained by ChatGPT. Education Sciences, 13(9), 856.CrossRef

Minsky, M. (2006). The emotion machine: Commonsense thinking, artificial intelligence, and the future of the human mind. Simon & Schuster.

Monett, D., & Lewis, C. W. P. (2018). Getting clarity by defining artificial intelligence - a survey. In V. C. Muller (Ed.), Philosophy and Theory of Artificial Intelligence (pp. 212–214). Springer.

National AI Advisory Committee (NAIAC) (2023.). Committee member perspectives. In National AI Advisory Committee Report. https://ai.gov/naiac/#MEMBERS

Nazaretsky, T., Ariely, M., Cukurova, M., & Alexandron, G. (2022). Teachers’ trust in AI-powered educational technology and a professional development program to improve it. British Journal of Educational Technology, 53(4), 914–931. https://doi.org/10.1111/bjet.13232CrossRef

Newell, A., & Simon, H. A. (1976). Computer science as empirical inquiry: Symbols and search. Communications of the ACM, 19(3), 113–126.CrossRef

OpenAI. (2023). GPT-4 Technical Report. https://doi.org/10.48550/arXiv.2303.08774

Organization for Economic Cooperation and Development (OECD). (2019). OECD AI Principles Overview. https://oecd.ai/en/ai-principles

Organization for Economic Cooperation and Development. (2013). Leadership for 21st Century Learning, Educational Research and Innovation. (OECD).https://doi.org/10.1787/9789264205406-en

Papenmeier, A., Kern, D., Englebienne, G., & Seifert, C. (2022). It’s complicated: The relationship between user trust, model accuracy and explanations in ai. ACM Transactions on Computer-Human Interaction, 29(4), 1–33. https://doi.org/10.1145/3495013CrossRef

Petricini, T., Wu, C., & Zipf, S. T. (2023). Perceptions about generative AI and ChatGPT use by faculty and college students. https://doi.org/10.35542/osf.io/jyma4

Pham, S. T. H., & Sampson, P. M. (2022). The development of artificial intelligence in education: A review in context. Journal of Computer Assisted Learning, 38(5), 1408–1421. https://doi.org/10.1111/jcal.12687CrossRef

Qadir, J. (2023). Engineering education in the era of ChatGPT: Promise and pitfalls of generative AI for education. IEEE Global Engineering Education Conference. https://doi.org/10.1109/EDUCON54358.2023.10125121CrossRef

Rad, D., & Rad, G. (2023). Exploring the psychological implications of ChatGPT: A qualitative study. Journal Plus Education / Educatia Plus, 32(1), 43–55. https://doi.org/10.24250/jpe/vol.321/2023/dr/grCrossRef

Resendez, A. (2019). Teachers’ perceptions and practices on using educational technology as an instructional tool in the classroom. [Doctoral Dissertation, The University of Texas Rio Grande Valley]. https://scholarworks.utrgv.edu/etd/570

Ruiz-Rojas, L. I., Acosta-Vargas, P., De-Moreta-Llovet, J., & Gonzalez-Rodriguez, M. (2023). Empowering education with generative artificial intelligence tools: Approach with an instructional design matrix. Sustainability, 15(15), 11524. https://doi.org/10.3390/su151511524CrossRef

Russell, S., & Norvig, P. (2010). Artificial intelligence: A modern approach (3rd ed.). Prentice Hall.

Sawyer, L. M. (2018). Perceptions and practice: The relationship between teacher perceptions of technology use and level of classroom technology integration. [Doctoral Dissertation, Southeastern University].

Schiaffino, S., Garcia, P., & Amandi, A. (2008). eTeacher: Providing personalized assistance to e-learning students. Computers & Education, 51(4), 1744–1754. https://doi.org/10.1016/j.compedu.2008.05.008CrossRef

Schiff, D. (2022). Education for AI, not AI for education: The role of education and ethics in national AI policy strategies. International Journal of Artificial Intelligence in Education, 32(3), 527–563. https://doi.org/10.1007/s40593-021-00270-2CrossRef

Smolansky, A., Cram, A., Raduescu, C., Zeivots, S., Huber, E., & Kizilcec, R. F. (2023). Educator and student perspectives on the impact of generative AI on assessments in higher education. In Proceedings of the Tenth ACM Conference on Learning@ Scale, pp. 378–382.

Sogaard, A. (2023). Grounding the vector space of an octopus: Word meaning from raw text. Minds and Machines, 33, 33–54. https://doi.org/10.1007/s11023-023-09622-4CrossRef

Stivers, J. L., & Cramer, S. F. (Eds.). (2009). A teachers guide to change: Understanding, navigating, and leading the process. Corwin Press.

Strzelecki, A. (2023). To use or not to use ChatGPT in higher education? A study of students’ acceptance and use of technology. Interactive Learning Environments. https://doi.org/10.1080/10494820.2023.2209881CrossRef

Susnjak, T. (2022). ChatGPT: The end of online exam integrity? arXiv https://doi.org/10.48550/arXiv.2212.09292

Tlili, A., Shehata, B., Adarkwah, M., Bozkurt, A., Hickey, D., Huang, R., Agyemang, B. (2023). What if the devil is my guardian angel: ChatGPT as a case study of using chatbots in education. Smart Learning Environments, 10(15). https://doi.org/10.1186/s40561-023-00237-x

United Nations International Centre for Technical and Vocational Education and Training. (UNEVOC). (2021). Understanding the impact of artificial intelligence on skills development. UNESCO. Paris, France.

Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. Kaiser, L., Polosukhin, I. (2017). Attention is all you need. https://doi.org/10.48550/arXiv.1706.03762.

Wang, P. (2019). On Defining Artificial Intelligence. Journal of Artificial General Intelligence, 10(2), 1–37. https://doi.org/10.3389/frobt.2018.00020CrossRef

Wang, P., Li, X., & Hammer, P. (2018). Self in NARS, an AGI System. Frontiers in Robotics and AI. https://doi.org/10.3389/frobt.2018.00020CrossRef

White House Office of Science and Technology Policy (OSTP). (n.d.). Blueprint for an AI Bill of Rights. https://www.whitehouse.gov/ostp/ai-bill-of-rights/

Williamson, B. (2019). New power networks in educational technology. Learning, Media and Technology, 44(4), 395–398. https://doi.org/10.1080/17439884.2019.1672724CrossRef

Witkin, B. R., & Altschuld, J. W. (1995). Planning and conducting needs assessments: A practical guide. Sage.

Wong, K. (2023). Cybernetical intelligence: Engineering cybernetics with machine intelligence. Wiley.CrossRef

World Commission on Ethics of Scientific Knowledge and Technology. (2019). Preliminary study on the ethics of artificial intelligence. COMEST.

Yan, D. (2023). Impact of ChatGPT on learners in a L2 writing practicum: An exploratory investigation. Education and Information Technologies, 28, 13943–13967. https://doi.org/10.1007/s10639-023-11742-4CrossRef

Zawacki-Richter, O., Marín, V. I., Bond, M., & Gouverneur, F. (2019). Systematic review of research on artificial intelligence applications in higher education–where are the educators? International Journal of Educational Technology in Higher Education, 16(1), 1–27. https://doi.org/10.1186/s41239-019-0171-0CrossRef

Title: A Needs Assessment to Support Faculty Members’ Awareness of Generative AI Technologies to Support Instruction
Authors: Rita Mathew
Jill E. Stefaniak
Publication date: 01-05-2024
Publisher: Springer US
Published in: TechTrends / Issue 4/2024
Print ISSN: 8756-3894
Electronic ISSN: 1559-7075
DOI: https://doi.org/10.1007/s11528-024-00964-z

Springer Professional

A Needs Assessment to Support Faculty Members’ Awareness of Generative AI Technologies to Support Instruction

Abstract

Premium Partner

Springer Professional

Abstract

Please log in to get access to your license.

Other articles of this Issue 4/2024

The Difference a Three-Minute Video Makes: Presence(s), Satisfaction, and Instructor-Confidence in Post-Pandemic Online Teacher Education

Essential Elements of Digital Citizenship: Insights from the Literature

Exploring Inventions in Self-Directed Language Learning with Generative AI: Implementations and Perspectives of YouTube Content Creators

Being in Two Places at the Same Time: a Future for Hybrid Learning Based on Student Preferences

ChatGPT: The Challenges It Presents for Writing Assignments

Harnessing the Power of Generative AI to Support ALL Learners