Top

TechTrends

Published in:

09-11-2023 | Original Paper

The Ethical Consequences, Contestations, and Possibilities of Designs in Educational Systems

Authors: Kevin Close, Melissa Warr, Punya Mishra

Published in: TechTrends | Issue 1/2024

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

Emerging technologies present new possibilities for schools, but also present ethical issues for designers. Ethical issues arising from the design, accessibility, adoption, and implementation of emerging technologies in schools are intertwined with existing power dynamics, hierarchies, and decision-making norms that perpetuate entrenched systems. Using a framework called the fives spaces for design in education framework as an analytical lens, we explore the ethical implications of two emerging artificial intelligence technologies in education: remote proctoring software and large language models. We find that designers adopting and implementing these emerging technologies must attend to the consequences of past design decisions and recognize that emerging technologies also create places for resistance and contestations. Lastly, by recognizing the wide scope of what can be redesigned, designers can start to see possibilities for redesigning in ways that are inclusive, equitable, and ethically conscious. Ultimately, we hope to begin a critical conversation about the two technologies by thinking about the sites of consequence, contestation, and possibilities in the designed cultures, systems, experiences, processes, and artifacts of schooling.

previous article Game-Based Learning and Systems Thinking: an Innovative Instructional Approach for the 21st Century

next article Innovation of Instructional Design and Assessment in the Age of Generative Artificial Intelligence

Anyon, J. (1980). Social class and the hidden curriculum of work. The Journal of Educational Research, 162(1), 67–92. http://www.jstor.org/stable/42741976. Accessed 17 Oct 2023.

Baker, B. D. (2021). Educational inequality and school finance: Why money matters for America’s students. Harvard Education Press.

Bang, M., & Vossoughi, S. (2016). Participatory design research and educational justice: Studying learning and relations within social change making. Cognition and Instruction, 34(3), 173–193. https://doi.org/10.1080/07370008.2016.1181879CrossRef

Beghetto, R. A. (2021). My favorite failure: Using digital technology to facilitate creative learning and reconceptualize failure. TechTrends, 65(4), 606–614. https://doi.org/10.1007/s11528-021-00607-7CrossRef

Bender, E. M., Gebru, T., McMillan-Major, A., & Shmitchell, S. (2021, March). On the Dangers of Stochastic Parrots: Can Language Models Be Too Big?. In Proceedings of the 2021 ACM conference on fairness, accountability, and transparency (pp. 610–623). https://doi.org/10.1145/3442188.3445922

Benjamin, R. (2019). Assessing risk, automating racism. Science, 366(6464), 421–422. https://doi.org/10.1126/science.aaz3873CrossRef

Benjamin, R. (2020). Race after technology: Abolitionist tools for the new Jim code. Polity. https://www.politybooks.com/bookdetail?book_slug=race-after-technology-abolitionist-tools-for-the-new-jim-code--9781509526390. Accessed 17 Oct 2023.

Buchanan, R. (1998). Branzi’s dilemma: Design in contemporary culture. Design Issues, 14(1), 3–20. https://doi.org/10.2307/1511825CrossRef

Buchanan, R. (1992). Wicked problems in design thinking. Design Issues, 8(2), 5–21. http://www.jstor.org/stable/1511637. Accessed 17 Oct 2023.CrossRef

Butrymowicz, S., & Mathewson, T. G. (2018). “Tired of fighting that fight”: School districts’ uphill battle to get good deals on ed tech. The Hechinger Report. https://hechingerreport.org/tired-of-fighting-that-fight-school-districts-uphill-battle-to-get-good-deals-on-ed-tech/. Accessed 17 Oct 2023.

Carpenter, J. P., & Krutka, D. G. (2014). How and why educators use Twitter: A survey of the field. Journal of Research on Technology in Education, 46(4), 414–434. https://doi.org/10.1080/15391523.2014.925701CrossRef

Casas-Roma, J., Conesa, J., & Caballé, S. (2021). Education, ethical dilemmas and AI: from ethical design to artificial morality. In Adaptive Instructional Systems. Design and Evaluation: Third International Conference, AIS 2021, Held as Part of the 23rd HCI International Conference, HCII 2021, Virtual Event, July 24–29, 2021, Proceedings, Part I (pp. 167-182). Cham: Springer International Publishing

Cobb, J. (2021). The man behind critical race theory. The New Yorker. https://www.newyorker.com/magazine/2021/09/20/the-man-behind-critical-race-theory. Accessed 17 Oct 2023.

Cohen, S., Abukhalaf, A. H. I., & Rinker, M. E. (2022). The Growing Mental Health Crisis Among America’s Children, Adolescents, and Young Adults. Academia Letters.

Curtin, S. C., & Heron, M. P. (2019). Death rates due to suicide and homicide among persons aged 10–24: United States, 2000–2017. National Center for Health Statistics, Center for Disease Control and Prevention. https://www.cdc.gov/nchs/data/databriefs/db352-h.pdf. Accessed 17 Oct 2023.

Eckenrode, J., Ricci, M., & Klingen, A. (2016). 7 things you should know about remote proctoring. Educause 7 Things Series. https://library.educause.edu/resources/2016/5/7-things-you-should-know-about-remote-proctoring. Accessed 17 Oct 2023.

Golsby-Smith, T. (1996). Fourth order design: A practical perspective. Design Issues, 12(1), 5–25. http://www.jstor.org/stable/1511742. Accessed 17 Oct 2023.CrossRef

Gutiérrez, K. D., & Jurow, A. S. (2016). Social design experiments: Toward equity by design. Journal of the Learning Sciences, 25(4), 565–598. https://doi.org/10.1080/10508406.2016.1204548CrossRef

Hohlfeld, T. N., Ritzhaupt, A. D., Barron, A. E., & Kemker, K. (2008). Examining the digital divide in K-12 public schools: Four-year trends for supporting ICT literacy in Florida. Computers & Education, 51(4), 1648–1663. https://doi.org/10.1016/j.compedu.2008.04.002CrossRef

Hubler, S. (2020). Keeping Online Testing Honest? Or an Orwellian Overreach? The New York Times. https://www.nytimes.com/2020/05/10/us/online-testing-cheating-universities-coronavirus.html. Accessed 17 Oct 2023.

Ishimaru, A. M., & Bang, M. (2022). Designing with Families for Just Futures. Journal of Family Diversity in Education, 4(2), 130–140. https://doi.org/10.53956/jfde.2022.171CrossRef

Kimmons, R. (2020). Current trends (and missing links) in educational technology research and practice. TechTrends, 64, 803–809. https://doi.org/10.1007/s11528-020-00549-6CrossRef

Krippendorff, K. (2005). The semantic turn: A new foundation for design. CRC Press.CrossRef

Kumar, A., & Davenport, T. (2023). How to make generative AI greener. Harvard Business Review. https://hbr.org/2023/07/how-to-make-generative-ai-greener. Accessed 17 Oct 2023.

Moholy-Nagy, L. (1947). Vision in Motion. Theobald.

Partnership for 21st century skills: Framework for 21st century learning. (2018). http://www.p21.org/about-us/p21-framework. Accessed 17 Oct 2023.

Peters, M. A., Jackson, L., Papastephanou, M., Jandrić, P., Lazaroiu, G., Evers, C. W., ... & Fuller, S. (2023). AI and the future of humanity: ChatGPT-4, philosophy and education–Critical responses. Educational Philosophy and Theory, 1–35. https://doi.org/10.1080/00131857.2023.2213437

Philip, T. M., Bang, M., & Jackson, K. (2018). Articulating the “how”, the “for what”, the “for whom”, and the “with whom” in concert: A call to broaden the benchmarks of our scholarship. Cognition and Instruction, 36(2), 83–88. https://doi.org/10.1080/07370008.2018.1413530CrossRef

Postman, N. (1998). Five things we need to know about technological change. https://web.cs.ucdavis.edu/~rogaway/classes/188/materials/postman.pdf. Accessed 17 Oct 2023.

Schroeder, S., Curcio, R., & Lundgren, L. (2019). Expanding the learning network: How teachers use Pinterest. Journal of Research on Technology in Education, 51(2), 166–186. https://doi.org/10.1080/15391523.2019.1573354CrossRef

Simon, H. A. (1969). The sciences of the artificial (3rd ed.). MIT Press.

Stubenvoll, M., Heiss, R., & Matthes, J. (2021). Media trust under threat: Antecedents and consequences of misinformation perceptions on social media. International Journal of Communication Systems, 15, 22. https://ijoc.org/index.php/ijoc/article/view/15410. Accessed 17 Oct 2023.

Teitelbaum, K. (2022). Curriculum, conflict, and critical race theory. Phi Delta Kappan, 103(5), 47–53. https://doi.org/10.1177/00317217221079979CrossRef

The U.S. Surgeon General’s Advisory. (2023). Social media and youth mental health. Department of Health and Human Services. https://www.hhs.gov/sites/default/files/sg-youth-mental-health-social-media-advisory.pdf. Accessed 17 Oct 2023.

Turcotte, J., York, C., Irving, J., Scholl, R. M., & Pingree, R. J. (2015). News recommendations from social media opinion leaders: Effects on media trust and information seeking. Journal of Computer-Mediated Communication: JCMC, 20(5), 520–535. https://doi.org/10.1111/jcc4.12127CrossRef

Warr, M., & Mishra, P. (2021). Integrating the discourse on teachers and design: An analysis of ten years of scholarship. Teaching and Teacher Education, 99, 103274. https://doi.org/10.1016/j.tate.2020.103274CrossRef

Weiner, S., Warr, M., & Mishra, P. (2020). Fostering system-level perspective taking when designing for change in educational systems. TechTrends, 64, 779–788. https://doi.org/10.1007/s11528-020-00529-wCrossRef

What is Amara’s law and why it’s more important now than ever. (2022) In thevirtulab. https://thevirtulab.com/what-is-amaras-law/. Accessed 17 Oct 2023.

Winner, L. (1980). Do artifacts have politics? Daedalus, 109(1), 121–136. https://www.jstor.org/stable/20024652. Accessed 17 Oct 2023.

Wood, C. (2020). New York bans facial recognition at schools until at least 2022. Edscoop. https://edscoop.com/new-york-facial-recognition-ban/. Accessed 17 Oct 2023.

Young, J. (2021). Automated proctoring swept in during pandemic. It’s likely to stick around, despite concerns. EdSurge. https://www.edsurge.com/news/2021-11-19-automated-proctoring-swept-in-during-pandemic-it-s-likely-to-stick-around-despite-concerns. Accessed 17 Oct 2023.

Title: The Ethical Consequences, Contestations, and Possibilities of Designs in Educational Systems
Authors: Kevin Close
Melissa Warr
Punya Mishra
Publication date: 09-11-2023
Publisher: Springer US
Published in: TechTrends / Issue 1/2024
Print ISSN: 8756-3894
Electronic ISSN: 1559-7075
DOI: https://doi.org/10.1007/s11528-023-00900-7

Springer Professional

The Ethical Consequences, Contestations, and Possibilities of Designs in Educational Systems

Abstract

Premium Partner

Springer Professional

Abstract

Please log in to get access to your license.

Other articles of this Issue 1/2024

TechTrends: A New Year and Transitions

International Students' Unique Challenges and Reflections

The Change We Work: Professional Agency and Ethics for Emerging AI Technologies

Adapting to the Future: ChatGPT as a Means for Supporting Constructivist Learning Environments

Don’t put the Cart Before the Horse: Self-Study on Using VR in Education

In Consideration of Context: The Potential of Geographic Information Systems (GIS)