Skip to main content
Top
Published in: Learning Environments Research 3/2022

19-10-2021 | Original Paper

Measure of opportunity: assessing equitable conditions to learn twenty-first century thinking skills

Authors: Ross C. Anderson, Paul Beach

Published in: Learning Environments Research | Issue 3/2022

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Many school change efforts aim to foster conditions for the development of students’ twenty-first century skills in an equitable and comprehensive way, but methods to measure the frequency and quality of opportunities that students receive in school are lacking. In this study, we describe the design, testing, and initial evaluation of a self-report measure of high-school students’ opportunity to learn and apply a core set of intrapersonal and interpersonal twenty-first century skills—collaboration, communication, creativity, critical thinking, and self-directed learning. Our sample included 9th graders (n = 522) from one large comprehensive high school in central California. Confirmatory factor analysis and multivariate regression modeling suggest promising reliability and validity to evaluate opportunities in high school learning environments. Based on this early evidence, the Student MetaSkills Survey appears to provide a way for school leaders and educators to evaluate the frequency and quality of key twenty-first century skills and take responsibility for providing equitable opportunities for students. Measuring inputs and processes, such as students’ opportunity-to-learn, can play an important role in the process of educational improvement.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Appendix
Available only for authorised users
Literature
go back to reference Alspaugh, J. W. (1998). Achievement loss associated with the transition to middle school and high school. The Journal of Educational Research, 92, 20–25.CrossRef Alspaugh, J. W. (1998). Achievement loss associated with the transition to middle school and high school. The Journal of Educational Research, 92, 20–25.CrossRef
go back to reference American Institutes for Research. (2016). Does deeper learning improve student outcomes? Results from the Study of Deeper Learning: Opportunities and outcomes. Washington, DC: American Institutes for Research American Institutes for Research. (2016). Does deeper learning improve student outcomes? Results from the Study of Deeper Learning: Opportunities and outcomes. Washington, DC: American Institutes for Research
go back to reference Ananiadou, K., & Claro, M. (2009). 21st century skills and competences for new millennium learners in OECD countries (OECD Education Working Papers, No. 41). OECD Publishing. Ananiadou, K., & Claro, M. (2009). 21st century skills and competences for new millennium learners in OECD countries (OECD Education Working Papers, No. 41). OECD Publishing.
go back to reference Beghetto, R. A. (2016). Creative learning: A fresh look. Journal of Cognitive Education and Psychology, 15, 6–23.CrossRef Beghetto, R. A. (2016). Creative learning: A fresh look. Journal of Cognitive Education and Psychology, 15, 6–23.CrossRef
go back to reference Beghetto, R. A., & Kaufman, J. C. (2007). Toward a broader conception of creativity: A case for mini-c creativity. Psychology of Aesthetics, Creativity, and the Arts, 1, 73–79.CrossRef Beghetto, R. A., & Kaufman, J. C. (2007). Toward a broader conception of creativity: A case for mini-c creativity. Psychology of Aesthetics, Creativity, and the Arts, 1, 73–79.CrossRef
go back to reference Bitter, C., Taylor, J., Zeiser, K. L., & Rickles, J. (2014). Providing opportunities for deeper learning. American Institutes for Research. Bitter, C., Taylor, J., Zeiser, K. L., & Rickles, J. (2014). Providing opportunities for deeper learning. American Institutes for Research.
go back to reference Bolhuis, S., & Voeten, M. J. M. (2001). Toward self-directed learning in secondary schools: What do teachers do?. Teacher and Teacher Education, 17, 837–855. Bolhuis, S., & Voeten, M. J. M. (2001). Toward self-directed learning in secondary schools: What do teachers do?. Teacher and Teacher Education, 17, 837–855.
go back to reference Booth, W. C. (2004). The rhetoric of rhetoric: The quest for effective communication. Malden, MA: Blackwell. Booth, W. C. (2004). The rhetoric of rhetoric: The quest for effective communication. Malden, MA: Blackwell.
go back to reference Bronson, M. B. (2001). Self-regulation in early childhood: Nature and nurture. New York, NY: Guilford Press. Bronson, M. B. (2001). Self-regulation in early childhood: Nature and nurture. New York, NY: Guilford Press.
go back to reference Brown, T. (2006). Confirmatory factor analysis for applied research. Guildford. Brown, T. (2006). Confirmatory factor analysis for applied research. Guildford.
go back to reference Care, E., Anderson, K., & Kim, H. (2016). Visualizing the breadth of skills movement across educational systems. Center for Universal Education at Brookings. Care, E., Anderson, K., & Kim, H. (2016). Visualizing the breadth of skills movement across educational systems. Center for Universal Education at Brookings.
go back to reference Cohen, J. (1992). A power primer. Pyschological Bulletin, 112(1), 155–159.CrossRef Cohen, J. (1992). A power primer. Pyschological Bulletin, 112(1), 155–159.CrossRef
go back to reference Conley, D. T. (2013). Rethinking the notion of “noncognitive.” Education Week, 32(18), 20–21. Conley, D. T. (2013). Rethinking the notion of “noncognitive.” Education Week, 32(18), 20–21.
go back to reference Costa, A. L., & Kallick, B. (2004). Assessment strategies for self-directed learning. Thousand Oaks, CA: Corwin Press. Costa, A. L., & Kallick, B. (2004). Assessment strategies for self-directed learning. Thousand Oaks, CA: Corwin Press.
go back to reference Council of Chief State School Officers. (2013). Knowledge, skills, and dispositions: The Innovation Lab Network state framework for college, career, and citizenship readiness, and implications for state policy. Retrieved from www.ccsso.org Council of Chief State School Officers. (2013). Knowledge, skills, and dispositions: The Innovation Lab Network state framework for college, career, and citizenship readiness, and implications for state policy. Retrieved from www.​ccsso.​org
go back to reference Darling-Hammond, L. (2010). The flat world and education: How America’s commitment to equity will determine our future. Teachers College Press. Darling-Hammond, L. (2010). The flat world and education: How America’s commitment to equity will determine our future. Teachers College Press.
go back to reference Datnow, A., & Park, V. (2018). Opening or closing doors for students: Equity and data use in schools. Journal of Educational Change, 19, 131–152.CrossRef Datnow, A., & Park, V. (2018). Opening or closing doors for students: Equity and data use in schools. Journal of Educational Change, 19, 131–152.CrossRef
go back to reference Davis, G. (1999). Barriers to creativity and creative attitudes. In M. A. Runco & S. Pritzker (Eds.), Encyclopedia of creativity (pp. 165–174). Academic Press. Davis, G. (1999). Barriers to creativity and creative attitudes. In M. A. Runco & S. Pritzker (Eds.), Encyclopedia of creativity (pp. 165–174). Academic Press.
go back to reference Dillman, D., Smyth, J., & Christian, L. (2014). Internet, phone, mail, and mixed-mode surveys: The tailored design method. Wiley. Dillman, D., Smyth, J., & Christian, L. (2014). Internet, phone, mail, and mixed-mode surveys: The tailored design method. Wiley.
go back to reference Dreyfus, S. E., & Dreyfus, H. L. (1980). A five-stage model of the mental activities involved in directed skill acquisition (No. ORC-80–2). Berkeley, CA: University of California Operations Research Center. Dreyfus, S. E., & Dreyfus, H. L. (1980). A five-stage model of the mental activities involved in directed skill acquisition (No. ORC-80–2). Berkeley, CA: University of California Operations Research Center.
go back to reference Dreyfus, H. L., & Dreyfus, S. E. (2005). Peripheral vision: Expertise in real world contexts. Organizational Studies, 26, 779–792.CrossRef Dreyfus, H. L., & Dreyfus, S. E. (2005). Peripheral vision: Expertise in real world contexts. Organizational Studies, 26, 779–792.CrossRef
go back to reference Elder, L., & Paul, R. (2007). Critical thinking: The nature of critical and creative thought, Part II. Journal of Developmental Education, 30(3), 36–37. Elder, L., & Paul, R. (2007). Critical thinking: The nature of critical and creative thought, Part II. Journal of Developmental Education, 30(3), 36–37.
go back to reference Finke, R. A., Ward, T. B., & Smith, S. M. (1992). Creative cognition: Theory, research, and application. MIT Press. Finke, R. A., Ward, T. B., & Smith, S. M. (1992). Creative cognition: Theory, research, and application. MIT Press.
go back to reference Flavell, J. H. (1979). Metacognition and cognitive monitoring: A new area of cognitive–developmental inquiry. American Psychologist, 34, 906–911.CrossRef Flavell, J. H. (1979). Metacognition and cognitive monitoring: A new area of cognitive–developmental inquiry. American Psychologist, 34, 906–911.CrossRef
go back to reference Geisinger, K. (2016). 21st century skills: What are they and how do we assess them? Applied Measurement in Education, 29, 245–249.CrossRef Geisinger, K. (2016). 21st century skills: What are they and how do we assess them? Applied Measurement in Education, 29, 245–249.CrossRef
go back to reference Green, J. O., & Burleson, B. R. (Eds.). (2008). Handbook of communication and social interaction skills. Mahwah, NJ: Erlbaum. Green, J. O., & Burleson, B. R. (Eds.). (2008). Handbook of communication and social interaction skills. Mahwah, NJ: Erlbaum.
go back to reference Guha, R., Caspary, K., Stites, R., Padilla, C., Arshan, N., Park, C., Tse, V., Astudillo, S., Black, A., & Adelman, N. (2014). Taking stock of the California Linked Learning District Initiative: Fifth-year evaluation report. Menlo Park, CA: SRI International. Guha, R., Caspary, K., Stites, R., Padilla, C., Arshan, N., Park, C., Tse, V., Astudillo, S., Black, A., & Adelman, N. (2014). Taking stock of the California Linked Learning District Initiative: Fifth-year evaluation report. Menlo Park, CA: SRI International.
go back to reference Heckman, J. J., & Rubinstein, Y. (2001). The importance of noncognitive skills: Lessons from the GED testing program. American Economic Review, 91, 145–149.CrossRef Heckman, J. J., & Rubinstein, Y. (2001). The importance of noncognitive skills: Lessons from the GED testing program. American Economic Review, 91, 145–149.CrossRef
go back to reference Kline, R. (2016). Principles and practice of structural equation modeling (4th ed.). Guilford Press. Kline, R. (2016). Principles and practice of structural equation modeling (4th ed.). Guilford Press.
go back to reference Ladson-Billings, G. (2006). From the achievement gap to the education debt: Understanding achievement in U.S. schools. Educational Researcher, 35, 3–12.CrossRef Ladson-Billings, G. (2006). From the achievement gap to the education debt: Understanding achievement in U.S. schools. Educational Researcher, 35, 3–12.CrossRef
go back to reference Lench, S., Fukuda, E., & Anderson, R. C. (2015). Essential skills and dispositions: Developmental frameworks for collaboration, creativity, communication, and self-direction. Lexington, KY: Center for Innovation in Education at the University of Kentucky. Retrieved at https://www.leadingwithlearning.org/esd Lench, S., Fukuda, E., & Anderson, R. C. (2015). Essential skills and dispositions: Developmental frameworks for collaboration, creativity, communication, and self-direction. Lexington, KY: Center for Innovation in Education at the University of Kentucky. Retrieved at https://​www.​leadingwithlearn​ing.​org/​esd
go back to reference Lucas, B. (2016). A five-dimensional model of creativity and its assessment in schools. Applied Measurement in Education, 29, 278–290.CrossRef Lucas, B. (2016). A five-dimensional model of creativity and its assessment in schools. Applied Measurement in Education, 29, 278–290.CrossRef
go back to reference MacCallum, R., Widaman, K., Zhang, S., & Hong, S. (1999). Sample size in factor analysis. Psychological Methods, 4, 84–99.CrossRef MacCallum, R., Widaman, K., Zhang, S., & Hong, S. (1999). Sample size in factor analysis. Psychological Methods, 4, 84–99.CrossRef
go back to reference Martin, C., Nacu, D., & Pinkard, N. (2016). Revealing opportunities for 21st century learning: An approach to interpreting user trace log data. Journal of Learning Analytics, 3, 37–87.CrossRef Martin, C., Nacu, D., & Pinkard, N. (2016). Revealing opportunities for 21st century learning: An approach to interpreting user trace log data. Journal of Learning Analytics, 3, 37–87.CrossRef
go back to reference Muthén, L., & Muthén, B. (2012). Mplus user’s guide (7th ed.). Los Angeles: Muthén & Muthén. Muthén, L., & Muthén, B. (2012). Mplus user’s guide (7th ed.). Los Angeles: Muthén & Muthén.
go back to reference National Research Council. (2001). Adding it up: Helping children learn mathematics. Washington, DC: National Academy Press National Research Council. (2001). Adding it up: Helping children learn mathematics. Washington, DC: National Academy Press
go back to reference National Research Council. (2012). Education for life and work: Developing transferable knowledge and skills in the 21st Century (Committee on defining deeper learning and 21st century skills, J.W. Pellegrino and M. L. Hilton, Eds., Board on Testing and Assessment and Board on Science Education, Division of Behavioral and Social Sciences and Education). Washington, DC: The National Academies Press. National Research Council. (2012). Education for life and work: Developing transferable knowledge and skills in the 21st Century (Committee on defining deeper learning and 21st century skills, J.W. Pellegrino and M. L. Hilton, Eds., Board on Testing and Assessment and Board on Science Education, Division of Behavioral and Social Sciences and Education). Washington, DC: The National Academies Press.
go back to reference Orfield, G. (2014). Tenth annual Brown lecture in education research: A new civil rights agenda for American education. Educational Researcher, 43, 273–292.CrossRef Orfield, G. (2014). Tenth annual Brown lecture in education research: A new civil rights agenda for American education. Educational Researcher, 43, 273–292.CrossRef
go back to reference Perry, L., Their, M., Beach, P., Anderson, R. C., Roberts, P., & Thoennessen, M. (under review). Opportunities and conditions to learn (OCL): A conceptual framework. Perry, L., Their, M., Beach, P., Anderson, R. C., Roberts, P., & Thoennessen, M. (under review). Opportunities and conditions to learn (OCL): A conceptual framework.
go back to reference Plucker, J. A. (2005). The (relatively) generalist view of creativity. In J. C. Kaufman & J. Baer (Eds.), Creativity across domains: Faces of the muse (pp. 307–312). Mahwah, NJ: Erlbaum. Plucker, J. A. (2005). The (relatively) generalist view of creativity. In J. C. Kaufman & J. Baer (Eds.), Creativity across domains: Faces of the muse (pp. 307–312). Mahwah, NJ: Erlbaum.
go back to reference Raykov, T. (2004). Behavioral scale reliability and measurement invariance evaluation using latent variable modeling. Behavior Therapy, 35, 299–331.CrossRef Raykov, T. (2004). Behavioral scale reliability and measurement invariance evaluation using latent variable modeling. Behavior Therapy, 35, 299–331.CrossRef
go back to reference Rickheit, G., & Strohner, H. (Eds.). (2008). Handbook of communication competence. Berlin, Germany: Mounton de Gruyter. Rickheit, G., & Strohner, H. (Eds.). (2008). Handbook of communication competence. Berlin, Germany: Mounton de Gruyter.
go back to reference Ritchhart, R. (2002). Intellectual character: What it is, why it matters, and how to get it. San Francisco, CA: Jossey-Bass. Ritchhart, R. (2002). Intellectual character: What it is, why it matters, and how to get it. San Francisco, CA: Jossey-Bass.
go back to reference Runco, M. A., & Chand, I. (1995). Cognition and creativity. Educational Psychology Review, 7, 243–267.CrossRef Runco, M. A., & Chand, I. (1995). Cognition and creativity. Educational Psychology Review, 7, 243–267.CrossRef
go back to reference Schacter, J., Thum, Y., & Zifkin, D. (2006). How much does creative teaching enhance elementary school students’ achievement? Journal of Creative Behavior, 40(1), 47–72.CrossRef Schacter, J., Thum, Y., & Zifkin, D. (2006). How much does creative teaching enhance elementary school students’ achievement? Journal of Creative Behavior, 40(1), 47–72.CrossRef
go back to reference Shadish, W., Cook, T., & Campbell, D. (2002). Experimental and quasi-experimental design for generalized causal inference. CA: Wadsworth Cengage Learning. Shadish, W., Cook, T., & Campbell, D. (2002). Experimental and quasi-experimental design for generalized causal inference. CA: Wadsworth Cengage Learning.
go back to reference Soland, J., Stecher, B. M., & Hamilton, L. S. (2013). Measuring 21st-century competencies: Guidance for educators. Asia Society & RAND. Soland, J., Stecher, B. M., & Hamilton, L. S. (2013). Measuring 21st-century competencies: Guidance for educators. Asia Society & RAND.
go back to reference Tabachnick, B. G., & Fidell, L. S. (1996). Using multivariate statistics (3rd ed.). HarperCollins. Tabachnick, B. G., & Fidell, L. S. (1996). Using multivariate statistics (3rd ed.). HarperCollins.
go back to reference The College Board. (2013). A review of the connections between the common core state standards and the next generation arts standards. New York, NY: Author. The College Board. (2013). A review of the connections between the common core state standards and the next generation arts standards. New York, NY: Author.
go back to reference The College Board. (2014). The arts and the Common Core: A comparison of the national core arts standards and the common core state standards. New York, NY: Author. The College Board. (2014). The arts and the Common Core: A comparison of the national core arts standards and the common core state standards. New York, NY: Author.
go back to reference The Secretary's Commission on Achieving Necessary Skills. (1991). What work requires of schools: A SCANS report for America 2000. Washington DC: U.S. Department of Labor The Secretary's Commission on Achieving Necessary Skills. (1991). What work requires of schools: A SCANS report for America 2000. Washington DC: U.S. Department of Labor
go back to reference Treffinger, D. J., & Isaksen, S. G. (2005). Creative problem solving: The history, development, and implications for gifted education and talent development. Gifted Child Quarterly, 49(4), 342–353. Treffinger, D. J., & Isaksen, S. G. (2005). Creative problem solving: The history, development, and implications for gifted education and talent development. Gifted Child Quarterly, 49(4), 342–353.
go back to reference Volet, S., Summers, M., & Thurman, J. (2009). High-level co-regulation in collaborative learning: How does it emerge and how is it sustained? Learning and Instruction, 19, 128–143.CrossRef Volet, S., Summers, M., & Thurman, J. (2009). High-level co-regulation in collaborative learning: How does it emerge and how is it sustained? Learning and Instruction, 19, 128–143.CrossRef
go back to reference Wallas, G. (1926). The art of thought. Harcourt Brace and World. Wallas, G. (1926). The art of thought. Harcourt Brace and World.
go back to reference Weinberger, A., Stegmann, K., & Fischer, F. (2007). Knowledge convergence in collaborative learning: Concepts and assessment. Learning and Instruction, 17, 416–426.CrossRef Weinberger, A., Stegmann, K., & Fischer, F. (2007). Knowledge convergence in collaborative learning: Concepts and assessment. Learning and Instruction, 17, 416–426.CrossRef
go back to reference Zerihun, Z., Beishuizen, J., & Van Os, W. (2012). Student learning experience as indicator of teaching quality. Educational Assessment, Evaluation and Accountability, 24, 99–111.CrossRef Zerihun, Z., Beishuizen, J., & Van Os, W. (2012). Student learning experience as indicator of teaching quality. Educational Assessment, Evaluation and Accountability, 24, 99–111.CrossRef
Metadata
Title
Measure of opportunity: assessing equitable conditions to learn twenty-first century thinking skills
Authors
Ross C. Anderson
Paul Beach
Publication date
19-10-2021
Publisher
Springer Netherlands
Published in
Learning Environments Research / Issue 3/2022
Print ISSN: 1387-1579
Electronic ISSN: 1573-1855
DOI
https://doi.org/10.1007/s10984-021-09388-5

Other articles of this Issue 3/2022

Learning Environments Research 3/2022 Go to the issue

Premium Partner