nach oben

Educational Assessment, Evaluation and Accountability

Erschienen in:

10.06.2020

COVID-19 and schooling: evaluation, assessment and accountability in times of crises—reacting quickly to explore key issues for policy, practice and research with the school barometer

verfasst von: Stephan Gerhard Huber, Christoph Helm

Erschienen in: Educational Assessment, Evaluation and Accountability | Ausgabe 2/2020

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config

KI-gestützte Suche

Aus

Abstract

The crisis caused by the COVID-19 virus has far-reaching effects in the field of education, as schools were closed in March 2020 in many countries around the world. In this article, we present and discuss the School Barometer, a fast survey (in terms of reaction time, time to answer and dissemination time) that was conducted in Germany, Austria and Switzerland during the early weeks of the school lockdown to assess and evaluate the current school situation caused by COVID-19. Later, the School Barometer was extended to an international survey, and some countries conducted the survey in their own languages. In Germany, Austria and Switzerland, 7116 persons participated in the German language version: 2222 parents, 2152 students, 1949 school staff, 655 school leaders, 58 school authority and 80 members of the school support system. The aim was to gather, analyse and present data in an exploratory way to inform policy, practice and further research. In this article, we present some exemplary first results and possible implications for policy, practice and research. Furthermore, we reflect on the strengths and limitations of the School Barometer and fast surveys as well as the methodological options for data collection and analysis when using a short monitoring survey approach. Specifically, we discuss the methodological challenges associated with survey data of this kind, including challenges related to hypothesis testing, the testing of causal effects and approaches to ensure reliability and validity. By doing this, we reflect on issues of assessment, evaluation and accountability in times of crisis.

Vorheriger Artikel Using test scores to evaluate and hold school teachers accountable in New Mexico

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

The full online questionnaire can be accessed at www.School-Barometer.net and Huber et al. (2020).

Artino, A. R. (2008). Motivational beliefs and perceptions of instructional quality: Predicting satisfaction with online training. Journal of Computer Assisted Learning, 24(3), 260–270. https://doi.org/10.1111/j.1365-2729.2007.00258.x.CrossRef

Bakker, A. B., & Demerouti, E. (2017). Job demands–resources theory: Taking stock and looking forward. Journal of Occupational Health Psychology, 22(3), 273–285.CrossRef

Bandura, A. (2001). Social cognitive theory: An Agentic perspective. Annual Review of Psychology, 52, 1–26. https://doi.org/10.1146/annurev.psych.52.1.1.CrossRef

Baumert, J., Kunter, M., Blum, W., Brunner, M., Voss, T., Jordan, A., et al. (2010). Teachers’ mathematical knowledge, cognitive activation in the classroom, and student progress. American Educational Research Journal, 47(1), 133–180. https://doi.org/10.3102/0002831209345157.CrossRef

Bollen, K. A., & Diamantopoulos, A. (2017). In defense of causal-formative indicators: A minority report. Psychological Methods, 22(3), 581–596. https://doi.org/10.1037/met0000056.CrossRef

Bronfenbrenner, U. (1996). The ecology of human development. Experiments by nature and design (9th ed.). Cambridge: Harvard University Press. https://doi.org/10.1080/00131728109336000.CrossRef

Calman, R. C. (2010). Exploring the underlying traits of high-performing schools. Education Quality and Accountability Office EQAO.

Chapman, C., Armstrong, P., Harris, A., Muijs, D., Reynolds, D., & Sammons, P. (2012). School effectiveness and improvement. Research, policy and practice. Challenging the Orthodoxy? London: Routledge.CrossRef

Cipriano, C., Barnes, T. N., Pieloch, K. A., Rivers, S. E., & Brackett, M. (2019). A multilevel approach to understanding student and teacher perceptions of classroom support during early adolescence. Learning Environments Research, 22(2), 209–228. https://doi.org/10.1007/s10984-018-9274-0.CrossRef

Coffman, D. L., & MacCallum, R. C. (2005). Using parcels to convert path analysis models into latent variable models. Multivariate Behavioral Research, 40(2), 235–259. https://doi.org/10.1207/s15327906mbr4002_4.CrossRef

Creemers, B., Kyriakides, L., & Sammons, P. (2010). Methodological advances in educational effectiveness research. London: Routledge.CrossRef

Cronbach, L. J. (1972a). Evaluation zur Verbesserung von Curricula. In C. Wulf (Ed.), Evaluation. Beschreibung und Bewertung von Unterricht, Curricula und Schulversuchen (pp. 41–59). München.

Cronbach, L. J. (1972b). Evaluation zur Verbesserung von curricula. [Evaluation to improve curricula.]. In C. Wulf (Ed.), Evaluation. Beschreibung und Bewertung von Unterricht, Curricula und Schulversuchen [Evaluation. Description and evaluation of teaching, curricula and school experiments] (pp. 41–59). Munich: Piper & co.

Datu, J. A. D. (2017). Sense of relatedness is linked to higher grit in a collectivist setting. Personality and Individual Differences, 105, 135–138. https://doi.org/10.1016/j.paid.2016.09.039.CrossRef

De Los Reyes, A., Thomas, S. A., Goodman, K. L., & Kundey, S. M. A. (2013). Principles underlying the use of multiple informants’ reports. Annual Review of Clinical Psychology, 9, 123–149. https://doi.org/10.1146/annurev-clinpsy-050212-185617.CrossRef

Desimone, L. M., Smith, T. M., & Frisvold, D. E. (2010). Survey measures of classroom instruction. Educational Policy, 24(2), 267–329. https://doi.org/10.1177/0895904808330173.CrossRef

Ditton, H. (2002a). Evaluation und Qualitätssicherung. [Evaluation and quality assurance.]. In R. Tippelt (Ed.), Handbuch Bildungsforschung [Handbook on Educational Research] (pp. 775–790). Opladen: Leske + Budrich.CrossRef

Ditton, H. (2002b). Evaluation und Qualitätssicherung. In R. Tippelt (Ed.), Handbuch Bildungsforschung (pp. 775–790). Opladen: Leske + Budrich.CrossRef

Eskreis-Winkler, L., Shulman, E. P., Beal, S. A., & Duckworth, A. L. (2014). The grit effect: Predicting retention in the military, the workplace, school and marriage. Frontiers in Psychology, 5(36), 1–12. https://doi.org/10.3389/fpsyg.2014.00036.CrossRef

Gideon, L. (Ed.). (2012). Handbook of Survey Methodology for the Social Sciences. New York: Springer.

Haagerup, U. (2017). Constructive news. Copenhagen: Aarhus University Press.CrossRef

Hallinger, P., & Huber, S. G. (2012). School leadership that makes a difference: International perspectives. School Effectiveness and School Improvement, 23(4), 1–9. https://doi.org/10.1080/09243453.2012.681508.CrossRef

Hargreaves, A., Lieberman, A., Fullan, M., & Hopkins, D. W. (1998). International handbook of educational change. Dordrecht: Springer.CrossRef

Harris, A., & Jones, M. (2012). Professional learning communities and system improvement. Improving Schools, 13(2), 172–181. https://doi.org/10.1177/1365480210376487.CrossRef

Harris, A., Chapman, C., Muijs, D., Russ, J., & Stoll, L. (2006). Improving schools in challenging circumstances: Exploring the possible. School Effectiveness and School Improvement, 17, 409–424. https://doi.org/10.1080/09243450600743483.CrossRef

Hattie, J. (2009). Visible learning. New York: Routledge.

Hawkes, M. (1996). Criteria for evaluating school-based distance education programs. NASSP Bulletin, 80(581), 45–52. https://doi.org/10.1177/019263659608058115.CrossRef

Hopkins, D., Harris, A., Stoll, L., & Mackay, T. (2011). School and school improvement: State of the art review. In Keynote presentation prepared for the 24th international congress of school effectiveness and school improvement. Limassol: Cyprus.

Huber, S.G. (2013). Forschung zu Belastung und Beanspruchung von Schulleitung. [Research on strain and stress of school leaders.] In S.G. Huber (Ed.), Jahrbuch Schulleitung 2013. Befunde und Impulse zu den Handlungsfeldern des Schulmanagements [Yearbook School Leadership 2013. Impulses from research and practice] (pp. 222-240). Köln: Wolters Kluwer Deutschland.

Huber, S.G. (2014). Kooperative Bildungslandschaften. Netzwerke(n) im und mit System. [Cooperative education landscapes. Networking systematically in the system.] Neuwied/Kronach/München: LinkLuchterhand/WoltersKluwer.

Huber, S. G. (2016a). Germany: The school leadership research base in Germany. In H. Ärlestig, C. Day, & O. Johansson (Eds.), A decade of research on school principals (pp. 375–401). Dordrecht: Springer.CrossRef

Huber, S. G. (2016b). Switzerland: The school leadership research base in Switzerland. In H. Ärlestig, C. Day, & O. Johansson (Eds.), A decade of research on school principals (pp. 421–442). Dordrecht: Springer.CrossRef

Huber, S. G. (2018). No simple fixes for schools in challenging circumstances. Contextualization for Germany. In C. Meyers & M. Darwin (Eds.), International perspectives on leading low-performing schools (pp. 243–266). Charlotte: Information Age Publishing.

Huber, S.G. (2020). Responsible leaders entwickeln Schule in der balance von Bewahren, Optimieren, Innovieren. [Responsible leaders develop schools keeping the balance between maintaining, optimizing, innovating.] In S.G. Huber (Ed.), Jahrbuch Schulleitung 2020. Impulse aus Wissenschaft und Praxis. [Yearbook School Leadership 2020. Impulses from research and practice (pp. 3-14).] Köln: Wolters Kluwer Deutschland.

Huber, S.G. & Ahlgrimm, F. (2012). Kooperation: Aktuelle Forschung zur Kooperation in und zwischen Schulen sowie mit anderen Partnern. [Cooperation. Current research on collaboration in and among schools as well as with external partners.] Münster u.a.: Waxmann.

Huber, S. G., & Muijs, D. (2010). School leadership effectiveness. The growing insight in the importance of school leadership for the quality and development of schools and their pupils. In S. G. Huber (Ed.), School leadership - international perspectives (pp. 57–78). Dordrecht: Springer.CrossRef

Huber, S.G. & Robinson, V. (2016). World school leadership study: practices and resilience. Symposium at the Meeting of the World Education Research Association (WERA) in conjunction with the Annual Meeting of the American Educational Research Association (AERA), 8.-12. April 2016 in Washington D.C.

Huber, S. & Spillane, J. (2016). World school leadership study – concept and design. Symposium at the European Congress on Educational Research of the European Educational Research Association, 23.-26. August 2016 in Dublin, Irland.

Huber, S.G. & Spillane, J. (2018). Mapping the field of research on education leadership administration and management: methodological, thematical and regional perspective. Symposium at the European Congress on Educational Research of the European Educational Research Association. 3.-4. September 2018 in Bozen, Italy.

Huber, S.G., Hader-Popp, S. & Schneider, N. (2014). Qualität und Entwicklung von Schule: Basiswissen Schulmanagement. [Quality and development of schools. Basic knowledge school management.] Reihe »BildungsWissen Lehramt«. [Series education knowledge for the teaching profession.] Weinheim und Basel: Beltz Verlag.

Huber, S. G. & Helm, C. (2020). Lernen in Zeiten der Corona-Pandemie. Die Rolle familiärer Merkmale für das Lernen von Schüler*innen: Befunde vom Schul-Barometer in Deutschland, Österreich und der Schweiz. [Learning in Times of the Corona Pandemic. The Role of Family Features for the Learning of Students.] Die Deutsche Schule, 16, 11-34. https://doi.org/10.31244/9783830992318.02.

Huber, S. G., Günther, P. S., Schneider, N., Helm, C., Schwander, M., Schneider, J. A., & Pruitt, J. (2020). COVID-19 – aktuelle Herausforderungen in Schule und Bildung. In Erste Befunde des Schul-Barometers in Deutschland, Österreich und der Schweiz. Münster: Waxmann. Retrieved May 26, 2020, from www.School-Barometer.net.

Johansen, W., Aggerholm, H. K., & Frandsen, F. (2012). Entering new territory: A study of internal crisis management and crisis communication in organizations. Public Relations Review, 38(2), 270–279. https://doi.org/10.1016/j.pubrev.2011.11.008.CrossRef

Karasek, R. A. (1979). Job Demands, Job Decision Latitude, and Mental Strain: Implications for Job Redesign. Administrative Science Quarterly. Vol. 2(24), 285–308. https://doi.org/10.2307/2392498, JSTOR 2392498.

Klieme, E., Pauli, C., & Reusser, K. (2009). The Pythagoras study: Investigating effects of teaching and learning in Swiss and German mathematics classrooms. In T. Janik & T. Seidel (Eds.), The power of video studies in investigating teaching and learning in the classroom (pp. 137–160). Münster u.a.: Waxmann. Retrieved from http://www.ciando.com/ebook/bid-40151

Kundu, A. (2017). Grit and agency: A framework for helping students in poverty to achieve academic greatness. National Youth-At-Risk Journal, 2(2), 69–80. https://doi.org/10.20429/nyarj.2017.020205.CrossRef

Kunter, M., Baumert, J., & Köller, O. (2007). Effective classroom management and the development of subject-related interest. Learning and Instruction, 17(5), 494–509. https://doi.org/10.1016/j.learninstruc.2007.09.002.CrossRef

Kunter, M., Tsai, Y.-M., Klusmann, U., Brunner, M., Krauss, S., & Baumert, J. (2008). Students’ and mathematics teachers’ perceptions of teacher enthusiasm and instruction. Learning and Instruction, 18(5), 468–482. https://doi.org/10.1016/j.learninstruc.2008.06.008.CrossRef

Kunter, M., Baumert, J., Blum, W., Klusmann, U., Krauss, S., & Neubrand, M. (Eds.). (2013). Cognitive activation in the mathematics classroom and professional competence of teachers. Results from the COACTIV project. New York: Springer. https://doi.org/10.1007/978-1-4614-5149-5.CrossRef

Larmuseau, C., Desmet, P., & Depaepe, F. (2019). Perceptions of instructional quality: Impact on acceptance and use of an online learning environment. Interactive Learning Environments, 27(7), 953–964. https://doi.org/10.1080/10494820.2018.1509874.CrossRef

Lazarus, R. S., & Folkman, S. (1984). Stress, appraisal, and coping. New York: Springer.

Maak, T., & Pless, N. M. (2006). Responsible leadership. London: Routledge.CrossRef

MacKenzie, S. B., Podsakoff, P. M., & Podsakoff, N. P. (2011). Construct measurement and validation procedures in MIS and behavioral research: Integrating new and existing techniques. MIS Quarterly, 35(2), 293–334. https://doi.org/10.2307/23044045.CrossRef

Margaryan, A., Bianco, M., & Littlejohn, A. (2015). Instructional quality of Massive Open Online Courses (MOOCs). Computers & Education, 80, 77–83. https://doi.org/10.1016/j.compedu.2014.08.005.CrossRef

McArdle, J. J. (2009). Latent variable modeling of differences and changes with longitudinal data. Annual Review of Psychology, 60, 577–605. https://doi.org/10.1146/annurev.psych.60.110707.163612.CrossRef

Mitchell, M. M., Bradshaw, C. P., & Leaf, P. J. (2010). Student and teacher perceptions of school climate: A multilevel exploration of patterns of discrepancy. Journal of School Health, 80(6), 271–279. https://doi.org/10.1111/j.1746-1561.2010.00501.x.CrossRef

Moos, L., & Huber, S. G. (2007). School leadership, school effectiveness and school improvement: Democratic and integrative leadership. In T. Townsend (Ed.), International handbook of school effectiveness and improvement (pp. 579–596). Dordrecht: Springer.CrossRef

Muijs, D., West, M., & Ainscow, M. (2010). Why network? Theoretical perspectives on networking. School Effectiveness and School Improvement, 21(1), 5–26. https://doi.org/10.1080/09243450903569692.CrossRef

Pearson, C. M., Roux-Dufort, C., & Clair, J. A. (2007). International handbook of organizational crises management. Thousand Oaks: Sage.

Podsakoff, P. M., MacKenzie, S. B., Lee, J.-Y., & Podsakoff, N. P. (2003). Common method biases in behavioral research. A critical review of the literature and recommended remedies. Journal of Applied Psychology, 88(5), 879–903. https://doi.org/10.1037/0021-9010.88.5.879.CrossRef

Robert, A., & Karasek, J. (1979). Job demands, job decision latitude, and mental strain. Implications for Job Redesign. Administrative Science Quarterly, 24(2), 285–308. https://doi.org/10.2307/2392498.CrossRef

Robinson, V. M., Lloyd, C. A., & Rowe, K. J. (2008). The impact of leadership on student outcomes: An analysis of the differential effects of leadership types. Educational Administration Quarterly, 44(5), 635–674. https://doi.org/10.1177/0013161X08321509.CrossRef

Rosenholtz, S. J. (1989). Teachers’ workplace. The social organization of schools. New York: Longman.

Rosenthal, U., & Kouzmin, A. (1993). Globalizing an agenda for contingencies and crisis management: An editorial statement. Journal of Contingencies & Crisis Management, 1, 1–12. https://doi.org/10.1111/j.1468-5973.1993.tb00001.x.CrossRef

Rosenthal, U., & Kouzmin, A. (1997). Crises and crisis management: Towards comprehensive government decision making. Journal of Public Administration Research and Thoery, 7, 277–304. https://doi.org/10.1093/oxfordjournals.jpart.a024349.CrossRef

Schneider, S. (1995). Flirting with disaster. Public management in crisis situations. New York: M.E. Sharpe.

Schnell, R., & Noack, M. (2017). Sampling, non-response and weighting methods for victimisation surveys. In N. Leitgöb-Guzy, C. Birkel, & R. Mischkowitz (Eds.), Victimisation surveys in Germany (pp. 82–85). Wiesbaden: Bundeskriminalamt.

Stone-Johnson, C. (2013). Responsible leadership. Educational Administration Quarterly, 50(4), 645–674. https://doi.org/10.1177/0013161X13510004.CrossRef

Stoop, I., & Harrison, E. (2012). Classification of Surveys. In L. Gideon (Ed.), Handbook of Survey Methodology for the Social Sciences, pp. 7–21. New York: Springer. https://doi.org/10.1007/978-1-4614-3876-2_2.

Strayhorn, T. L. (2014). What role does grit play in the academic success of black male collegians at predominantly white institutions? Journal of African American Studies, 18(1), 1–10. https://doi.org/10.1007/s12111-012-9243-0.CrossRef

Su, R., Zhang, Q., Liu, Y., & Tay, L. (2019). Modeling congruence in organizational research with latent moderated structural equations. Journal of Applied Psychology, 104(11), 1404–1433. https://doi.org/10.1037/apl0000411.CrossRef

Teddlie, C. & Stringfield, S. (2007). A History of School Effectiveness and Improvement Research in the USA focusing on the Past Quarter Century. In T. Townsend (Ed.), International Handbook of School Effectiveness and Improvement, p. 131–166. Dordrecht: Springer. https://doi.org/10.1007/978-1-4020-5747-2.

Tian, M., & Huber, S. G. (2019). Mapping educational leadership, administration and management research 2007–2016: Thematic strands and the changing landscape. Journal of Educational Administration, 58(2), 129–150. https://doi.org/10.1108/JEA-12-2018-0234.CrossRef

Trautwein, U., Lüdtke, O., Schnyder, I., & Niggli, A. (2006). Predicting homework effort: Support for a domain-specific, multilevel homework model. Journal of Educational Psychology, 98(2), 438–456. https://doi.org/10.1037/0022-0663.98.2.438.

Vardarlier, P. (2016). Strategic approach to human resources management during crisis. Procedia - Social and Behavioral Sciences, 235, 463–472. https://doi.org/10.1016/j.sbspro.2016.11.057.CrossRef

Weber, C. (2017). Problems in the validation of cluster level constructs measured by individual level ratings. Presentation at the 23rd Workshop Applied Classification Analysis (Nov., 2017).

Weick, K. E. (1988). Enacted sensemaking in crisis situation. Journal of Management Studies, 25(4), 305–317. https://doi.org/10.1111/j.1467-6486.1988.tb00039.x.CrossRef

Weick, K. E. (2010). Reflection on enacted sensemaking in the Bhopal disaster. Journal of Management Studies, 47, 537–550. https://doi.org/10.1111/j.1467-6486.2010.00900.x.CrossRef

West, M. A., & Hirst, G. (2003). Cooperation and teamwork for innovation. In M. A. West, D. Tjosvold, & K. G. Smith (Eds.), International handbook of teamwork and cooperative working (pp. 297–321). New York: Wiley.CrossRef

Wettstein, A., Ramseier, E., Scherzinger, M., & Gasser, L. (2016a). Unterrichtsstörungen aus Lehrer- und Schülersicht. Zeitschrift für Entwicklungspsychologie und Pädagogische Psychologie, 48(4), 171–183. https://doi.org/10.1026/0049-8637/a000159.CrossRef

Wettstein, A., Ramseier, E., Scherzinger, M., & Gasser, L. (2016b). Unterrichtsstörungen aus Lehrer- und Schülersicht. [Class disorders from the teacher and student perspective.]. Zeitschrift für Entwicklungspsychologie und Pädagogische Psychologie [Journal for Developmental and Educational Psychology], 48(4), 171–183. https://doi.org/10.1026/0049-8637/a000159.CrossRef

Wettstein, A., Scherzinger, M., & Ramseier, E. (2018a). Empirische Arbeit: Unterrichtsstörungen, Beziehung und Klassenführung aus Lehrer-, Schüler- und Beobachterperspektive. Psychologie in Erziehung und Unterricht, 65(1), 58–74. https://doi.org/10.2378/peu2018.art04d.CrossRef

Wettstein, A., Scherzinger, M., & Ramseier, E. (2018b). Empirische Arbeit: Unterrichtsstörungen, Beziehung und Klassenführung aus Lehrer-, Schüler- und Beobachterperspektive. [Empirical work: Class disorders, relationship and classroom management from the teacher, student and observer perspective.]. Psychologie in Erziehung und Unterricht [Psychology in education and teaching], 65(1), 58–74. https://doi.org/10.2378/peu2018.art04d.CrossRef

Titel: COVID-19 and schooling: evaluation, assessment and accountability in times of crises—reacting quickly to explore key issues for policy, practice and research with the school barometer
verfasst von: Stephan Gerhard Huber
Christoph Helm
Publikationsdatum: 10.06.2020
Verlag: Springer Netherlands
Erschienen in: Educational Assessment, Evaluation and Accountability / Ausgabe 2/2020
Print ISSN: 1874-8597
Elektronische ISSN: 1874-8600
DOI: https://doi.org/10.1007/s11092-020-09322-y

Springer Professional

Abstract

Bitte loggen Sie sich ein, um Zugang zu Ihrer Lizenz zu erhalten.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Wirtschaft"

Weitere Artikel der Ausgabe 2/2020

Correction to: An integral perspective on teacher evaluation: a review of empirical studies

Using test scores to evaluate and hold school teachers accountable in New Mexico

Assessment and evaluation with clarifying purposes for policy and practice

Assessment policies and practices in contexts of diversity: unravelling the tensions

Missing children: how Chilean schools evaded accountability by having low-performing students miss high-stakes tests

An integral perspective on teacher evaluation: a review of empirical studies

Premium Partner