nach oben

Educational Assessment, Evaluation and Accountability

Erschienen in:

26.11.2018

Teacher log of students’ opportunity to learn and classroom observation: an initial investigation of convergence

verfasst von: Ilona Arnold-Berkovits, Alexander Kurz, Linda A. Reddy

Erschienen in: Educational Assessment, Evaluation and Accountability | Ausgabe 1/2019

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config

KI-gestützte Suche

Aus

Abstract

The present study investigated the convergent validity of the Instructional Learning Opportunities Guidance System (MyiLOGS; Kurz and Elliott 2012), a teacher self-report log designed to measure students’ opportunity to learn (OTL) the intended curriculum. MyiLOGS is compared to the Classroom Strategies Assessment System—Observer Form (CSAS-O; Reddy and Dudek 2016), an online multidimensional assessment of instruction and behavior management practices. The study included 71 kindergarten through 12th grade teachers and 11 school principals from six high poverty charter schools in the northeastern USA. Results provided initial evidence for the relationship between OTL and principal observer ratings of instruction. As hypothesized, results indicate significant positive correlations between teacher ratings of time spent on instruction and time spent on academic standards with observer ratings of teaching strategies; and significant negative correlations with observer discrepancy ratings for instructional and behavior management. These findings indicate that the MyiLOGS teacher self-report formative assessment may support teachers’ movement towards improving their teaching practice. Limitations of the measures and generalizability are discussed.

Vorheriger Artikel Classroom observation systems in context: A case for the validation of observation systems

Nächster Artikel Using the dynamic approach to school improvement to promote quality and equity in education: a European study

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Achenbach, T. M., McConaughy, S., & Howell, C. T. (1987). Child/adolescent behavioral and emotional problems: implications of cross-informant correlations for situational specificity. Psychological Bulletin, 87(2), 213–232.CrossRef

Adams, E. L., Carrier, S. J., Minogue, J., Porter, S. R., McEachin, A., Walkowiak, T. A., & Zulli, R. A. (2017). The development and validation of the Instructional Practices Log in Science: a measure of K-5 science instruction. International Journal of Science Education, 39(3), 335–357.CrossRef

Alberto, P. A., & Troutman, A. C. (2003). Applied behaviour analysis for teachers. Upper Saddle River: Merrill Prentice Hall.

American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (2014). Standards for educational and psychological testing. Washington, DC: American Educational Research Association.

Anderson, L., & Krathwohl, D. R. (2001). A taxonomy for learning, teaching, and assessing: a revision of Bloom’s taxonomy of educational objectives. New York: Longman.

Anderson, L. W. (1986). Opportunity to learn. In T. Husén & T. Postlethwaite (Eds.), International encyclopedia of education: research and studies (pp. 3682–3686). Oxford, UK: Pergamon.

Bloom, B. S. (1976). Human characteristics and school learning. New York: McGraw-Hill.

Bonner, S. M., Rivera, C. T., & Chen, P. P. (2018). Standards and assessment: coherence from the teacher’s perspective. Educational Assessment, Evaluation and Accountability, 30(1), 71–92. https://doi.org/10.1007/s11092-017-9272-2.CrossRef

Brophy, J., & Good, T. L. (1986). Teacher behavior and student achievement. In M. C. Wittrock (Ed.), Handbook of research on teaching (3rd ed., pp. 328–375). New York: Macmillian.

Burstein, L., & Winters, L. (1994). Models for collecting and using data on opportunity to lean at the state level: OTL options for the CCSSO SCASS science assessment. In Presented at the CCSSO National Conference on Large-scale Assessment. Albuquerque, NM.

Camburn, E. M., & Barnes, C. A. (2004). Assessing the validity of a language arts instruction log through triangulation. Elementary School Journal, 105, 49–73.CrossRef

Camburn, E. M., Han, S. W., & Sebastian, J. (2017). Assessing the validity of an annual survey for measuring the enacted literacy curriculum. Educational Policy, 31(1), 73–107.CrossRef

Carroll, J. B. (1963). A model of school learning. Teachers College Record, 64, 723–733.

Cohen, J. (1992). A power primer. Psychological Bulletin, 112(1), 155–159.CrossRef

Connor, C. M., Morrison, F. J., Fishman, B. J., Ponitz, C. C., Glasney, S., Underwood, P. S., Piasta, S. B., Crowe, E. C., & Schatschneider, C. (2009). The ISI classroom observation system: examining the literacy instruction provided to individual students. Educational Researcher, 38(2), 85–99.CrossRef

Danielson, C. (2013). The framework for teaching evaluation instrument. Princeton: The Danielson Group.

Dudek, C. M., Reddy, L. A., & Lekwa, A. L. (2018). Measuring teacher practices to inform student achievement in high poverty schools: An initial predictive validity Study. Contemporary School Psychology 0, 1–11. https://doi.org/10.1007/s40688-018-0196-8

Elbaum, B., Vaughn, S., Hughes, M. T., Moody, S. W., & Schumm, J. S. (2000). In R. Gersten, E. P. Schiller, & S. Vaughn (Eds.), How reading outcomes for students with learning disabilities are related to instructional grouping formats: a meta-analytic review. Mahwah: Erlbaum.

Elliott, S. N., Kurz, A., Tindal, G., & Yel, N. (2017). Influence of opportunity to learn indices and education status on students’ mathematics achievement growth. Remedial and Special Education, 38(3), 145–158. https://doi.org/10.1177/0741932516663000.CrossRef

Gamoran, A., Porter, A. C., Smithson, J., & White, P. A. (1997). Upgrading high school mathematics instruction: improving learning opportunities for low-achieving, low-income youth. Educational Evaluation and Policy Analysis, 19(4), 325–338.CrossRef

Harris, A. (1998). Effective teaching: a review of the literature. School Leadership & Management, 18(2), 169–183.CrossRef

Hattie, J., Biggs, J., & Purdie, N. (1996). Effects of learning skills interventions on student learning: a meta-analysis. Review of Educational Research, 66(2), 99–136.CrossRef

Herman, J. L., Klein, D. C., & Abedi, J. (2000). Assessing students’ opportunity to learn: teacher and student perspectives. Educational Measurement: Issues and Practice, 19(4), 16–24.CrossRef

Hopkins, W. G. (2002). A scale of magnitudes for effect statistics. A New View of Statistics, 502, 411.

Horner, R. H., Sugai, G., Todd, A. W., & Lewis-Palmer, T. (2000). Elements of behavior support plans: a technical brief. Exceptionality, 8(3), 205–215. https://doi.org/10.1207/S15327035EX0803_6.CrossRef

Irvin, M., Byun, S., Smiley, W. S., & Hutchins, B. C. (2017). Relation of opportunity to learn advanced math to the educational attainment of rural youth. American Journal of Education, 123(3), 475–510.CrossRef

Jensen, B., Martínez, M. G. P., & Escobar, A. A. (2016). Framing and assessing classroom opportunity to learn: the case of Mexico. Assessment in Education: Principles, Policy & Practice, 23(1), 149–172.

Kane, M. T. (1992). An argument-based approach to validity. Psychological Bulletin, 112(3), 527–535.CrossRef

Kane, M. T. (2001). Current concerns in validity theory. Journal of Educational Measurement, 38(4), 319–342.CrossRef

Kounin, J. S. (1970). Discipline and group management in classrooms. New York: Holt, Reinhart, and Winston Retrieved from http://psycnet.apa.org/psycinfo/1973-07871-000.

Kurz, A. (2011). Access to what should be taught and will be tested: Students’ opportunity to learn the intended curriculum. In S. N. Elliott, R. J. Kettler, P. A. Beddow, & A. Kurz (Eds.), Handbook of accessible achievement tests for all students: bridging the gaps between research, practice, and policy (pp. 99–129). York: Springer.

Kurz, A. (2016). Measuring opportunity to learn through a teacher log. Presented at the Annual Pacific Research Coast Conference, San Diego, CA.

Kurz, A. (2017). Educational redemption and instructional coaching. Presented at the Annual Pacific Research Coast Conference, San Diego, CA.

Kurz, A., & Elliott, S. N. (2011). Overcoming barriers to access for students with disabilities: testing accommodations and beyond. In M. Russell & M. Kavanaugh (Eds.), Assessing students in the margins: challenges, strategies, and techniques (pp. 31–58). Charlotte: Information Age Publishing.

Kurz, A., & Elliott, S. N. (2012). MyiLOGS: My Instructional Learning Opportunities Guidance System (Version 2) [Online measurement instrument]. Tempe: Arizona State University.

Kurz, A., Elliott, S. N., Kettler, R. J., & Yel, N. (2014a). Assessing students’ opportunity to learn the intended curriculum using an online teacher log: initial validity evidence. Educational Assessment, 19(3), 159–184.CrossRef

Kurz, A., Elliott, S. N., Lemons, C. J., Zigmond, N., Kloo, A., & Kettler, R. J. (2014b). Assessing opportunity-to-learn for students with disabilities in general and special education classes. Assessment for Effective Intervention, 40(1), 24–39.CrossRef

Kurz, A., Elliott, S. N., & Roach, A. T. (2015). Addressing the missing instructional data problem: using a teacher log to document Tier 1 instruction. Remedial and Special Education, 36(6), 361–373.CrossRef

Kurz, A., Elliott, S. N., Wehby, J. H., & Smithson, J. L. (2010). Alignment of the intended, planned, and enacted curriculum in general and special education and its relation to student achievement. Journal of Special Education, 44, 131–145.CrossRef

Kurz, A., Reichenberg, R., & Yel, N. (in Press). Setting opportunity-to-learn standards for effective teaching. Educational Evaluation and Policy Analysis.

Lekwa, A. J., Reddy, L. A., & Shernoff, E. S. (2018). Measuring teacher practices and student academic engagement: A convergent validity study. School Psychology Quarterly: The Official Journal of the Division of School Psychology, American Psychological Association, Advance online publication. https://doi.org/10.1037/spq0000268.

Marzano, R. J. (2000). A new era of school reform: going where the research takes us. (REL, 96006101).

Nelson, P. M., Demers, J. A., & Christ, T. J. (2014). The Responsive Environmental Assessment for Classroom Teaching (REACT): the dimensionality of student perceptions of the instructional environment. School Psychology Quarterly, 29(2), 182–197.CrossRef

Nelson, P., Reddy, L. A., Dudek, C. M., & Lekwa, A. (2017). Observer and student ratings of the class environment: a preliminary investigation of convergence. School Psychology Quarterly, 32(4), 465–479. https://doi.org/10.1037/spq0000176.

New Jersey Department of Education. (2017). Requirements and resources for teacher evaluations. AchieveNJ. Retrieved from http://www.state.nj.us/education/AchieveNJ/resources/TeacherEvaluationRequirementsandResources.pdf

Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric theory (Vol. 3). New York: McGraw-Hill.

Pianta, R. C., La Paro, K., & Hamre, B. K. (2008). Classroom Assessment Scoring System (CLASS). Baltimore: Paul H. Brookes.

Porter, A. C. (2002). Measuring the content of instruction: uses in research and practice. Educational Researcher, 31(7), 3–14.CrossRef

Reddy, L. A., & Dudek, C. M. (2014). Teacher progress monitoring of instructional and behavioral management practices: An evidence-based approach to improving classroom practices. International Journal of School and Educational Psychology, 2(2), 71–84.

Reddy, L. A., & Dudek, C. M. (2016). Classroom strategy assessment system. Piscataway: Rutgers University.

Reddy, L. A., Dudek, C. M., & Lekwa, A. (2017). Classroom strategies coaching model: Integration of formative assessment and instructional coaching. Theory Into Practice, 56(1), 46–55.CrossRef

Reddy, L. A., Dudek, C. M., Rualo, A. J., & Fabiano, G. A. (2016). Concurrent validity of the Classroom Strategies Scale–Teacher Form: A preliminary investigation. Educational Assessment, 21(4), 267–277.

Reddy, L. A., Fabiano, G. A., Dudek, C. M., & Hsu, L. (2013a). Development and construct validity of the Classroom Strategies Scale. School Psychology Quarterly, 28, 317–341.CrossRef

Reddy, L. A., Fabiano, G. A., Dudek, C. M., & Hsu, L. (2013b). Instructional and behavioral management practices implemented by elementary general education teachers. Journal of School Psychology, 51(6), 683–700.CrossRef

Reddy, L. A., Fabiano, G. A., Dudek, C. M., & Hsu, L. (2013c). Predictive validity of the Classroom Strategies Scale—Observer Form on statewide testing scores: An initial investigation. School Psychology Quarterly, 28(4), 301–316.

Reddy, L. A., Fabiano, G., & Dudek, C. M. (2013). Concurrent validity of the Classroom Strategies Scale—Observer Form. Journal of Psychoeducational Assessment, 31, 258–270.CrossRef

Reddy, L. A., Kettler, R. J., & Kurz, A. (2015). School-wide educator evaluation for improving school capacity and student achievement in high-poverty schools: Year 1 of the School System Improvement Project. Journal of Educational and Psychological Consultation, 25(2–3), 90–108.CrossRef

Roach, A. T., Kurz, A., & Elliott, S. N. (2015). Facilitating opportunity to learn for students with disabilities with instructional feedback data. Preventing School Failure: Alternative Education for Children and Youth, 59(3), 168–178.CrossRef

Rowan, B., Camburn, E., & Correnti, R. (2004). Using teacher logs to measure the enacted curriculum: a study of literacy teaching in third-grade classrooms. Elementary School Journal, 105, 75–101.CrossRef

Rowan, B., & Correnti, R. (2009). Studying reading instruction with teacher logs: lessons from the Study of Instructional Improvement. Educational Researcher, 38, 120–131.CrossRef

Scheerens, J., & Bosker, R. (1997). The foundations of educational effectiveness. Oxford: Pergamon Retrieved from https://research.utwente.nl/en/publications/the-foundations-of-educational-effectiveness.

Schloss, P. J., & Smith, M. A. (1998). Applied behavior analysis in the classroom. Boston: Allyn & Bacon.

Stage, S. A., & Quiroz, D. R. (1997). A meta-analysis of interventions to decrease disruptive classroom behavior in public education settings. School Psychology Review. Retrieved from http://psycnet.apa.org/psycinfo/1997-43327-001

Steele, J. M., House, E. R., & Kerins, T. (1971). An instrument for assessing instructional climate through low-inference student judgments. American Educational Research Journal, 8, 447–466.CrossRef

Volpe, R. J., & DiPerna, J. C. (2010). Cooperative learning observation code for kids. Unpublished Observation Code Book.

Walberg, H. J. (1986). Synthesis of research on teaching. In M. Wittrock (Ed.)Handbook of Research on Teaching (3rd ed.). New York: Macmillan.

Wang, J. (1998). Opportunity to learn: the impacts and policy implications. Educational Evaluation and Policy Analysis, 20, 137–156.CrossRef

Titel: Teacher log of students’ opportunity to learn and classroom observation: an initial investigation of convergence
verfasst von: Ilona Arnold-Berkovits
Alexander Kurz
Linda A. Reddy
Publikationsdatum: 26.11.2018
Verlag: Springer Netherlands
Erschienen in: Educational Assessment, Evaluation and Accountability / Ausgabe 1/2019
Print ISSN: 1874-8597
Elektronische ISSN: 1874-8600
DOI: https://doi.org/10.1007/s11092-018-9288-2

Springer Professional

Abstract

Bitte loggen Sie sich ein, um Zugang zu Ihrer Lizenz zu erhalten.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Wirtschaft"

Weitere Artikel der Ausgabe 1/2019

Underperforming teachers: the impact on co-workers and their responses

Reframing conversations about teacher quality: school and district administrators’ perceptions of the validity, reliability, and justifiability of a new teacher evaluation system

Top-down and bottom-up approaches to improve educational quality: their intended and unintended consequences

Using the dynamic approach to school improvement to promote quality and equity in education: a European study

Classroom observation systems in context: A case for the validation of observation systems

Premium Partner