Weitere Artikel dieser Ausgabe durch Wischen aufrufen
The present study investigated the convergent validity of the Instructional Learning Opportunities Guidance System (MyiLOGS; Kurz and Elliott 2012), a teacher self-report log designed to measure students’ opportunity to learn (OTL) the intended curriculum. MyiLOGS is compared to the Classroom Strategies Assessment System—Observer Form (CSAS-O; Reddy and Dudek 2016), an online multidimensional assessment of instruction and behavior management practices. The study included 71 kindergarten through 12th grade teachers and 11 school principals from six high poverty charter schools in the northeastern USA. Results provided initial evidence for the relationship between OTL and principal observer ratings of instruction. As hypothesized, results indicate significant positive correlations between teacher ratings of time spent on instruction and time spent on academic standards with observer ratings of teaching strategies; and significant negative correlations with observer discrepancy ratings for instructional and behavior management. These findings indicate that the MyiLOGS teacher self-report formative assessment may support teachers’ movement towards improving their teaching practice. Limitations of the measures and generalizability are discussed.
Bitte loggen Sie sich ein, um Zugang zu diesem Inhalt zu erhalten
Sie möchten Zugang zu diesem Inhalt erhalten? Dann informieren Sie sich jetzt über unsere Produkte:
Achenbach, T. M., McConaughy, S., & Howell, C. T. (1987). Child/adolescent behavioral and emotional problems: implications of cross-informant correlations for situational specificity. Psychological Bulletin, 87(2), 213–232. CrossRef
Adams, E. L., Carrier, S. J., Minogue, J., Porter, S. R., McEachin, A., Walkowiak, T. A., & Zulli, R. A. (2017). The development and validation of the Instructional Practices Log in Science: a measure of K-5 science instruction. International Journal of Science Education, 39(3), 335–357. CrossRef
Alberto, P. A., & Troutman, A. C. (2003). Applied behaviour analysis for teachers. Upper Saddle River: Merrill Prentice Hall.
American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (2014). Standards for educational and psychological testing. Washington, DC: American Educational Research Association.
Anderson, L., & Krathwohl, D. R. (2001). A taxonomy for learning, teaching, and assessing: a revision of Bloom’s taxonomy of educational objectives. New York: Longman.
Anderson, L. W. (1986). Opportunity to learn. In T. Husén & T. Postlethwaite (Eds.), International encyclopedia of education: research and studies (pp. 3682–3686). Oxford, UK: Pergamon.
Bloom, B. S. (1976). Human characteristics and school learning. New York: McGraw-Hill.
Brophy, J., & Good, T. L. (1986). Teacher behavior and student achievement. In M. C. Wittrock (Ed.), Handbook of research on teaching (3rd ed., pp. 328–375). New York: Macmillian.
Burstein, L., & Winters, L. (1994). Models for collecting and using data on opportunity to lean at the state level: OTL options for the CCSSO SCASS science assessment. In Presented at the CCSSO National Conference on Large-scale Assessment. Albuquerque, NM.
Camburn, E. M., & Barnes, C. A. (2004). Assessing the validity of a language arts instruction log through triangulation. Elementary School Journal, 105, 49–73. CrossRef
Camburn, E. M., Han, S. W., & Sebastian, J. (2017). Assessing the validity of an annual survey for measuring the enacted literacy curriculum. Educational Policy, 31(1), 73–107. CrossRef
Carroll, J. B. (1963). A model of school learning. Teachers College Record, 64, 723–733.
Cohen, J. (1992). A power primer. Psychological Bulletin, 112(1), 155–159. CrossRef
Connor, C. M., Morrison, F. J., Fishman, B. J., Ponitz, C. C., Glasney, S., Underwood, P. S., Piasta, S. B., Crowe, E. C., & Schatschneider, C. (2009). The ISI classroom observation system: examining the literacy instruction provided to individual students. Educational Researcher, 38(2), 85–99. CrossRef
Danielson, C. (2013). The framework for teaching evaluation instrument. Princeton: The Danielson Group.
Dudek, C. M., Reddy, L. A., & Lekwa, A. L. (2018). Measuring teacher practices to inform student achievement in high poverty schools: An initial predictive validity Study. Contemporary School Psychology 0, 1–11. https://doi.org/10.1007/s40688-018-0196-8
Elbaum, B., Vaughn, S., Hughes, M. T., Moody, S. W., & Schumm, J. S. (2000). In R. Gersten, E. P. Schiller, & S. Vaughn (Eds.), How reading outcomes for students with learning disabilities are related to instructional grouping formats: a meta-analytic review. Mahwah: Erlbaum.
Gamoran, A., Porter, A. C., Smithson, J., & White, P. A. (1997). Upgrading high school mathematics instruction: improving learning opportunities for low-achieving, low-income youth. Educational Evaluation and Policy Analysis, 19(4), 325–338. CrossRef
Harris, A. (1998). Effective teaching: a review of the literature. School Leadership & Management, 18(2), 169–183. CrossRef
Hattie, J., Biggs, J., & Purdie, N. (1996). Effects of learning skills interventions on student learning: a meta-analysis. Review of Educational Research, 66(2), 99–136. CrossRef
Herman, J. L., Klein, D. C., & Abedi, J. (2000). Assessing students’ opportunity to learn: teacher and student perspectives. Educational Measurement: Issues and Practice, 19(4), 16–24. CrossRef
Hopkins, W. G. (2002). A scale of magnitudes for effect statistics. A New View of Statistics, 502, 411.
Irvin, M., Byun, S., Smiley, W. S., & Hutchins, B. C. (2017). Relation of opportunity to learn advanced math to the educational attainment of rural youth. American Journal of Education, 123(3), 475–510. CrossRef
Jensen, B., Martínez, M. G. P., & Escobar, A. A. (2016). Framing and assessing classroom opportunity to learn: the case of Mexico. Assessment in Education: Principles, Policy & Practice, 23(1), 149–172. CrossRef
Kane, M. T. (1992). An argument-based approach to validity. Psychological Bulletin, 112(3), 527–535. CrossRef
Kane, M. T. (2001). Current concerns in validity theory. Journal of Educational Measurement, 38(4), 319–342. CrossRef
Kounin, J. S. (1970). Discipline and group management in classrooms. New York: Holt, Reinhart, and Winston Retrieved from http://psycnet.apa.org/psycinfo/1973-07871-000.
Kurz, A. (2011). Access to what should be taught and will be tested: Students’ opportunity to learn the intended curriculum. In S. N. Elliott, R. J. Kettler, P. A. Beddow, & A. Kurz (Eds.), Handbook of accessible achievement tests for all students: bridging the gaps between research, practice, and policy (pp. 99–129). York: Springer. CrossRef
Kurz, A. (2016). Measuring opportunity to learn through a teacher log. Presented at the Annual Pacific Research Coast Conference, San Diego, CA.
Kurz, A. (2017). Educational redemption and instructional coaching. Presented at the Annual Pacific Research Coast Conference, San Diego, CA.
Kurz, A., & Elliott, S. N. (2011). Overcoming barriers to access for students with disabilities: testing accommodations and beyond. In M. Russell & M. Kavanaugh (Eds.), Assessing students in the margins: challenges, strategies, and techniques (pp. 31–58). Charlotte: Information Age Publishing.
Kurz, A., & Elliott, S. N. (2012). MyiLOGS: My Instructional Learning Opportunities Guidance System (Version 2) [Online measurement instrument]. Tempe: Arizona State University.
Kurz, A., Elliott, S. N., Kettler, R. J., & Yel, N. (2014a). Assessing students’ opportunity to learn the intended curriculum using an online teacher log: initial validity evidence. Educational Assessment, 19(3), 159–184. CrossRef
Kurz, A., Elliott, S. N., Lemons, C. J., Zigmond, N., Kloo, A., & Kettler, R. J. (2014b). Assessing opportunity-to-learn for students with disabilities in general and special education classes. Assessment for Effective Intervention, 40(1), 24–39. CrossRef
Kurz, A., Elliott, S. N., & Roach, A. T. (2015). Addressing the missing instructional data problem: using a teacher log to document Tier 1 instruction. Remedial and Special Education, 36(6), 361–373. CrossRef
Kurz, A., Elliott, S. N., Wehby, J. H., & Smithson, J. L. (2010). Alignment of the intended, planned, and enacted curriculum in general and special education and its relation to student achievement. Journal of Special Education, 44, 131–145. CrossRef
Kurz, A., Reichenberg, R., & Yel, N. (in Press). Setting opportunity-to-learn standards for effective teaching. Educational Evaluation and Policy Analysis.
Lekwa, A. J., Reddy, L. A., & Shernoff, E. S. (2018). Measuring teacher practices and student academic engagement: A convergent validity study. School Psychology Quarterly: The Official Journal of the Division of School Psychology, American Psychological Association, Advance online publication. https://doi.org/10.1037/spq0000268.
Marzano, R. J. (2000). A new era of school reform: going where the research takes us. (REL, 96006101).
Nelson, P. M., Demers, J. A., & Christ, T. J. (2014). The Responsive Environmental Assessment for Classroom Teaching (REACT): the dimensionality of student perceptions of the instructional environment. School Psychology Quarterly, 29(2), 182–197. CrossRef
New Jersey Department of Education. (2017). Requirements and resources for teacher evaluations. AchieveNJ. Retrieved from http://www.state.nj.us/education/AchieveNJ/resources/TeacherEvaluationRequirementsandResources.pdf
Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric theory (Vol. 3). New York: McGraw-Hill.
Pianta, R. C., La Paro, K., & Hamre, B. K. (2008). Classroom Assessment Scoring System (CLASS). Baltimore: Paul H. Brookes.
Porter, A. C. (2002). Measuring the content of instruction: uses in research and practice. Educational Researcher, 31(7), 3–14. CrossRef
Reddy, L. A., & Dudek, C. M. (2014). Teacher progress monitoring of instructional and behavioral management practices: An evidence-based approach to improving classroom practices. International Journal of School and Educational Psychology, 2(2), 71–84. CrossRef
Reddy, L. A., & Dudek, C. M. (2016). Classroom strategy assessment system. Piscataway: Rutgers University.
Reddy, L. A., Dudek, C. M., & Lekwa, A. (2017). Classroom strategies coaching model: Integration of formative assessment and instructional coaching. Theory Into Practice, 56(1), 46–55. CrossRef
Reddy, L. A., Dudek, C. M., Rualo, A. J., & Fabiano, G. A. (2016). Concurrent validity of the Classroom Strategies Scale–Teacher Form: A preliminary investigation. Educational Assessment, 21(4), 267–277. CrossRef
Reddy, L. A., Fabiano, G. A., Dudek, C. M., & Hsu, L. (2013a). Development and construct validity of the Classroom Strategies Scale. School Psychology Quarterly, 28, 317–341. CrossRef
Reddy, L. A., Fabiano, G. A., Dudek, C. M., & Hsu, L. (2013b). Instructional and behavioral management practices implemented by elementary general education teachers. Journal of School Psychology, 51(6), 683–700. CrossRef
Reddy, L. A., Fabiano, G. A., Dudek, C. M., & Hsu, L. (2013c). Predictive validity of the Classroom Strategies Scale—Observer Form on statewide testing scores: An initial investigation. School Psychology Quarterly, 28(4), 301–316. CrossRef
Reddy, L. A., Fabiano, G., & Dudek, C. M. (2013). Concurrent validity of the Classroom Strategies Scale—Observer Form. Journal of Psychoeducational Assessment, 31, 258–270. CrossRef
Reddy, L. A., Kettler, R. J., & Kurz, A. (2015). School-wide educator evaluation for improving school capacity and student achievement in high-poverty schools: Year 1 of the School System Improvement Project. Journal of Educational and Psychological Consultation, 25(2–3), 90–108. CrossRef
Roach, A. T., Kurz, A., & Elliott, S. N. (2015). Facilitating opportunity to learn for students with disabilities with instructional feedback data. Preventing School Failure: Alternative Education for Children and Youth, 59(3), 168–178. CrossRef
Rowan, B., Camburn, E., & Correnti, R. (2004). Using teacher logs to measure the enacted curriculum: a study of literacy teaching in third-grade classrooms. Elementary School Journal, 105, 75–101. CrossRef
Rowan, B., & Correnti, R. (2009). Studying reading instruction with teacher logs: lessons from the Study of Instructional Improvement. Educational Researcher, 38, 120–131. CrossRef
Scheerens, J., & Bosker, R. (1997). The foundations of educational effectiveness. Oxford: Pergamon Retrieved from https://research.utwente.nl/en/publications/the-foundations-of-educational-effectiveness.
Schloss, P. J., & Smith, M. A. (1998). Applied behavior analysis in the classroom. Boston: Allyn & Bacon.
Stage, S. A., & Quiroz, D. R. (1997). A meta-analysis of interventions to decrease disruptive classroom behavior in public education settings. School Psychology Review. Retrieved from http://psycnet.apa.org/psycinfo/1997-43327-001
Steele, J. M., House, E. R., & Kerins, T. (1971). An instrument for assessing instructional climate through low-inference student judgments. American Educational Research Journal, 8, 447–466. CrossRef
Volpe, R. J., & DiPerna, J. C. (2010). Cooperative learning observation code for kids. Unpublished Observation Code Book.
Walberg, H. J. (1986). Synthesis of research on teaching. In M. Wittrock (Ed.) Handbook of Research on Teaching (3rd ed.). New York: Macmillan.
Wang, J. (1998). Opportunity to learn: the impacts and policy implications. Educational Evaluation and Policy Analysis, 20, 137–156. CrossRef
- Teacher log of students’ opportunity to learn and classroom observation: an initial investigation of convergence
Linda A. Reddy
- Springer Netherlands
Educational Assessment, Evaluation and Accountability
Print ISSN: 1874-8597
Elektronische ISSN: 1874-8600
Neuer Inhalt/© Stellmach, Neuer Inhalt/© BBL, Neuer Inhalt/© Maturus, Pluta Logo/© Pluta, Neuer Inhalt/© hww, digitale Transformation/© Maksym Yemelyanov | Fotolia