Skip to main content
Erschienen in: Journal of Science Education and Technology 1/2013

01.02.2013

Measuring Model-Based High School Science Instruction: Development and Application of a Student Survey

verfasst von: Gavin W. Fulmer, Ling L. Liang

Erschienen in: Journal of Science Education and Technology | Ausgabe 1/2013

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This study tested a student survey to detect differences in instruction between teachers in a modeling-based science program and comparison group teachers. The Instructional Activities Survey measured teachers’ frequency of modeling, inquiry, and lecture instruction. Factor analysis and Rasch modeling identified three subscales, Modeling and Reflecting, Communicating and Relating, and Investigative Inquiry. As predicted, treatment group teachers engaged in modeling and inquiry instruction more than comparison teachers, with effect sizes between 0.55 and 1.25. This study demonstrates the utility of student report data in measuring teachers’ classroom practices and in evaluating outcomes of a professional development program.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Literatur
Zurück zum Zitat Adamson SL, Banks D, Burtch M, Cox F III, Judson E, Turley JB, Benford R, Lawson AE (2003) Reformed undergraduate instruction and its subsequent impact on secondary school teaching practice and student achievement. J Res Sci Teach 40(10):939–957CrossRef Adamson SL, Banks D, Burtch M, Cox F III, Judson E, Turley JB, Benford R, Lawson AE (2003) Reformed undergraduate instruction and its subsequent impact on secondary school teaching practice and student achievement. J Res Sci Teach 40(10):939–957CrossRef
Zurück zum Zitat Aleamoni LM (1999) Student rating myths versus research facts from 1924 to 1998. J Personnel Eval Educ 13:153–166CrossRef Aleamoni LM (1999) Student rating myths versus research facts from 1924 to 1998. J Personnel Eval Educ 13:153–166CrossRef
Zurück zum Zitat Akerson VL, Abd-El-Khalick F, Lederman NG (2000) Influence of a reflective explicit activity-based approach on elementary teachers’ conceptions of Nature of Science. J Res Sci Teach 37:295–317CrossRef Akerson VL, Abd-El-Khalick F, Lederman NG (2000) Influence of a reflective explicit activity-based approach on elementary teachers’ conceptions of Nature of Science. J Res Sci Teach 37:295–317CrossRef
Zurück zum Zitat Andrich D (1978) A rating formulation for ordered response categories. Psychometrika 43:561–573CrossRef Andrich D (1978) A rating formulation for ordered response categories. Psychometrika 43:561–573CrossRef
Zurück zum Zitat Association of American Universities (1995) Survey of undergraduate education activities. Author, Washington, DC Association of American Universities (1995) Survey of undergraduate education activities. Author, Washington, DC
Zurück zum Zitat Banilower ER (2005) A study of the predictive validity of the LSC classroom observation protocol. Horizon Research, Inc., Chapel Hill Banilower ER (2005) A study of the predictive validity of the LSC classroom observation protocol. Horizon Research, Inc., Chapel Hill
Zurück zum Zitat Beeth ME, Hewson PW (1999) Learning goals in an exemplary science teacher’s practice: cognitive and social factors in teaching for conceptual change. Sci Educ 83:738–760CrossRef Beeth ME, Hewson PW (1999) Learning goals in an exemplary science teacher’s practice: cognitive and social factors in teaching for conceptual change. Sci Educ 83:738–760CrossRef
Zurück zum Zitat Bill & Melinda Gates Foundation (2010b) Working with teachers to develop fair and reliable measures of effective teaching: framing paper of the measures of effective teaching project. Author, Seattle. Accessed November 1, 2010 from http://www.metproject.org/reading Bill & Melinda Gates Foundation (2010b) Working with teachers to develop fair and reliable measures of effective teaching: framing paper of the measures of effective teaching project. Author, Seattle. Accessed November 1, 2010 from http://​www.​metproject.​org/​reading
Zurück zum Zitat Bond TG, Fox CM (2001) Applying the Rasch model: fundamental measurement in the human sciences, 2nd edn. Routledge, New York Bond TG, Fox CM (2001) Applying the Rasch model: fundamental measurement in the human sciences, 2nd edn. Routledge, New York
Zurück zum Zitat Brewe E, Sawtelle V, Kramer LH, O’Brien GE, Rodriguez I, Pamelá P (2010) Toward equity through participation in Modeling Instruction in introductory university physics. Phys Rev Special Topics Phys Educ Res 6:010106 Brewe E, Sawtelle V, Kramer LH, O’Brien GE, Rodriguez I, Pamelá P (2010) Toward equity through participation in Modeling Instruction in introductory university physics. Phys Rev Special Topics Phys Educ Res 6:010106
Zurück zum Zitat Clement J (1989) Learning via model construction and criticism. In: Glover G, Ronning R, Reynolds C (eds.) Handbook of creativity: assessment, theory and research. Plenum, New York, NY, pp 341–381 Clement J (1989) Learning via model construction and criticism. In: Glover G, Ronning R, Reynolds C (eds.) Handbook of creativity: assessment, theory and research. Plenum, New York, NY, pp 341–381
Zurück zum Zitat Clement J (2008) Six levels of organization for curriculum design and teaching. In: Clement J, Rea-Ramirez MA (eds.) Model based learning and instruction in science. Springer, New York, NY, pp 255–272CrossRef Clement J (2008) Six levels of organization for curriculum design and teaching. In: Clement J, Rea-Ramirez MA (eds.) Model based learning and instruction in science. Springer, New York, NY, pp 255–272CrossRef
Zurück zum Zitat Cohen J (1988) Statistical power analysis for the behavioral sciences, 2nd edn. Lawrence Erlbaum Associates, Mahwah Cohen J (1988) Statistical power analysis for the behavioral sciences, 2nd edn. Lawrence Erlbaum Associates, Mahwah
Zurück zum Zitat Desimone LM (2009) Improving impact studies of teachers’ professional development: toward better conceptualizations and measures. Educ Res 38(3):181–199 Desimone LM (2009) Improving impact studies of teachers’ professional development: toward better conceptualizations and measures. Educ Res 38(3):181–199
Zurück zum Zitat Desimone L, Porter AC, Garet MS, Yoon KS, Birman BF (2002) Effects of professional development on teachers’ instruction: results from a three-year longitudinal study. Educ Eval Policy Anal 24(2):81–112CrossRef Desimone L, Porter AC, Garet MS, Yoon KS, Birman BF (2002) Effects of professional development on teachers’ instruction: results from a three-year longitudinal study. Educ Eval Policy Anal 24(2):81–112CrossRef
Zurück zum Zitat Duran E, Duran LB (2005) Project ASTER: a model staff development program and its impact on early childhood teachers’ self-efficacy. J Element Sci Educ 17(2):1–12CrossRef Duran E, Duran LB (2005) Project ASTER: a model staff development program and its impact on early childhood teachers’ self-efficacy. J Element Sci Educ 17(2):1–12CrossRef
Zurück zum Zitat Fenstermacher GD, Richardson V (2005) On making determinations of quality in teaching. Teach College Rec 107(1):186–213CrossRef Fenstermacher GD, Richardson V (2005) On making determinations of quality in teaching. Teach College Rec 107(1):186–213CrossRef
Zurück zum Zitat Fulmer GW (2008) Successes and setbacks in collaboration for science instruction: connecting teacher practices to contextual pressures and student learning outcomes. VDM Publishing, Saarbrücken, Germany Fulmer GW (2008) Successes and setbacks in collaboration for science instruction: connecting teacher practices to contextual pressures and student learning outcomes. VDM Publishing, Saarbrücken, Germany
Zurück zum Zitat Garet MS, Porter AC, Desimone L, Birman BF, Yoon KS (2001) What makes professional development effective? Results from a national sample of teachers. Am Educ Res J 38:915–945CrossRef Garet MS, Porter AC, Desimone L, Birman BF, Yoon KS (2001) What makes professional development effective? Results from a national sample of teachers. Am Educ Res J 38:915–945CrossRef
Zurück zum Zitat Hestenes D, Wells M, Swackhamer G (1992) Force concept inventory. Phys Teach 30:141–158CrossRef Hestenes D, Wells M, Swackhamer G (1992) Force concept inventory. Phys Teach 30:141–158CrossRef
Zurück zum Zitat Ihaka R, Gentleman R (1996) R: a language for data analysis and graphics. J Comput Graph Stat 5(3):299–314 Ihaka R, Gentleman R (1996) R: a language for data analysis and graphics. J Comput Graph Stat 5(3):299–314
Zurück zum Zitat Liang LL, Fulmer GW, Majerich DM, Clevenstine R, Howanski R (2012) The effects of a model-based physics curriculum program with a physics first approach: a causal-comparative study. J Sci Educ Technol 21(1):114–124. doi:10.1007/s10956-011-9287-2 CrossRef Liang LL, Fulmer GW, Majerich DM, Clevenstine R, Howanski R (2012) The effects of a model-based physics curriculum program with a physics first approach: a causal-comparative study. J Sci Educ Technol 21(1):114–124. doi:10.​1007/​s10956-011-9287-2 CrossRef
Zurück zum Zitat Liu X, Zhang BH, Liang LL, Fulmer GW, Kim B, Yuan HQ (2009) Alignment between the physics content standards and standardized tests: a comparison among US-NY, Singapore, and China-Jiangsu. Sci Educ 93:777–797. doi:10.1002/sce.20330 CrossRef Liu X, Zhang BH, Liang LL, Fulmer GW, Kim B, Yuan HQ (2009) Alignment between the physics content standards and standardized tests: a comparison among US-NY, Singapore, and China-Jiangsu. Sci Educ 93:777–797. doi:10.​1002/​sce.​20330 CrossRef
Zurück zum Zitat Johnson DK, Duvernoy R, McGill P, Will JF (1996) Educating teachers together: teachers as learners, talkers, and collaborators. Theory Practice 35(3):173–178 Johnson DK, Duvernoy R, McGill P, Will JF (1996) Educating teachers together: teachers as learners, talkers, and collaborators. Theory Practice 35(3):173–178
Zurück zum Zitat Johnson CC, Kahle JB, Fargo JD (2007) A study of the effect of sustained, whole-school professional development on student achievement in science. J Res Sci Teach 44(6):775–786CrossRef Johnson CC, Kahle JB, Fargo JD (2007) A study of the effect of sustained, whole-school professional development on student achievement in science. J Res Sci Teach 44(6):775–786CrossRef
Zurück zum Zitat Karplus R (1977) Science teaching and the development of reasoning. J Res Sci Teach 14:169–175CrossRef Karplus R (1977) Science teaching and the development of reasoning. J Res Sci Teach 14:169–175CrossRef
Zurück zum Zitat Koziol SM Jr, Burns P (1986) Teachers’ accuracy in self-reporting about instructional practices using a focused self-report inventory. J Educ Res 79(4):205–209 Koziol SM Jr, Burns P (1986) Teachers’ accuracy in self-reporting about instructional practices using a focused self-report inventory. J Educ Res 79(4):205–209
Zurück zum Zitat Lawley DN, Maxwell AE (1962) Factor analysis as a statistical method. J R Stat Soc Ser D (The Statistician) 12(3):209–229 Lawley DN, Maxwell AE (1962) Factor analysis as a statistical method. J R Stat Soc Ser D (The Statistician) 12(3):209–229
Zurück zum Zitat Lawrenz F, Wood NB, Kirchhoff A, Kim NK, Eisenkraft A (2009) Variables affecting physics achievement. J Res Sci Teach 44(6):775–786 Lawrenz F, Wood NB, Kirchhoff A, Kim NK, Eisenkraft A (2009) Variables affecting physics achievement. J Res Sci Teach 44(6):775–786
Zurück zum Zitat Levine A (2006) Educating school teachers. Education Schools Project, New York Levine A (2006) Educating school teachers. Education Schools Project, New York
Zurück zum Zitat Lieberman A (2000) Networks as learning communities: shaping the future of teacher development. Teach Educ 51:221–227CrossRef Lieberman A (2000) Networks as learning communities: shaping the future of teacher development. Teach Educ 51:221–227CrossRef
Zurück zum Zitat Linacre JM (2007) WINSTEPS (Version 3.61.2) [Computer Software]. Winsteps.com, Chicago Linacre JM (2007) WINSTEPS (Version 3.61.2) [Computer Software]. Winsteps.com, Chicago
Zurück zum Zitat Marsh HW (1984) Students’ evaluations of university teaching: dimensionality, reliability, validity, potential biases, and utility. J Educ Psychol 76(5):707–754CrossRef Marsh HW (1984) Students’ evaluations of university teaching: dimensionality, reliability, validity, potential biases, and utility. J Educ Psychol 76(5):707–754CrossRef
Zurück zum Zitat Minner DD, Levy AJ, Century J (2010) Inquiry-based science instruction—what is it and does it matter? Results from a research synthesis years 1984 to 2002. J Res Sci Teach 47(4):474–496CrossRef Minner DD, Levy AJ, Century J (2010) Inquiry-based science instruction—what is it and does it matter? Results from a research synthesis years 1984 to 2002. J Res Sci Teach 47(4):474–496CrossRef
Zurück zum Zitat National Research Council (NRC) (1996) National science education standards. National Academy Press, Washington, D.C. National Research Council (NRC) (1996) National science education standards. National Academy Press, Washington, D.C.
Zurück zum Zitat Park S, Jang J-Y, Chen Y-C, Jung J (2011) Is pedagogical content knowledge (PCK) necessary for reformed science teaching? Evidence from an empirical study. Res Sci Educ 41(2):245–260. doi:10.1007/s11165-009-9163-8 CrossRef Park S, Jang J-Y, Chen Y-C, Jung J (2011) Is pedagogical content knowledge (PCK) necessary for reformed science teaching? Evidence from an empirical study. Res Sci Educ 41(2):245–260. doi:10.​1007/​s11165-009-9163-8 CrossRef
Zurück zum Zitat Peterson KD, Wahlquist C, Bone K (2000) Student surveys for school teacher evaluation. J Personnel Eval Educ 14(2):135–153CrossRef Peterson KD, Wahlquist C, Bone K (2000) Student surveys for school teacher evaluation. J Personnel Eval Educ 14(2):135–153CrossRef
Zurück zum Zitat Peterson KD (2000) Teacher evaluation: a comprehensive guide to new directions and practices, 2nd edn. Corwin Press, Thousand Oaks Peterson KD (2000) Teacher evaluation: a comprehensive guide to new directions and practices, 2nd edn. Corwin Press, Thousand Oaks
Zurück zum Zitat Porter AC (2002) Measuring the content of instruction: uses in research and practice. Educ Res 31(7):3–14 Porter AC (2002) Measuring the content of instruction: uses in research and practice. Educ Res 31(7):3–14
Zurück zum Zitat Raudenbush SW, Bryk AS (2002) Hierarchical linear models: applications and data analysis methods, 2nd edn. Sage, Newbury Park, CA Raudenbush SW, Bryk AS (2002) Hierarchical linear models: applications and data analysis methods, 2nd edn. Sage, Newbury Park, CA
Zurück zum Zitat Sawada D, Piburn M, Judson E, Turley J, Falconer K, Benford R, Bloom I (2002) Measuring reform practices in science and mathematics classrooms: the reformed teaching observation protocol. School Sci Math 102(6):245–253CrossRef Sawada D, Piburn M, Judson E, Turley J, Falconer K, Benford R, Bloom I (2002) Measuring reform practices in science and mathematics classrooms: the reformed teaching observation protocol. School Sci Math 102(6):245–253CrossRef
Zurück zum Zitat Schön DA (1983) The reflective practitioner: how professionals think in action. Basic Books, New York Schön DA (1983) The reflective practitioner: how professionals think in action. Basic Books, New York
Zurück zum Zitat Schwarz CV, White BY (2005) Metamodeling knowledge: developing students’ understanding of scientific modeling. Cogn Instruct 23:165–205CrossRef Schwarz CV, White BY (2005) Metamodeling knowledge: developing students’ understanding of scientific modeling. Cogn Instruct 23:165–205CrossRef
Zurück zum Zitat Schwarz CV, Gwekwerere YN (2007) Using a guided inquiry and modeling instructional framework (EIMA) to support preservice K-8 science teaching. Sci Educ 91:158–186CrossRef Schwarz CV, Gwekwerere YN (2007) Using a guided inquiry and modeling instructional framework (EIMA) to support preservice K-8 science teaching. Sci Educ 91:158–186CrossRef
Zurück zum Zitat Texas Education Agency (2005) Technical digest for the academic year 2004-2005. A Collaborative Effort of the Texas Education Agency, Pearson Educational Measurement, Harcourt Educational Measurement, and Beck Evaluation and Testing Associates, Inc. Author, Austin. Retrieved 1 December 2011 from http://www.tea.state.tx.us/student.assessment/ Texas Education Agency (2005) Technical digest for the academic year 2004-2005. A Collaborative Effort of the Texas Education Agency, Pearson Educational Measurement, Harcourt Educational Measurement, and Beck Evaluation and Testing Associates, Inc. Author, Austin. Retrieved 1 December 2011 from http://​www.​tea.​state.​tx.​us/​student.​assessment/​
Zurück zum Zitat Van Driel JH, Verloop N (1999) Teachers’ knowledge of models and modeling in science. Int J Sci Educ 21:1141–1153CrossRef Van Driel JH, Verloop N (1999) Teachers’ knowledge of models and modeling in science. Int J Sci Educ 21:1141–1153CrossRef
Zurück zum Zitat van Driel JH, Beijaard D, Verloop N (2001) Professional development and reform in science education: the role of teachers’ practical knowledge. J Res Sci Teach 38:137–158CrossRef van Driel JH, Beijaard D, Verloop N (2001) Professional development and reform in science education: the role of teachers’ practical knowledge. J Res Sci Teach 38:137–158CrossRef
Zurück zum Zitat van Prooijen J-W, van der Kloot WA (2001) Confirmatory analysis of exploratively obtained factor structures. Educ Psychol Measur 61:777–792CrossRef van Prooijen J-W, van der Kloot WA (2001) Confirmatory analysis of exploratively obtained factor structures. Educ Psychol Measur 61:777–792CrossRef
Zurück zum Zitat Venville G, Sheffield R, Rennie LJ, Wallace J (2008) The writing on the wall: classroom context, curriculum implementation, and student learning in integrated, community-based science projects. J Res Sci Teach 45(8):857–880CrossRef Venville G, Sheffield R, Rennie LJ, Wallace J (2008) The writing on the wall: classroom context, curriculum implementation, and student learning in integrated, community-based science projects. J Res Sci Teach 45(8):857–880CrossRef
Zurück zum Zitat Vescio V, Rossa D, Adams A (2008) A review of research on the impact of professional learning communities on teaching practice and student learning. Teach Teacher Educ 24(1):80–91CrossRef Vescio V, Rossa D, Adams A (2008) A review of research on the impact of professional learning communities on teaching practice and student learning. Teach Teacher Educ 24(1):80–91CrossRef
Zurück zum Zitat Waight N, Abd-El-Khalick F (2007) The impact of technology on the enactment of “inquiry” in a technology enthusiast’s sixth grade science classroom. J Res Sci Teach 44(1):154–182CrossRef Waight N, Abd-El-Khalick F (2007) The impact of technology on the enactment of “inquiry” in a technology enthusiast’s sixth grade science classroom. J Res Sci Teach 44(1):154–182CrossRef
Zurück zum Zitat Wells M, Hestenes D, Swackhamer G (1995) A modeling method for high school physics instruction. Am J Phys 63:606–619CrossRef Wells M, Hestenes D, Swackhamer G (1995) A modeling method for high school physics instruction. Am J Phys 63:606–619CrossRef
Zurück zum Zitat Wilson CD, Taylor JA, Kowalski SM, Carlson J (2010) The relative effects and equity of inquiry-based and commonplace science teaching on students’ knowledge, reasoning, and argumentation. J Res Sci Teach 47(3):276–301 Wilson CD, Taylor JA, Kowalski SM, Carlson J (2010) The relative effects and equity of inquiry-based and commonplace science teaching on students’ knowledge, reasoning, and argumentation. J Res Sci Teach 47(3):276–301
Zurück zum Zitat Zeichner K, Liston DP (2006) Teaching student teachers to reflect. In: Hartley D, Whitehead M (eds) Teacher education: professionalism, social justice and teacher education (Volume IV). Routledge, New York, pp 5–34 Zeichner K, Liston DP (2006) Teaching student teachers to reflect. In: Hartley D, Whitehead M (eds) Teacher education: professionalism, social justice and teacher education (Volume IV). Routledge, New York, pp 5–34
Metadaten
Titel
Measuring Model-Based High School Science Instruction: Development and Application of a Student Survey
verfasst von
Gavin W. Fulmer
Ling L. Liang
Publikationsdatum
01.02.2013
Verlag
Springer Netherlands
Erschienen in
Journal of Science Education and Technology / Ausgabe 1/2013
Print ISSN: 1059-0145
Elektronische ISSN: 1573-1839
DOI
https://doi.org/10.1007/s10956-012-9374-z

Weitere Artikel der Ausgabe 1/2013

Journal of Science Education and Technology 1/2013 Zur Ausgabe

    Marktübersichten

    Die im Laufe eines Jahres in der „adhäsion“ veröffentlichten Marktübersichten helfen Anwendern verschiedenster Branchen, sich einen gezielten Überblick über Lieferantenangebote zu verschaffen.