Skip to main content
Erschienen in: Journal of Science Education and Technology 2/2010

01.04.2010

Development and Application of a Rubric for Evaluating Students’ Performance on Newton’s Laws of Motion

verfasst von: Mustafa Sabri Kocakülah

Erschienen in: Journal of Science Education and Technology | Ausgabe 2/2010

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This study aims to develop and apply a rubric to evaluate the solutions of pre-service primary science teachers to questions about Newton’s Laws of Motion. Two groups were taught the topic using the same teaching methods and administered four questions before and after teaching. Furthermore, 76 students in the experiment group were instructed about the features and use of the rubric and asked to construct a rubric, while 77 students in the control group were not. Students’ solutions were evaluated with the agreed rubric by the instructor, an independent coder and the peers in the experiment class. The effectiveness of the rubric on students’ achievement was examined by applying descriptive statistics and linear regression to scores obtained from both tests. T-test statistics and analysis of variance procedures were also used to analyze the reliability and validity of the assessments made. The results revealed that the developed rubric was used consistently by the instructor and peers and significant correlations (p < 0.001) were found among the scores. The inter-coder reliabilities were 0.98 and 0.93 in the pre- and post-tests with 76 peer coders. A generalizability study showed that the estimates of 16 peer coders on average matched the reliability of single-instructor assessments. It was concluded that the developed rubric was able to highlight the aspects of the problem solutions and helped increase students’ achievement.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Literatur
Zurück zum Zitat Andaloro G, Bellomonte L, Sperandeo-Mineo RM (1997) A computer-based learning environment in the field of Newtonian mechanics. Int J Sci Educ 19(6):661–680CrossRef Andaloro G, Bellomonte L, Sperandeo-Mineo RM (1997) A computer-based learning environment in the field of Newtonian mechanics. Int J Sci Educ 19(6):661–680CrossRef
Zurück zum Zitat Bakeman R (2005) Recommended effect size statistics for repeated measures designs. Behav Res Methods 37(3):379–384 Bakeman R (2005) Recommended effect size statistics for repeated measures designs. Behav Res Methods 37(3):379–384
Zurück zum Zitat Bednarski M (2003) Assessing performance tasks. Sci Teach 70(4):34 Bednarski M (2003) Assessing performance tasks. Sci Teach 70(4):34
Zurück zum Zitat Caleon I, Subramaniam R (2005) The impact of a cryogenics-based enrichment programme on attitude towards science and the learning of science concepts. Int J Sci Educ 27(6):679–704CrossRef Caleon I, Subramaniam R (2005) The impact of a cryogenics-based enrichment programme on attitude towards science and the learning of science concepts. Int J Sci Educ 27(6):679–704CrossRef
Zurück zum Zitat Crouch C (1998) Peer instruction: an interactive approach for large classes. Opt Photonics News 9(9):37–41CrossRef Crouch C (1998) Peer instruction: an interactive approach for large classes. Opt Photonics News 9(9):37–41CrossRef
Zurück zum Zitat Crouch CH, Mazur E (2001) Peer instruction: ten years of experience and results. Am J Phys 69(9):970–977CrossRef Crouch CH, Mazur E (2001) Peer instruction: ten years of experience and results. Am J Phys 69(9):970–977CrossRef
Zurück zum Zitat D’amico EJ, Neilands TB, Zambarano R (2001) Power analysis for multivariate and repeated measures designs: a flexible approach using the SPSS MANOVA procedure. Behav Res Methods Instrum Comput 33(4):479–484 D’amico EJ, Neilands TB, Zambarano R (2001) Power analysis for multivariate and repeated measures designs: a flexible approach using the SPSS MANOVA procedure. Behav Res Methods Instrum Comput 33(4):479–484
Zurück zum Zitat Davidowitz B, Rollnick M, Fakudze C (2005) Development and application of a rubric for analysis of novice students’ laboratory flow diagrams. Int J Sci Educ 27(1):43–59CrossRef Davidowitz B, Rollnick M, Fakudze C (2005) Development and application of a rubric for analysis of novice students’ laboratory flow diagrams. Int J Sci Educ 27(1):43–59CrossRef
Zurück zum Zitat Ebel RL (1951) Estimation of the reliability of ratings. Psychometrika 16(4):407–424CrossRef Ebel RL (1951) Estimation of the reliability of ratings. Psychometrika 16(4):407–424CrossRef
Zurück zum Zitat Etkina E, Van Heuvelen A, White-Brahmia S, Brookes DT, Gentile M, Murthy S, Rosengrant D, Warren A (2006) Scientific abilities and their assessment. Phys Rev Spec Top Phys Educ Res 2(2):1–15 Etkina E, Van Heuvelen A, White-Brahmia S, Brookes DT, Gentile M, Murthy S, Rosengrant D, Warren A (2006) Scientific abilities and their assessment. Phys Rev Spec Top Phys Educ Res 2(2):1–15
Zurück zum Zitat Fagen AP (2003) Assessing and enhancing the introductory science course in physics and biology: peer instruction, classroom demonstrations and genetics vocabulary. PhD thesis, Harvard University Fagen AP (2003) Assessing and enhancing the introductory science course in physics and biology: peer instruction, classroom demonstrations and genetics vocabulary. PhD thesis, Harvard University
Zurück zum Zitat Fagen AP, Crouch CH, Mazur E (2002) Peer instruction: results from a range of classrooms. Phys Teach 40(4):206–209CrossRef Fagen AP, Crouch CH, Mazur E (2002) Peer instruction: results from a range of classrooms. Phys Teach 40(4):206–209CrossRef
Zurück zum Zitat Falchikov N (1995) Peer feedback marking: developing peer assessment. Innov Educ Train Int 32(2):175–187CrossRef Falchikov N (1995) Peer feedback marking: developing peer assessment. Innov Educ Train Int 32(2):175–187CrossRef
Zurück zum Zitat Ferguson GA (1971) Statistical analysis in psychology and education. McGraw-Hill, New York Ferguson GA (1971) Statistical analysis in psychology and education. McGraw-Hill, New York
Zurück zum Zitat Fowler SR, Zeidler DL, Sadler TD (2009) Moral sensitivity in the context of socioscientific issues in high school science students. Int J Sci Educ 31(2):279–296CrossRef Fowler SR, Zeidler DL, Sadler TD (2009) Moral sensitivity in the context of socioscientific issues in high school science students. Int J Sci Educ 31(2):279–296CrossRef
Zurück zum Zitat Fraenkel JR, Wallen NE (1996) How to design and evaluate research in education, 3rd edn. McGraw-Hill, New York Fraenkel JR, Wallen NE (1996) How to design and evaluate research in education, 3rd edn. McGraw-Hill, New York
Zurück zum Zitat Freeman M (1995) Peer assessment by groups of group work. Assess Eval High Educ 20:289–299CrossRef Freeman M (1995) Peer assessment by groups of group work. Assess Eval High Educ 20:289–299CrossRef
Zurück zum Zitat Gaigher E, Rogan JM, Braun MWH (2007) Exploring the development of conceptual understanding through structured problem-solving in physics. Int J Sci Educ 29(9):1089–1110CrossRef Gaigher E, Rogan JM, Braun MWH (2007) Exploring the development of conceptual understanding through structured problem-solving in physics. Int J Sci Educ 29(9):1089–1110CrossRef
Zurück zum Zitat Gatfield T (1999) Examining student satisfaction with group projects and peer assessment. Assess Eval High Educ 24:365–377CrossRef Gatfield T (1999) Examining student satisfaction with group projects and peer assessment. Assess Eval High Educ 24:365–377CrossRef
Zurück zum Zitat Gillmore GM (2000) Drawing inferences about instructors: the inter-class reliability of student ratings of instruction. Office of Educational Assessment, report no. 00-02, University of Washington, US Gillmore GM (2000) Drawing inferences about instructors: the inter-class reliability of student ratings of instruction. Office of Educational Assessment, report no. 00-02, University of Washington, US
Zurück zum Zitat Gravetter FJ, Wallnau LB (1996) Statistics for the behavioral sciences: a first course for students of psychology and education, 4th edn. West Publishing Company, Minneapolis Gravetter FJ, Wallnau LB (1996) Statistics for the behavioral sciences: a first course for students of psychology and education, 4th edn. West Publishing Company, Minneapolis
Zurück zum Zitat Green PJ (2003) Peer instruction for astronomy. Prentice Hall, Upper Saddle River Green PJ (2003) Peer instruction for astronomy. Prentice Hall, Upper Saddle River
Zurück zum Zitat Green SB, Salkind NJ, Akey TM (2000) Using SPSS for Windows: analyzing and understanding data. Prentice Hall, New Jersey Green SB, Salkind NJ, Akey TM (2000) Using SPSS for Windows: analyzing and understanding data. Prentice Hall, New Jersey
Zurück zum Zitat Hafner JC, Hafner PM (2003) Quantitative analysis of the rubric as an assessment tool: an empirical study of student peer-group rating. Int J Sci Educ 25(12):1509–1528CrossRef Hafner JC, Hafner PM (2003) Quantitative analysis of the rubric as an assessment tool: an empirical study of student peer-group rating. Int J Sci Educ 25(12):1509–1528CrossRef
Zurück zum Zitat Hair JF, Anderson RE, Tatham RL, Black WC (1998) Multivariate data analysis. Prentice Hall, New Jersey Hair JF, Anderson RE, Tatham RL, Black WC (1998) Multivariate data analysis. Prentice Hall, New Jersey
Zurück zum Zitat Herman JL, Aschbacher PR, Winters L (1992) A practical guide to alternative assessment. Association for Supervision and Curriculum Development, Alexandria Herman JL, Aschbacher PR, Winters L (1992) A practical guide to alternative assessment. Association for Supervision and Curriculum Development, Alexandria
Zurück zum Zitat Hohenshell LM, Hand B (2006) Writing-to-learn strategies in secondary school cell biology: a mixed method study. Int J Sci Educ 28(2&3):261–289CrossRef Hohenshell LM, Hand B (2006) Writing-to-learn strategies in secondary school cell biology: a mixed method study. Int J Sci Educ 28(2&3):261–289CrossRef
Zurück zum Zitat Hughes IE, Large BJ (1993) Staff and peer group assessment of oral communication skills. Stud High Educ 18:379–385CrossRef Hughes IE, Large BJ (1993) Staff and peer group assessment of oral communication skills. Stud High Educ 18:379–385CrossRef
Zurück zum Zitat Jackson CW, Larkin MJ (2002) Teaching students to use grading rubrics. Teach Except Child 35(1):40–45 Jackson CW, Larkin MJ (2002) Teaching students to use grading rubrics. Teach Except Child 35(1):40–45
Zurück zum Zitat Jimoyiannis A, Komis V (2003) Investigating Greek students’ ideas about forces and motion. Res Sci Educ 33:375–392CrossRef Jimoyiannis A, Komis V (2003) Investigating Greek students’ ideas about forces and motion. Res Sci Educ 33:375–392CrossRef
Zurück zum Zitat Kilic GB, Cakan M (2007) Peer assessment of elementary science teaching skills. J Sci Teacher Educ 18(1):91–107CrossRef Kilic GB, Cakan M (2007) Peer assessment of elementary science teaching skills. J Sci Teacher Educ 18(1):91–107CrossRef
Zurück zum Zitat Kinnear PR, Gray CD (2008) SPSS 16 made simple. Psychology Press, Hove Kinnear PR, Gray CD (2008) SPSS 16 made simple. Psychology Press, Hove
Zurück zum Zitat Kwan K, Leung R (1996) Tutor versus peer group assessment of student performance in a simulation training exercise. Assess Eval High Educ 21:205–215CrossRef Kwan K, Leung R (1996) Tutor versus peer group assessment of student performance in a simulation training exercise. Assess Eval High Educ 21:205–215CrossRef
Zurück zum Zitat Lasry N, Mazur E, Watkins J (2008) Peer instruction: from Harvard to the two-year college. Am J Phys 76(11):1066–1069CrossRef Lasry N, Mazur E, Watkins J (2008) Peer instruction: from Harvard to the two-year college. Am J Phys 76(11):1066–1069CrossRef
Zurück zum Zitat Litzinger TA, Lee SH, Wise JC, Felder RM (2007) A psychometric study of the index of learning styles. J Eng Educ 96(4):309–319 Litzinger TA, Lee SH, Wise JC, Felder RM (2007) A psychometric study of the index of learning styles. J Eng Educ 96(4):309–319
Zurück zum Zitat Lorenzo M, Crouch CH, Mazur E (2006) Reducing the gender gap in the physics classroom. Am J Phys 74(2):118–122CrossRef Lorenzo M, Crouch CH, Mazur E (2006) Reducing the gender gap in the physics classroom. Am J Phys 74(2):118–122CrossRef
Zurück zum Zitat Luft JA (1999) Rubrics: design and use in science teacher education. J Sci Teacher Educ 10(2):107–121CrossRef Luft JA (1999) Rubrics: design and use in science teacher education. J Sci Teacher Educ 10(2):107–121CrossRef
Zurück zum Zitat MacAlpine JMK (1999) Improving and encouraging peer assessment of student presentations. Assess Eval High Educ 24:15–25CrossRef MacAlpine JMK (1999) Improving and encouraging peer assessment of student presentations. Assess Eval High Educ 24:15–25CrossRef
Zurück zum Zitat Magin D, Helmore P (2001) Peer and teacher assessments of oral presentation skills: how reliable are they? Stud High Educ 26(3):287–298CrossRef Magin D, Helmore P (2001) Peer and teacher assessments of oral presentation skills: how reliable are they? Stud High Educ 26(3):287–298CrossRef
Zurück zum Zitat Mazur E (1997) Peer instruction: A user’s manual. Prentice Hall, Upper Saddle River, NJ Mazur E (1997) Peer instruction: A user’s manual. Prentice Hall, Upper Saddle River, NJ
Zurück zum Zitat McCollister S (2002) Developing criteria rubrics in the art classroom. Art Educ 55(6):46CrossRef McCollister S (2002) Developing criteria rubrics in the art classroom. Art Educ 55(6):46CrossRef
Zurück zum Zitat Mildenhall PT, Williams JS (2001) Instability in students’ use of intuitive and Newtonian models to predict motion: the critical effect of the parameters involved. Int J Sci Educ 23(6):643–660 Mildenhall PT, Williams JS (2001) Instability in students’ use of intuitive and Newtonian models to predict motion: the critical effect of the parameters involved. Int J Sci Educ 23(6):643–660
Zurück zum Zitat Nicol DJ, Boyle JT (2003) Peer instruction versus class-wide discussion in the large classes: a comparison of two interaction methods in the wired classroom. Stud High Educ 28(4):458–473CrossRef Nicol DJ, Boyle JT (2003) Peer instruction versus class-wide discussion in the large classes: a comparison of two interaction methods in the wired classroom. Stud High Educ 28(4):458–473CrossRef
Zurück zum Zitat Parker J, Heywood D (2000) Exploring the relationship between subject knowledge and pedagogic content knowledge in primary teachers’ learning about forces. Int J Sci Educ 22(1):89–111CrossRef Parker J, Heywood D (2000) Exploring the relationship between subject knowledge and pedagogic content knowledge in primary teachers’ learning about forces. Int J Sci Educ 22(1):89–111CrossRef
Zurück zum Zitat Pomplun M, Capps L (1999) Gender differences for constructed response mathematics items. Educ Psychol Measur 59:597–614CrossRef Pomplun M, Capps L (1999) Gender differences for constructed response mathematics items. Educ Psychol Measur 59:597–614CrossRef
Zurück zum Zitat Pomplun M, Sundbye N (1999) Gender differences in constructed response reading items. Appl Measur Educ 12:95–109CrossRef Pomplun M, Sundbye N (1999) Gender differences in constructed response reading items. Appl Measur Educ 12:95–109CrossRef
Zurück zum Zitat Popham WJ (1997) What’s wrong- and what’s right-with rubrics. Educ Leadership 55(2):72–75 Popham WJ (1997) What’s wrong- and what’s right-with rubrics. Educ Leadership 55(2):72–75
Zurück zum Zitat Potvin PJ, Schutz RW (2000) Statistical power for the two-factor repeated measures ANOVA. Behav Res Method Instrum Comput 32(2):347–356 Potvin PJ, Schutz RW (2000) Statistical power for the two-factor repeated measures ANOVA. Behav Res Method Instrum Comput 32(2):347–356
Zurück zum Zitat Rosengrant D, Van Heuvelen A, Etkina E (2005) Free-body diagrams: necessary or sufficient? Am Inst Phys Conf Proc 790(1):177–180 Rosengrant D, Van Heuvelen A, Etkina E (2005) Free-body diagrams: necessary or sufficient? Am Inst Phys Conf Proc 790(1):177–180
Zurück zum Zitat Rutherford S (2007) Using a laboratory conclusion rubric. Sci Act Classroom Projects Curr Ideas 43(4):9–14CrossRef Rutherford S (2007) Using a laboratory conclusion rubric. Sci Act Classroom Projects Curr Ideas 43(4):9–14CrossRef
Zurück zum Zitat Serway RA, Beichner RJ (2000) Physics for scientists and engineers. Saunders College Publishing, Orlando Serway RA, Beichner RJ (2000) Physics for scientists and engineers. Saunders College Publishing, Orlando
Zurück zum Zitat Shymansky JA, Yore LD, Treagust DF, Thiele RB, Harrison A, Waldrip BG, Stocklmayer SM, Venville G (1997) Examining the construction process: a study of changes in level 10 students’ understanding of classical mechanics. J Res Sci Teach 34(6):571–593CrossRef Shymansky JA, Yore LD, Treagust DF, Thiele RB, Harrison A, Waldrip BG, Stocklmayer SM, Venville G (1997) Examining the construction process: a study of changes in level 10 students’ understanding of classical mechanics. J Res Sci Teach 34(6):571–593CrossRef
Zurück zum Zitat Stefani LAJ (1994) Peer, self and tutor assessment: relative reliabilities. Stud High Educ 19:69–75CrossRef Stefani LAJ (1994) Peer, self and tutor assessment: relative reliabilities. Stud High Educ 19:69–75CrossRef
Zurück zum Zitat Stevens J (1996) Applied multivariate statistics for the social sciences. Erlbaum, Mahwah Stevens J (1996) Applied multivariate statistics for the social sciences. Erlbaum, Mahwah
Zurück zum Zitat Stoll SA (2003) Assessing elementary students. Strategies 16(1):33 Stoll SA (2003) Assessing elementary students. Strategies 16(1):33
Zurück zum Zitat Topping K (1998) Peer assessment between students in colleges and universities. Rev Educ Res 68(3):249–276 Topping K (1998) Peer assessment between students in colleges and universities. Rev Educ Res 68(3):249–276
Zurück zum Zitat Trumper R, Gorsky P (1997) A survey of biology students’ conceptions of force in pre-service training for high school teachers. Res Sci Technol Educ 15(2):133–149CrossRef Trumper R, Gorsky P (1997) A survey of biology students’ conceptions of force in pre-service training for high school teachers. Res Sci Technol Educ 15(2):133–149CrossRef
Metadaten
Titel
Development and Application of a Rubric for Evaluating Students’ Performance on Newton’s Laws of Motion
verfasst von
Mustafa Sabri Kocakülah
Publikationsdatum
01.04.2010
Verlag
Springer Netherlands
Erschienen in
Journal of Science Education and Technology / Ausgabe 2/2010
Print ISSN: 1059-0145
Elektronische ISSN: 1573-1839
DOI
https://doi.org/10.1007/s10956-009-9188-9

Weitere Artikel der Ausgabe 2/2010

Journal of Science Education and Technology 2/2010 Zur Ausgabe

    Marktübersichten

    Die im Laufe eines Jahres in der „adhäsion“ veröffentlichten Marktübersichten helfen Anwendern verschiedenster Branchen, sich einen gezielten Überblick über Lieferantenangebote zu verschaffen.