Skip to main content
Disciplines
Automotive Business IT + Informatics Construction + Real Estate Electrical Engineering + Electronics Energy + Sustainability Insurance + Risk Finance + Banking Management + Leadership Marketing + Sales Mechanical Engineering + Materials
Events
DE
EN
Books
Journals
Topic Page
Marketing
Start single access now
Access for companies
EXTENDED SEARCH
Log in
Top
Published in:
What Does a ‘Good’ Essay Look Like? Rainbow Diagrams Representing Essay Quality Read chapter Read first chapter

2018 | OriginalPaper | Chapter

Calculating the Random Guess Score of Multiple-Response and Matching Test Items

Authors : Silvester Draaijer, Sally Jordan, Helen Ogden

Published in: Technology Enhanced Assessment

Publisher: Springer International Publishing

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

For achievement tests, the guess score is often used as a baseline for the lowest possible grade for score to grade transformations and setting the cut scores. For test item types such as multiple-response, matching and drag-and-drop, determining the guess score requires more elaborate calculations than the more straightforward calculation of the guess score for True-False and multiple-choice test item formats. For various variants of multiple-response and matching types with respect to dichotomous and polytomous scoring, methods for determining the guess score are presented and illustrated with practical applications. The implications for theory and practice are discussed.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

inform now
previous chapter Pathways to Successful Online Testing: eExams with the “Secure Exam Environment” (SEE)
next chapter Designing a Collaborative Problem Solving Task in the Context of Urban Planning
Footnotes
1
Some other methods try to incorporate student’s knowledge level in estimating guessing level using formula scoring [10] but this is abandoned because of validity problems [11].
 
Literature
1.
Berk, R.A.: A consumer’s guide to setting performance standards on criterion-referenced tests. Rev. Educ. Res. 56, 137–172 (1986)CrossRef
2.
Brennan, R.L.: Educational Measurement. Rowman & Littlefield Publishers, Lanham (2006)
3.
Cizek, G.J.: Setting Performance Standards: Concepts, Methods, and Perspectives. Routledge, Abingdon (2001)
4.
Cohen-Schotanus, J., Van der Vleuten, C.P.M.: A standard setting method with the best performing students as point of reference: practical and affordable. Med. Teach. 32, 154–160 (2010)CrossRef
5.
Burton, R.F.: Quantifying the effects of chance in multiple choice and true/false tests: question selection and guessing of answers. Assess. Eval. High. Educ. 26, 41–50 (2001)CrossRef
6.
7.
Ebel, R.L., Frisbie, D.A.: Essentials of Educational Measurement. Prentice Hall, Upper Saddle River (1991)
8.
Gronlund, N.E.: Assessment of Student Achievement. Allyn & Bacon, Boston (1998)
9.
Van Berkel, H.J.M., Bax, A.: Toetsen in het Hoger Onderwijs [Testing in Higher Education]. Bohn Stafleu Van Loghum, Houten/Diegem (2006)
10.
Frary, R.B.: Formula scoring of multiple-choice tests (correction for guessing). In: ITEMS: The Instructional Topics in Educational Measurement Series (1988)
11.
Roberts, D.: Let’s talk about the “correction for guessing” formula. Penn State University (2001)
12.
Draaijer, S., Hartog, R., Hofstee, J.: Guidelines for the design of digital closed questions for assessment and learning in higher education. E-J. Instr. Sci. Technol. 10 (2007)
13.
Hartog, R., Draaijer, S., Rietveld, L.C.: Practical aspects of task allocation in design and development of digital closed questions in higher education. Pract. Assess. Res. Eval. 13, 2–15 (2008)
14.
Jordan, S.: E-assessment: past, present and future. New Dir. 9, 87–106 (2013)CrossRef
15.
Draaijer, S., Hartog, R.: Design patterns for digital item types in higher education. E-J. Instr. Sci. Technol. 10 (2007)
16.
Mackenzie, D., O’Hare, D.: Empirical prediction of the measurement scale and base level “guess factor” for advanced computer-based assessments. In: Danson, M. (ed.) Sixth International Computer Assisted Assessment (CAA) Conference Proceedings. Loughborough University (2002)
17.
18.
Brown, G.A., Bull, J., Pendlebury, M.: Assessing Student Learning in Higher Education. Routledge, Abingdon (1997)
19.
Attali, Y., Bar-Hillel, M.: Guess where: the position of correct answers in multiple-choice test items as a psychometric variable. J. Educ. Meas. 40, 109–128 (2003)CrossRef
20.
Kupsch, B., Horn, E.: Writing matching questions. UW–Madison School of Nursing
21.
Vos, H., De Graaf, A.: De quotiëntregel [The quotient rule]. Examas. 1, 18–21 (2008)
22.
Vos, H., Kloppenburg, M., Tomson, O.: Optimale uniforme scoringsregels voor innovatieve vraagvormen [Optimal uniform scoring rules for innovative test item formats]. Examas. 3, 21–24 (2010)
23.
Eggen, T.J., Lampe, T.T.: Comparison of the reliability of scoring methods of multiple-response items, matching items, and sequencing items. CADMO (2012)
Metadata
Title
Calculating the Random Guess Score of Multiple-Response and Matching Test Items
Authors
Silvester Draaijer
Sally Jordan
Helen Ogden
Copyright Year
2018
Book
Technology Enhanced Assessment

Print ISBN: 978-3-319-97806-2

Electronic ISBN: 978-3-319-97807-9

Copyright Year: 2018

DOI
https://doi.org/10.1007/978-3-319-97807-9_16

Premium Partner

    Image Credits