Skip to main content
Erschienen in: Advances in Data Analysis and Classification 1/2013

01.03.2013 | Regular Article

Cohen’s weighted kappa with additive weights

verfasst von: Matthijs J. Warrens

Erschienen in: Advances in Data Analysis and Classification | Ausgabe 1/2013

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Cohen’s weighted kappa is a popular descriptive statistic for summarizing interrater agreement on an ordinal scale. An agreement table with \(n\in \mathbb N _{\ge 3}\) ordered categories can be collapsed into \(n-1\) distinct \(2\times 2\) tables by combining adjacent categories. Weighted kappa with linear weights is a weighted average of the kappas corresponding to the \(2\times 2\) tables, where the weights are the denominators of the \(2\times 2\) kappas. It is shown that the linearly weighted kappa is a special case of a more general weighted kappa that is a weighted average of the \(2\times 2\) kappas. This weighted kappa has additive weights, that is, given initial weights for pairs of adjacent categories the weight for two non-adjacent categories is obtained by adding the weights of all pairs of adjacent categories between the two.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Anderson SI, Housley AM, Jones PA, Slattery J, Miller JD (1993) Glasgow outcome scale: an inter-rater reliability study. Brain Inj 7:309–317CrossRef Anderson SI, Housley AM, Jones PA, Slattery J, Miller JD (1993) Glasgow outcome scale: an inter-rater reliability study. Brain Inj 7:309–317CrossRef
Zurück zum Zitat Berry KJ, Johnston JE, Mielke PW (2008) Weighted kappa for multiple raters. Percept Mot Skill 107: 837–848 Berry KJ, Johnston JE, Mielke PW (2008) Weighted kappa for multiple raters. Percept Mot Skill 107: 837–848
Zurück zum Zitat Brenner H, Kliebsch U (1996) Dependence of weighted kappa coefficients on the number of categories. Epidemiology 7:199–202CrossRef Brenner H, Kliebsch U (1996) Dependence of weighted kappa coefficients on the number of categories. Epidemiology 7:199–202CrossRef
Zurück zum Zitat Cicchetti DV (1976) Assessing inter-rater reliability for rating scales: resolving some basic issues. Bri J Psychiatry 129:452–456CrossRef Cicchetti DV (1976) Assessing inter-rater reliability for rating scales: resolving some basic issues. Bri J Psychiatry 129:452–456CrossRef
Zurück zum Zitat Cicchetti D, Allison T (1971) A new procedure for assessing reliability of scoring EEG sleep recordings. Am J EEG Technol 11:101–109 Cicchetti D, Allison T (1971) A new procedure for assessing reliability of scoring EEG sleep recordings. Am J EEG Technol 11:101–109
Zurück zum Zitat Cohen J (1960) A coefficient of agreement for nominal scales. Educat Psychol Measur 20:37–46CrossRef Cohen J (1960) A coefficient of agreement for nominal scales. Educat Psychol Measur 20:37–46CrossRef
Zurück zum Zitat Cohen J (1968) Weighted kappa: nominal scale agreement with provision for scaled disagreement or partial credit. Psychol Bull 70:213–220CrossRef Cohen J (1968) Weighted kappa: nominal scale agreement with provision for scaled disagreement or partial credit. Psychol Bull 70:213–220CrossRef
Zurück zum Zitat Fleiss JL, Cohen J (1973) The equivalence of weighted kappa and the intraclass correlation coefficient as measures of reliability. Edu Psychol Measur 33:613–619CrossRef Fleiss JL, Cohen J (1973) The equivalence of weighted kappa and the intraclass correlation coefficient as measures of reliability. Edu Psychol Measur 33:613–619CrossRef
Zurück zum Zitat Fleiss JL, Cohen J, Everitt BS (1969) Large sample standard errors of kappa and weighted kappa. Psychol Bull 72:323–327CrossRef Fleiss JL, Cohen J, Everitt BS (1969) Large sample standard errors of kappa and weighted kappa. Psychol Bull 72:323–327CrossRef
Zurück zum Zitat Graham P, Jackson R (1993) The analysis of ordinal agreement data: beyond weighted kappa. J Clin Epidemiol 46:1055–1062CrossRef Graham P, Jackson R (1993) The analysis of ordinal agreement data: beyond weighted kappa. J Clin Epidemiol 46:1055–1062CrossRef
Zurück zum Zitat Hsu LM, Field R (2003) Interrater agreement measures: comments on \(\kappa _{n}\), Cohen’s kappa, Scott’s \(\pi \) and Aickin’s \(\alpha \). Underst Stat 2:205–219CrossRef Hsu LM, Field R (2003) Interrater agreement measures: comments on \(\kappa _{n}\), Cohen’s kappa, Scott’s \(\pi \) and Aickin’s \(\alpha \). Underst Stat 2:205–219CrossRef
Zurück zum Zitat Jakobsson U, Westergren A (2005) Statistical methods for assessing agreement for ordinal data. Scand J Caring Sci 19:427–431CrossRef Jakobsson U, Westergren A (2005) Statistical methods for assessing agreement for ordinal data. Scand J Caring Sci 19:427–431CrossRef
Zurück zum Zitat Kraemer HC, Periyakoil VS, Noda A (2002) Kappa coefficients in medical research. Stat Med 21:2109–2129CrossRef Kraemer HC, Periyakoil VS, Noda A (2002) Kappa coefficients in medical research. Stat Med 21:2109–2129CrossRef
Zurück zum Zitat Kundel HL, Polansky M (2003) Measurement of observer agreement. Radiology 288:303–308CrossRef Kundel HL, Polansky M (2003) Measurement of observer agreement. Radiology 288:303–308CrossRef
Zurück zum Zitat Maclure M, Willett WC (1987) Misinterpretation and misuse of the kappa statistic. J Epidemiol 126:161–169CrossRef Maclure M, Willett WC (1987) Misinterpretation and misuse of the kappa statistic. J Epidemiol 126:161–169CrossRef
Zurück zum Zitat Mielke PW, Berry KJ (2009) A note on Cohen’s weighted kappa coefficient of agreement with linear weights. Stat Methodol 6:439–446MathSciNetCrossRef Mielke PW, Berry KJ (2009) A note on Cohen’s weighted kappa coefficient of agreement with linear weights. Stat Methodol 6:439–446MathSciNetCrossRef
Zurück zum Zitat Schuster C (2004) A note on the interpretation of weighted kappa and its relations to other rater agreement statistics for metric scales. Edu Psychol Measur 64:243–253MathSciNetCrossRef Schuster C (2004) A note on the interpretation of weighted kappa and its relations to other rater agreement statistics for metric scales. Edu Psychol Measur 64:243–253MathSciNetCrossRef
Zurück zum Zitat Seddon JM, Sahagian CR, Glynn RJ, Sperduto RD, Gragoudas ES, The Eye Disorders Case-Control Study Group (1990) Evaluation of an iris color classification system. Invest Ophthalmol Vis Sci 31:1592–1598 Seddon JM, Sahagian CR, Glynn RJ, Sperduto RD, Gragoudas ES, The Eye Disorders Case-Control Study Group (1990) Evaluation of an iris color classification system. Invest Ophthalmol Vis Sci 31:1592–1598
Zurück zum Zitat Warrens MJ (2011) Cohen’s linearly weighted kappa is a weighted average of \(2\times 2\) kappas. Psychometrika 76:471–486MathSciNetMATHCrossRef Warrens MJ (2011) Cohen’s linearly weighted kappa is a weighted average of \(2\times 2\) kappas. Psychometrika 76:471–486MathSciNetMATHCrossRef
Zurück zum Zitat Warrens MJ (2012a) Some paradoxical results for the quadratically weighted kappa. Psychometrika 77: 315–323 Warrens MJ (2012a) Some paradoxical results for the quadratically weighted kappa. Psychometrika 77: 315–323
Zurück zum Zitat Warrens MJ (2012b) Cohen’s linearly weighted kappa is a weighted average. Adv Data Anal Class 6:67–79 Warrens MJ (2012b) Cohen’s linearly weighted kappa is a weighted average. Adv Data Anal Class 6:67–79
Zurück zum Zitat Warrens MJ (2012c) Equivalences of weighted kappas for multiple raters. Stat Method 9:407–422 Warrens MJ (2012c) Equivalences of weighted kappas for multiple raters. Stat Method 9:407–422
Zurück zum Zitat Westlund KB, Kurland LT (1953) Studies on multiple sclerosis in Winnipeg, Manitoba and New Orleans, Louisiana. Am J Hyg 57:380–396 Westlund KB, Kurland LT (1953) Studies on multiple sclerosis in Winnipeg, Manitoba and New Orleans, Louisiana. Am J Hyg 57:380–396
Zurück zum Zitat Wilson JTL, Pettigrew LEL, Teasdale GM (1998) Structured interviews for the Glasgow outcome scale and the extended Glasgow outcome scale: guidelines for their use. J Neurotrauma 15:573–585CrossRef Wilson JTL, Pettigrew LEL, Teasdale GM (1998) Structured interviews for the Glasgow outcome scale and the extended Glasgow outcome scale: guidelines for their use. J Neurotrauma 15:573–585CrossRef
Metadaten
Titel
Cohen’s weighted kappa with additive weights
verfasst von
Matthijs J. Warrens
Publikationsdatum
01.03.2013
Verlag
Springer-Verlag
Erschienen in
Advances in Data Analysis and Classification / Ausgabe 1/2013
Print ISSN: 1862-5347
Elektronische ISSN: 1862-5355
DOI
https://doi.org/10.1007/s11634-013-0123-9

Weitere Artikel der Ausgabe 1/2013

Advances in Data Analysis and Classification 1/2013 Zur Ausgabe

Editorial

Editorial

Premium Partner