Raking Kappa: Describing Potential Impact of Marginal Distributions on Measures of Agreement

Alan Agresti, Atalanta Ghosh, Matilde Bini

Research output: Contribution to journalArticlepeer-review

31 Scopus citations

Abstract

Several authors have noted the dependence of kappa measures of inter‐rater agreement on the marginal distributions of contingency tables displaying the joint ratings. This paper introduces a smoothed version of kappa computed after raking the table to achieve pre‐specified marginal distributions. A comparison of kappa with raked kappa for various margins can indicate the extent of the dependence on the margins, and can indicate how much of the lack of agreement is due to marginal heterogeneity.

Original languageEnglish
Pages (from-to)811-820
Number of pages10
JournalBiometrical Journal
Volume37
Issue number7
DOIs
StatePublished - 1 Jan 1995
Externally publishedYes

Keywords

  • Cohen's kappa
  • Raked contingency tables
  • Rater agreement
  • Table standardization
  • Weighted kappa

Fingerprint

Dive into the research topics of 'Raking Kappa: Describing Potential Impact of Marginal Distributions on Measures of Agreement'. Together they form a unique fingerprint.

Cite this