Equivalences of weighted kappas for multiple raters

DOI10.1016/J.STAMET.2011.11.001MaRDI QIDQ2360892zbMATH OpenOpenAlexFDO

Authors Matthijs J. Warrens

Publication date 29 June 2017

Published in Statistical Methodology (Search for Journal in Brave)

Full work available at URL https://doi.org/10.1016/j.stamet.2011.11.001

zbMATH Keywords

Cohen's kappaCohen's weighted kappainter-rater reliabilityordinal agreementMielke, Berry and Johnston's weighted kappa\(g\)-agreementHubert's kappamultiple raters

Mathematics Subject Classification ID

Contingency tables (62H17) Measures of association (correlation, canonical correlation, etc.) (62H20)

Recommendations

• Weighted kappas for \(3 \times 3\) tables
• A family of multi-rater kappas that can always be increased and decreased by combining categories
• Weighted kappa as a function of unweighted kappas
• Measuring inter-rater agreement: how useful is the kappa statistic
• Hubert's multi-rater kappa revisited

Cites work

• scientific article; zbMATH DE number 3866350 (Why is no real title available?)
• A comparison of the multidimensional scaling of triadic and dyadic distances
• A family of multi-rater kappas that can always be increased and decreased by combining categories
• A formal proof of a paradox associated with Cohen's kappa
• A note on the linearly weighted kappa coefficient for ordinal scales
• Agreement between two independent groups of raters
• An Application of Hierarchical Kappa-type Statistics in the Assessment of Majority Agreement among Multiple Observers
• Beyond kappa: A review of interrater agreement measures
• Cohen's kappa can always be increased and decreased by combining categories
• Cohen's kappa is a weighted average
• Cohen's linearly weighted kappa is a weighted average of \(2\times 2\) kappas
• Dispersion-weighted kappa: an integrative framework for metric and nominal scale agreement coefficients
• Generalization of the kappa coefficient for ordinal categorical data, multiple observers and incomplete designs
• Inequalities between kappa and kappa-like statistics for \(k\times k\) tables
• Inequalities between multi-rater kappas
• Measuring Agreement for Multinomial Data
• On multi-way metricity, minimality and diagonal planes
• On similarity coefficients for \(2\times2\) tables and correction for chance
• On the equivalence of Cohen's kappa and the Hubert-Arabie adjusted Rand index
• Ramifications of a population model for \(\kappa\) as a coefficient of reliability
• Some paradoxical results for the quadratically weighted kappa
• Statistical description of interrater variability in ordinal ratings
• The Measurement of Observer Agreement for Categorical Data
• Triadic distance models: axiomatization and least squares representation
• Weighted kappa is higher than Cohen's kappa for tridiagonal agreement tables
• \(k\)-adic similarity coefficients for binary (presence/absence) data
• \(n\)-way metrics

Cited in

(14)

• Dispersion-weighted kappa: an integrative framework for metric and nominal scale agreement coefficients
• On the equivalence of multirater kappas based on 2-agreement and 3-agreement with binary scores
• Weighted kappas for \(3 \times 3\) tables
• Corrected Zegers-ten Berge coefficients are special cases of Cohen's weighted kappa
• The dependence of chance-corrected weighted agreement coefficients on the power parameter of the weighting scheme: analysis and measurement
• Hubert's multi-rater kappa revisited
• Cohen's weighted kappa with additive weights
• Inequalities between multi-rater kappas
• On the equivalence of some indices of similarity: implication for binary presence/absence data
• Analysis of the weighted kappa and its maximum with Markov moves
• Power weighted versions of Bennett, Alpert, and Goldstein's \(S\)
• Multiple-rater kappas for binary data: models and interpretation
• A family of multi-rater kappas that can always be increased and decreased by combining categories
• A comparison of reliability coefficients for ordinal rating scales

This page was built for publication: Equivalences of weighted kappas for multiple raters

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2360892)