Beyond kappa: A review of interrater agreement measures

DOI10.2307/3315487zbMath0929.62117WikidataQ59508937 ScholiaQ59508937MaRDI QIDQ4262085

Michelle Capozzoli, Debajyoti Sinha, Laura A. McSweeney, Mousumi Banerjee

Publication date: 31 January 2000

Published in: Canadian Journal of Statistics (Search for Journal in Brave)

Full work available at URL: https://semanticscholar.org/paper/7dc97e85652502ccfab37c549c671408ce94a94e

zbMATH Keywords

log-linear models; ordinal data; intraclass correlation; nominal data; kappa coefficient

Mathematics Subject Classification ID

62H20: Measures of association (correlation, canonical correlation, etc.)

62P25: Applications of statistics to social sciences

62P15: Applications of statistics to psychology

Related Items

Bayesian Inference for Kappa from Single and Multiple Studies, Unnamed Item, A new weighted rank coefficient of concordance, Statistical description of interrater variability in ordinal ratings, On population‐based measures of agreement for binary classifications, Methods of assessing categorical agreement between correlated screening tests in clinical studies, A new approach to inter-rater agreement through stochastic orderings: the discrete case, Multivariate spatial outlier detection using robust geographically weighted methods, On the equivalence of multirater kappas based on 2-agreement and 3-agreement with binary scores, A comparison of reliability coefficients for ordinal rating scales, Scalable penalized spatiotemporal land-use regression for ground-level nitrogen dioxide, The effect of combining categories on Bennett, Alpert and Goldstein's \(S\), Equivalences of weighted kappas for multiple raters, Cohen's quadratically weighted kappa is higher than linearly weighted kappa for tridiagonal agreement tables, Inequalities between multi-rater kappas, Weighted Least-Squares Approach for Comparing Correlated Kappa, A local agreement pattern measure based on hazard functions for survival outcomes, A Bayesian Method of Estimating Kappa Coefficient with Application to a Rheumatoid Arthritis Study, Fixed-Effects Modeling of Cohen's Kappa for Bivariate Multinomial Data

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Longitudinal data analysis using generalized linear models
• Maximum Likelihood Estimation of Agreement in the Constant Predictive Probability Model, and Its Relation to Cohen's Kappa
• 2 x 2 Kappa Coefficients: Measures of Agreement or Association
• A Concordance Correlation Coefficient to Evaluate Reproducibility
• The Maximum Likelihood Estimation of Correlation from Contingency Tables
• A Model for Agreement Between Ratings on an Ordinal Scale
• Extension of the Kappa Coefficient
• Measuring Agreement for Multinomial Data
• The Measurement of Observer Agreement for Categorical Data
• Measurement of Interrater Agreement with Adjustment for Covariates
• Testing the Homogeneity of Kappa Statistics
• A Weighted Concordance Correlation Coefficient for Repeated Measurement Designs
• Assessing Interrater Agreement from Dependent Data
• Latent Variable Models for Clustered Ordinal Data
• Measures of Association for Cross Classifications