On Assessing Interrater Agreement for Multiple Attribute Responses

DOI10.2307/2531695MaRDI QIDQ3201486zbMATHOpenAlexWikidataFDO

Authors Lawrence L. Kupper, Kerry B. Hafner

Publication date 1989

Published in Biometrics (Search for Journal in Brave)

Full work available at URL https://doi.org/10.2307/2531695

zbMATH Keywords

kappa statisticnominal attributeschance-corrected agreement statisticsnoncentral hypergeometric distributiononditional distribution theorytwo-rater concordance statistic

Mathematics Subject Classification ID

Applications of statistics to biology and medical sciences; meta analysis (62P10) Applications of statistics (62P99)

Recommendations

• Rater agreement for complex assessments
• Agreement between two independent groups of raters
• Multiple-rater kappas for binary data: models and interpretation
• Beyond kappa: A review of interrater agreement measures
• Cohen's Kappa Statistic: A Critical Appraisal and Some Modifications

Cited in

(10)

• Inference procedures for assessing interobserver agreement among multiple raters
• A measure of interrater absolute agreement for ordinal categorical data
• Rater agreement for complex assessments
• scientific article; zbMATH DE number 4159937 (Why is no real title available?)
• A new approach to inter-rater agreement through stochastic orderings: the discrete case
• Marginal analysis of measurement agreement among multiple raters with non-ignorable missing ratings
• A multi-rater nonparametric test of agreement and corresponding agreement plot
• Do we agree? Measuring agreement on the human judgments in emotion annotation of news sentences
• On some methods of assessment of interrater reliability for nominal and ordinal data
• Higher-Order Kappa-Type Statistics for a Dichotomous Attribute in Multiple Ratings

This page was built for publication: On Assessing Interrater Agreement for Multiple Attribute Responses

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3201486)