ura

Monitoring Rater Reliability

Last update: 13 September 2023

Copyright license: MIT license, File License

Software version identifier: 1.0.0

Provides researchers with a simple set of diagnostic tools for monitoring the progress and reliability of raters conducting content coding tasks. Goehring (2023) <https://bengoehring.github.io/files/ps-paper-anon-word-ca.docx> argues that supervisors—especially supervisors of small teams—should utilize computational tools to monitor reliability in real time. As such, this package provides easy-to-use functions for calculating inter-rater reliability statistics and measuring the reliability of one coder compared to the rest of the team.

This page was built for software: ura