Generalized reliability based on distances

DOI10.1111/BIOM.13287MaRDI QIDQ6094207zbMATH OpenOpenAlexFDO

Authors Meng Xu, Philip T. Reiss, Ivor Cribben

Publication date 9 October 2023

Published in Biometrics (Search for Journal in Brave)

Copyright license Creative Commons Attribution 4.0 International

Full work available at URL https://arxiv.org/abs/1912.07137

zbMATH Keywords

functional connectivityintraclass correlation coefficientSpearman-Brown formulatest-retest reliability

Mathematics Subject Classification ID

Applications of statistics to biology and medical sciences; meta analysis (62P10)

Abstract: The intraclass correlation coefficient (ICC) is a classical index of measurement reliability. With the advent of new and complex types of data for which the ICC is not defined, there is a need for new ways to assess reliability. To meet this need, we propose a new distance-based intraclass correlation coefficient (dbICC), defined in terms of arbitrary distances among observations. We introduce a bias correction to improve the coverage of bootstrap confidence intervals for the dbICC, and demonstrate its efficacy via simulation. We illustrate the proposed method by analyzing the test-retest reliability of brain connectivity matrices derived from a set of repeated functional magnetic resonance imaging scans. The Spearman-Brown formula, which shows how more intensive measurement increases reliability, is extended to encompass the dbICC.

Recommendations

• Generalized S-Shapedness of Reliability Functions
• scientific article; zbMATH DE number 1531976
• Relations for reliability measures of weighted distributions
• Extensions of reliability theory
• On the crossings of reliability measures
• The reliability of a generalized consecutive system
• Estimation and testing procedures for the reliability functions of a general class of distributions

Cites work

• scientific article; zbMATH DE number 4088796 (Why is no real title available?)
• scientific article; zbMATH DE number 847242 (Why is no real title available?)
• scientific article; zbMATH DE number 2199188 (Why is no real title available?)
• scientific article; zbMATH DE number 3297790 (Why is no real title available?)
• A unified approach to multi-item reliability
• Measuring and testing dependence by correlation of distances
• Measuring the Stability of Results From Supervised Statistical Learning
• Modern psychometrics with R
• Multivariate statistics. High dimensional and large-sample approximations.
• On distance-based permutation tests for between-group comparisons
• Stability

Cited in

(7)

• Truncated rank correlation (TRC) as a robust measure of test-retest reliability in mass spectrometry data
• Adaption of generalizability theory for inter-rater reliability for landmark localization
• Planning and analysis of measurement reliability studies
• Reliability of a longitudinal sequence of scale ratings
• Functional response models for intraclass correlation coefficients
• Generalized activities and \(K\)-terminal reliability
• Continuous-Time Multivariate Analysis

This page was built for publication: Generalized reliability based on distances

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6094207)