Tests for statistical significance of a treatment effect in the presence of hidden sub-populations

DOI10.1007/S10260-014-0271-XzbMATH Open1441.62149OpenAlexW2029438298MaRDI QIDQ2353370FDOQ2353370

Authors Yanyan Li 

Publication date 9 July 2015

Published in Statistical Methods and Applications (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/1211.0032

zbMATH Keywords

EM algorithmBayesian model averaginggap statisticDunn indexPAM clustering algorithmunivariate and multivariate two-sample tests

Mathematics Subject Classification ID

Bayesian inference (62F15) Classification and discrimination; cluster analysis (statistical aspects) (62H30) Hypothesis testing in multivariate analysis (62H15)

Abstract: For testing the statistical significance of a treatment effect, we usually compare between two parts of a population, one is exposed to the treatment, and the other is not exposed to it. Standard parametric and nonparametric two-sample tests are often used for this comparison. But direct applications of these tests can yield misleading results, especially when the population has some hidden sub-populations, and the impact of this sub-population difference on the study variables dominates the treatment effect. This problem becomes more evident if these subpopulations have widely different proportions of representatives in the samples taken from these two parts, which are often referred to as the treatment group and the control group. In this article, we make an attempt to overcome this problem. Our propose methods use suitable clustering algorithms to find the hidden sub-populations and then eliminate the sub-population effect by using suitable transformations. Standard two-sample tests, when they are applied on the transformed data, yield better results. Some simulated and real data sets are analyzed to show the utility of the proposed methods.

Recommendations

• A U-statistic-based test of treatment effect heterogeneity
• Uniformly most powerful tests for simultaneously detecting a treatment effect in the overall population and at least one subpopulation
• A Locally Most Powerful Test for Detecting a Treatment Effect in the Presence of Nonresponders
• A General Framework for Subgroup Detection via One-Step Value Difference Estimation
• Locally Most Powerful Tests for Detecting Treatment Effects When Only a Subset of Patients Can Be Expected to "Respond" to Treatment

Cites work

• scientific article; zbMATH DE number 45532 (Why is no real title available?)
• scientific article; zbMATH DE number 3567782 (Why is no real title available?)
• scientific article; zbMATH DE number 1203738 (Why is no real title available?)
• scientific article; zbMATH DE number 509167 (Why is no real title available?)
• scientific article; zbMATH DE number 1964693 (Why is no real title available?)
• scientific article; zbMATH DE number 1373656 (Why is no real title available?)
• scientific article; zbMATH DE number 835699 (Why is no real title available?)
• scientific article; zbMATH DE number 3376558 (Why is no real title available?)
• A Bayesian analysis of some nonparametric problems
• A Quality Index Based on Data Depth and Multivariate Rank Tests
• A method for simultaneous variable selection and outlier identification in linear regression
• A new look at the statistical model identification
• An Approach to Multivariate Rank Tests in Multivariate Analysis of Variance
• Bayesian Density Estimation and Inference Using Mixtures
• Bayesian multiscale smoothing in supervised and semi-supervised kernel discriminant analysis
• Clustering and classification based on the L\(_{1}\) data depth
• Estimating the dimension of a model
• Estimating the number of clusters in a data set via the gap statistic
• Finite mixture and Markov switching models.
• Fitting multivariage normal finite mixtures subject to structural equation modeling
• Model Selection and Model Averaging
• Model-Based Gaussian and Non-Gaussian Clustering
• Multivariate nonparametric methods with R. An approach based on spatial signs and ranks.
• Multivariate nonparametric tests
• Multivariate spatial sign and rank methods
• On a Geometric Notion of Quantiles for Multivariate Data
• PLS path modeling
• Pattern classification.
• Silhouettes: a graphical aid to the interpretation and validation of cluster analysis
• The Rahman polynomials and the Lie algebra \(\mathfrak{sl}_{3}(\mathbb{C})\)
• Well-Separated Clusters and Optimal Fuzzy Partitions
• \(M\)-estimation, convexity and quantiles

Cited in

(3)

• Uniformly most powerful tests for simultaneously detecting a treatment effect in the overall population and at least one subpopulation
• An omnibus test for detection of subgroup treatment effects via data partitioning
• Testing overall and subpopulation treatment effects with measurement errors

Describes a project that uses

Uses Software

• Silhouettes
• ElemStatLearn
• clustervalidation

This page was built for publication: Tests for statistical significance of a treatment effect in the presence of hidden sub-populations

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2353370)