Tests for statistical significance of a treatment effect in the presence of hidden sub-populations

DOI10.1007/S10260-014-0271-XzbMATH Open1441.62149arXiv1211.0032OpenAlexW2029438298MaRDI QIDQ2353370FDOQ2353370

Authors: Yanyan Li 

Publication date: 9 July 2015

Published in: Statistical Methods and Applications (Search for Journal in Brave)

Abstract: For testing the statistical significance of a treatment effect, we usually compare between two parts of a population, one is exposed to the treatment, and the other is not exposed to it. Standard parametric and nonparametric two-sample tests are often used for this comparison. But direct applications of these tests can yield misleading results, especially when the population has some hidden sub-populations, and the impact of this sub-population difference on the study variables dominates the treatment effect. This problem becomes more evident if these subpopulations have widely different proportions of representatives in the samples taken from these two parts, which are often referred to as the treatment group and the control group. In this article, we make an attempt to overcome this problem. Our propose methods use suitable clustering algorithms to find the hidden sub-populations and then eliminate the sub-population effect by using suitable transformations. Standard two-sample tests, when they are applied on the transformed data, yield better results. Some simulated and real data sets are analyzed to show the utility of the proposed methods.

Full work available at URL: https://arxiv.org/abs/1211.0032

Recommendations

• A U-statistic-based test of treatment effect heterogeneity
• Uniformly most powerful tests for simultaneously detecting a treatment effect in the overall population and at least one subpopulation
• A Locally Most Powerful Test for Detecting a Treatment Effect in the Presence of Nonresponders
• A General Framework for Subgroup Detection via One-Step Value Difference Estimation
• Locally Most Powerful Tests for Detecting Treatment Effects When Only a Subset of Patients Can Be Expected to "Respond" to Treatment

zbMATH Keywords

EM algorithmBayesian model averaginggap statisticDunn indexPAM clustering algorithmunivariate and multivariate two-sample tests

Mathematics Subject Classification ID

Bayesian inference (62F15) Classification and discrimination; cluster analysis (statistical aspects) (62H30) Hypothesis testing in multivariate analysis (62H15)

Cites Work

• Silhouettes: a graphical aid to the interpretation and validation of cluster analysis
• Estimating the number of clusters in a data set via the gap statistic
• PLS path modeling
• Estimating the dimension of a model
• Title not available (Why is that?)
• Bayesian Density Estimation and Inference Using Mixtures
• A new look at the statistical model identification
• Finite mixture and Markov switching models.
• Title not available (Why is that?)
• Model-Based Gaussian and Non-Gaussian Clustering
• Title not available (Why is that?)
• \(M\)-estimation, convexity and quantiles
• A Bayesian analysis of some nonparametric problems
• Pattern classification.
• On a Geometric Notion of Quantiles for Multivariate Data
• Title not available (Why is that?)
• Title not available (Why is that?)
• Clustering and classification based on the L\(_{1}\) data depth
• Title not available (Why is that?)
• Model Selection and Model Averaging
• Multivariate spatial sign and rank methods
• A Quality Index Based on Data Depth and Multivariate Rank Tests
• Title not available (Why is that?)
• Well-Separated Clusters and Optimal Fuzzy Partitions
• Multivariate nonparametric tests
• Multivariate nonparametric methods with R. An approach based on spatial signs and ranks.
• Title not available (Why is that?)
• An Approach to Multivariate Rank Tests in Multivariate Analysis of Variance
• The Rahman polynomials and the Lie algebra \(\mathfrak{sl}_{3}(\mathbb{C})\)
• Fitting multivariage normal finite mixtures subject to structural equation modeling
• Bayesian multiscale smoothing in supervised and semi-supervised kernel discriminant analysis
• A method for simultaneous variable selection and outlier identification in linear regression

Cited In (2)

• Testing overall and subpopulation treatment effects with measurement errors
• An omnibus test for detection of subgroup treatment effects via data partitioning

Uses Software

• Silhouettes
• ElemStatLearn
• clustervalidation

This page was built for publication: Tests for statistical significance of a treatment effect in the presence of hidden sub-populations

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2353370)