A Step-Up Multiple Test Procedure
\(t\) statisticscomparisonwise approachexperimentwise approachfamilywise error ratejoint \(p\)-valuesleast squares estimatorsmultiple comparisons procedurespower comparisonsprobability of rejecting all false hypothesesprobability of rejecting at least one false hypothesissingle-step procedurestep-down test proceduresstep-up multiple test procedure
We consider the problem of simultaneously testing \(k\geq 2\) hypotheses on parameters \(\theta_ 1,\dots,\theta_ k\). In a typical application the \(\theta\)'s may be a set of contrasts, for instance, a set of orthogonal contrasts among population means or a set of differences between \(k\) treatment means and a standard treatment mean. It is assumed that least squares estimators \(\hat\theta_ 1,\dots,\hat\theta_ k\) are available that are jointly normally distributed with a common variance (known up to a scalar, namely the error variance \(\sigma^ 2\)) and a common known correlation. An independent \(\chi^ 2\)-distributed unbiased estimator of \(\sigma^ 2\) is also assumed to be available. We propose a step-up multiple test procedure for this problem which tests the \(t\) statistics for the \(k\) hypotheses in order starting with the least significant one and continues as long as an acceptance occurs. Critical constants required by this step-up procedure to control the type I familywise error rate at or below a specified level \(\alpha\) are computed for both one-sided and two-sided testing problems. Power comparisons are made for one-sided testing problems with the well-known normal theory based single-step and step-down test procedures, and also with a step-up test procedure proposed for a wider class of problems by \textit{Y. Hochberg} [Biometrika 75, No. 4, 800-802 (1988; Zbl 0661.62067)]. Two different definitions of power are considered --- the probability of rejecting all false hypotheses and the probability of rejecting at least one false hypothesis; the results are found to be qualitatively similar. The proposed step-up procedure is more powerful than the single-step procedure except when only one hypothesis is false, in which case it is slightly less powerful.
- STEPWISE TESTS WHEN THE TEST STATISTICS ARE INDEPENDENT
- A general approach to stepup multiple test procedures for free-combinations families.
- A generalized step-up-down multiple test procedure
- A more powerful step-up procedure for controlling the false discovery rate under independence
- Simple Stepwise Tests of Hypotheses and Multiple Comparisons
- Step-up and step-down procedures controlling the number and proportion of false positives
- On the evaluation of the joint distribution of order statistics
- Marcus-Talpaz simultaneous lower confidence bounds for contrasts between treatment and control means
- Asymptotic comparison of the critical values of step-down and step-up multiple comparison procedures
- On the limit behaviour of the joint distribution function of order statistics
- On some single-stage, step-down and step-up procedures for comparing three normal means
- Multiple testing and simultaneous confidence intervals: calculation of constants
- A note on the monotonicity of the critical values of a step-up test
- Calculation of critical values for Dunnett and Tamhane's step-up multiple test procedure.
- A modified Benjamini-Hochberg multiple comparisons procedure for controlling the false discovery rate
- A more powerful step-up procedure for controlling the false discovery rate under independence
- Asymptotic comparison of step-down and step-up multiple test procedures based on exchangeable test statistics
- Some remarks on repeated significance tests for linear contrasts.
- A general approach to stepup multiple test procedures for free-combinations families.
- Stepwise multiple test procedures with biometric applications
- Exact unconditional distributions for dichotomous data in many-to-one comparisons.
- Critical values for multiple testing and comparisons: one step and step down procedures.
- Resampling-based false discovery rate controlling multiple test procedures for correlated test statistics.
- Solution to Dalal and Mallows conjecture on monotone property of the joint distribution of order statistics.
- Monotonicity properties of multiple endpoint testing procedures
- Extensions of multiple testing procedures based on Simes' test
- Duality between multiple testing and selecting
- Optimal design for \(p\)-value consistent step-up procedures for multiple comparisons with a control in direction-mixed families
- Basic concepts of multiple tests -- a survey
- Stepwise normal theory multiple test procedures controlling the false discovery rate
- Identification of the minimum non-inferior dose in a three-arm non-inferiority trial
- Exact simultaneous confidence intervals for a finite set of contrasts of three, four or five generally correlated normal means
- A smooth version of the step-up procedure for multiple tests of hypotheses
- Generalizing Simes' test and Hochberg's stepup procedure
- A two-step rejection procedure for testing multiple hypotheses
- Modified Simes' critical values under positive dependence
- Simultaneous confidence intervals for comparing several exponential location parameters with a control
- On optimality of stepdown and stepup multiple test procedures
- A class of improved hybrid Hochberg-Hommel type step-up multiple test procedures
- Directional multivariate tests rejecting null and negative effects in all variables
- A step-down test based on the likelihood ratio for multiple comparisons with a control
- Simple Stepwise Tests of Hypotheses and Multiple Comparisons
- Multiple Testing to Establish Superiority/Equivalence of a New Treatment Compared with k Standard Treatments for Unbalanced Designs
- An approach to confirmatory testing of subpopulations in clinical trials
- Computing percentage points of the largest among Student's t random variables
- Step-Up Procedure for Multiple Comparison with a Control for Multivariate Normal Means
- Step-up tests for comparing several exponential populations with control: location case
- The most-cited statistical papers
- Hochberg's Step-Up Method: Cutting Corners Off Holm's Step-Down Method
- scientific article; zbMATH DE number 3949560 (Why is no real title available?)
- Multiple testing in a set of nested hypotheses
- P-value adjustment for multiple binary endpoints
- A generalized step-up-down multiple test procedure
- A Permutational Step-Up Method of Testing Multiple Outcomes
- Subset selection of the best treatment via many-one tests
- scientific article; zbMATH DE number 1089166 (Why is no real title available?)
- Weighted multiplicity adjustments for animal carcinogenicity tests
- On power and sample size computation for multiple testing procedures
- AN APPROACH TO PERFORMING MULTIPLE COMPARISONS WITH A CONTROL IN GEE MODELS
- Some aspects of simultaneous inference
- General theory of mixture procedures for gatekeeping
- scientific article; zbMATH DE number 7387184 (Why is no real title available?)
- Comparing Three Groups
- Constrained Bayesian Rules for Testing Statistical Hypotheses
- Multiple comparison procedures for finding non-maximum normal means
- Multiple hypothesis testing for Poisson processes with variable change–point intensity
- Comparing several normal variances with a control using sample quasi range
- Note on closed testing procedure and sequentially rejective step down procedure
- Stepwise multiple comparison procedures for normal variances
- Evaluations of FWER-controlling methods in multiple hypothesis testing
- Multiple comparisons with a control for exponential location parameters under heteroscedasticity
- Multiple Testing of General Contrasts
- On two results in multiple testing
- Stepwise Multiple Testing as Formalized Data Snooping
- Percentage Points of the Multivariate t Distribution
- Two‐Stage Designs for Dose‐Finding Trials with a Biologic Endpoint Using Stepwise Tests
- On the Assessment of the Performance of Multiple Test Procedures
- A modified Dunnett and Tamhane step-up approach for establishing superiority/equivalence of a new treatment compared with k standard treatments
- Sample size determination in step-down and step-up multiple tests for comparing treatments with a control
- Optimally weighted, fixed sequence and gatekeeper multiple testing procedures
- A unified framework for weighted parametric group sequential design
- Bayesian multiple mean comparisons between two normal populations
- Adaptive seamless designs with interim treatment selection: a case study in oncology
- Closed MCP-Mod for pairwise comparisons of several doses with a control
- Step-up testing procedure for multiple comparisons with a control for a latent variable model with ordered categorical responses
- Traditional multiplicity adjustment methods in clinical trials
- Type-II generalized family-wise error rate formulas with application to sample size determination
- Key multiplicity issues in clinical drug development
- Testing each hypothesis marginally at alpha while still controlling FWER: how and when
- Objective Bayesian multiple testing for k normal populations
- More on the inadmissibility of step-up
- One-sided multiple comparisons for treatment means with a control mean
- The use of an identity in Anderson for multivariate multiple testing
- Stepwise multiple tests for successive comparisons of treatment effects
- Multiple testing procedures for analyzing stratified comparative clinical trials using odds ratios
- On hypothesis testing with a partitioned random alternative
This page was built for publication: A Step-Up Multiple Test Procedure
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4031137)