Overcoming the limitations of phase transition by higher order analysis of regularization techniques (Q1991696)

From MaRDI portal
scientific article
Language Label Description Also known as
English
Overcoming the limitations of phase transition by higher order analysis of regularization techniques
scientific article

    Statements

    Overcoming the limitations of phase transition by higher order analysis of regularization techniques (English)
    0 references
    0 references
    0 references
    0 references
    30 October 2018
    0 references
    This paper establishes asymptotic properties of the \(l_q\)-regularized least squares estimators, for different values of \(q\). It focuses on the high dimensional setting with sparsity. A small error framework is built to develop the study. It demonstrates, by exploring the case of \(q\) in the interval \((1,2]\), the inadequacy of the phase-transition approach and then extends the analysis by considering second-order components of the asymptotic risk. Methods for improving the approximations when first and second-order are inaccurate are proposed. Results of simulations performed to numerically evaluate the estimators in the reality of samples of finite size are presented.
    0 references
    bridge regression
    0 references
    phase transition
    0 references
    comparison of estimators
    0 references
    small error regime
    0 references
    second-order term
    0 references
    asymptotic mean square error
    0 references
    optimal tuning
    0 references
    0 references
    0 references

    Identifiers