An efficient stochastic Newton algorithm for parameter estimation in logistic regressions
From MaRDI portal
Abstract: Logistic regression is a well-known statistical model which is commonly used in the situation where the output is a binary random variable. It has a wide range of applications including machine learning, public health, social sciences, ecology and econometry. In order to estimate the unknown parameters of logistic regression with data streams arriving sequentially and at high speed, we focus our attention on a recursive stochastic algorithm. More precisely, we investigate the asymptotic behavior of a new stochastic Newton algorithm. It enables to easily update the estimates when the data arrive sequentially and to have research steps in all directions. We establish the almost sure convergence of our stochastic Newton algorithm as well as its asymptotic normality. All our theoretical results are illustrated by numerical experiments.
Recommendations
- Quadratic lower-bound algorithm for maximum likelihood estimator of logistic regression on parameter and its application
- A stochastic estimation algorithm with observation averaging
- Stochastic approximation and Newton's estimate of a mixing distribution
- Inversion-free subsampling Newton's method for large sample logistic regression
- Logistic regression with random coefficients
Cites work
- Lp and almost sure rates of convergence of averaged stochastic gradient algorithms: locally strongly convex objective
- A Stochastic Approximation Method
- A stochastic quasi-Newton method for large-scale optimization
- Acceleration of Stochastic Approximation by Averaging
- Adaptivity of averaged stochastic gradient descent to local strong convexity for logistic regression
- Applied logistic regression
- Asymptotic Almost Sure Efficiency of Averaged Stochastic Algorithms
- scientific article; zbMATH DE number 976356 (Why is no real title available?)
- scientific article; zbMATH DE number 1972910 (Why is no real title available?)
- Online estimation of the asymptotic variance for averaged stochastic gradient algorithms
- Optimal non-asymptotic analysis of the Ruppert-Polyak averaging stochastic algorithm
- Optimal survey schemes for stochastic gradient descent with applications to \(M\)-estimation
- RES: Regularized Stochastic BFGS Algorithm
- System identification with quantized observations
Cited in
(19)- Multinomial logistic regression algorithm
- Inversion-free subsampling Newton's method for large sample logistic regression
- A two step algorithm for solving a large scale semi-definite logit model
- On the asymptotic rate of convergence of stochastic Newton algorithms and their weighted averaged versions
- An Algorithm for Exact Logistic Regression
- scientific article; zbMATH DE number 7626738 (Why is no real title available?)
- scientific article; zbMATH DE number 5260684 (Why is no real title available?)
- Recursive ridge regression using second-order stochastic algorithms
- Online stochastic Newton methods for estimating the geometric median and applications
- Deterministic subsampling for logistic regression with massive data
- On the inversion-free Newton's method and its applications
- An efficient averaged stochastic Gauss-Newton algorithm for estimating parameters of nonlinear regressions models
- A simplified Newton stochastic approximation algorithm estimating the hazard function of censored data
- Asymptotically efficient adaptive identification under saturated output observations
- Natural Gradient Variational Bayes Without Fisher Matrix Analytic Calculation and Its Inversion
- On adaptive stochastic optimization for streaming data: a Newton's method with \( \mathcal{O}(dN)\) operations
- Statistical inference of constrained stochastic optimization via sketched sequential quadratic programming
- Online covariance matrix estimation in sketched Newton methods
- Complexity reduction in online stochastic Newton methods with potential \(\mathcal{O}(Nd)\) total cost
This page was built for publication: An efficient stochastic Newton algorithm for parameter estimation in logistic regressions
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5212017)
