Performance analysis of stochastic gradient algorithms under weak conditions

DOI10.1007/S11432-008-0117-YMaRDI QIDQ948509zbMATH OpenOpenAlexFDO

Authors Feng Ding, Fei Liu, Huizhong Yang

Publication date 16 October 2008

Published in Science in China. Series F (Search for Journal in Brave)

Full work available at URL https://doi.org/10.1007/s11432-008-0117-y

zbMATH Keywords

parameter estimationleast squaresstochastic gradientmultivariable systemsrecursive identificationconvergence propertiesmartingale convergence theorem

Mathematics Subject Classification ID

Estimation and detection in stochastic control theory (93E10) Identification in stochastic control theory (93E12)

Recommendations

• scientific article; zbMATH DE number 1322672
• Convergence analysis of gradient descent stochastic algorithms
• Analysis of stochastic gradient algorithms for linear regression problems
• Strong error analysis for stochastic gradient descent optimization algorithms
• Uniform-in-time weak error analysis for stochastic gradient descent algorithms via diffusion approximation
• Analysis of stochastic gradient descent in continuous time
• New Convergence Aspects of Stochastic Gradient Algorithms
• Convergence analysis of smoothed stochastic gradient-type algorithm
• scientific article; zbMATH DE number 1341059

Cites work

• scientific article; zbMATH DE number 4066707 (Why is no real title available?)
• Adaptive Digital Control of Hammerstein Nonlinear Systems with Limited Output Sampling
• Adaptive prediction by least squares predictors in stochastic regression models with applications to time series
• Auxiliary model-based least-squares identification methods for Hammerstein output-error systems
• Combined parameter and output estimation of dual-rate systems using an auxiliary model
• Consistency of the least-squares identification method
• Extended least squares and their applications to adaptive control and prediction in linear systems
• Hierarchical least squares identification methods for multivariable systems
• Identification and stochastic adaptive control
• Identification of Hammerstein nonlinear ARMAX systems
• Least squares based self‐tuning control of dual‐rate systems
• Least squares estimates in stochastic regression models with applications to identification and control of dynamic systems
• On the convergence of least squares estimates in white noise
• Parameter estimation of dual-rate stochastic systems by using an output error method
• Performance analysis of least mean square algorithm for time-varying systems
• Performance analysis of multi-innovation gradient type identification methods
• Performance bounds of forgetting factor least-squares algorithms for time-varying systems with finite measurement data
• Recursive Identification and Adaptive Prediction in Linear Stochastic Systems
• Stochastic adaptive prediction and model reference control
• The convergence of AML

Cited in

(61)

• Multi-innovation gradient identification methods for bilinear output-error systems
• Auxiliary model-based maximum likelihood multi-innovation forgetting gradient identification for a class of multivariable systems
• scientific article; zbMATH DE number 4012471 (Why is no real title available?)
• Hierarchical Newton iterative identification methods for a class of input multi-piecewise Hammerstein models with autoregressive noise
• Two-stage least squares based iterative identification algorithm for controlled autoregressive moving average (CARMA) systems
• The residual-based ESG algorithm and its performance analysis
• Gradient-based parameter estimation for input nonlinear systems with ARMA noises based on the auxiliary model
• Iterative identification algorithm for Wiener nonlinear systems using the Newton method
• Hierarchical least squares identification for the multivariate input nonlinear controlled autoregressive moving average systems
• Hierarchical least squares based iterative estimation algorithm for multivariable Box-Jenkins-like systems using the auxiliary model
• Distributed identification based partially-coupled recursive generalized extended least squares algorithm for multivariate input-output-error systems with colored noises from observation data
• Highly efficient three-stage maximum likelihood recursive least squares identification method for multiple-input multiple-output systems
• Separable synchronous gradient-based iterative algorithms for the nonlinear ExpARX system
• Online identification of Hammerstein systems with B-spline networks
• Hierarchical least squares algorithms for single-input multiple-output systems based on the auxiliary model
• Gradient based iterative solutions for general linear matrix equations
• Multi-innovation stochastic gradient algorithm for multiple-input single-output systems using the auxiliary model
• Convergence of stochastic gradient estimation algorithm for multivariable ARX-like systems
• An iterative least squares estimation algorithm for controlled moving average systems based on matrix decomposition
• Performance analysis of the AM-SG parameter estimation for multivariable systems
• Data filtering-based maximum likelihood gradient-based iterative algorithm for input nonlinear Box-Jenkins systems with saturation nonlinearity
• Least squares parameter estimation and multi-innovation least squares methods for linear fitting problems from noisy data
• Two-stage recursive least squares parameter estimation algorithm for output error models
• Maximum likelihood interval-varying recursive least squares identification for output-error autoregressive systems with scarce measurements
• Weighted multi-innovation parameter estimation for a time-varying Volterra-Hammerstein system with colored noise
• The residual based interactive least squares algorithms and simulation studies
• Two-stage least squares based iterative estimation algorithm for CARARMA system modeling
• Auxiliary model-based maximum likelihood multi-innovation recursive least squares identification for multiple-input multiple-output systems
• Identification methods for two-variable difference systems
• The residual based interactive stochastic gradient algorithms for controlled moving average models
• Time series AR modeling with missing observations based on the polynomial transformation
• Filtering-based gradient joint identification algorithms for nonlinear fractional-order models with colored noises
• Consistency of the extended gradient identification algorithm for multi-input multi-output systems with moving average noises
• Hierarchical maximum likelihood multi-innovation identification methods for a class of multivariable Hammerstein-input-nonlinear systems
• Gradient-based iterative identification for MISO Wiener nonlinear systems: application to a glutamate fermentation process
• Parameter identification of systems with preload nonlinearities based on the finite impulse response model and negative gradient search
• Two-stage auxiliary model maximum likelihood least squares-based iterative estimation method for general stochastic multivariable systems
• Separable synthesis gradient estimation methods and convergence analysis for multivariable systems
• Hierarchical least squares parameter estimation for the multiple-input nonlinear systems by using the data filtering
• Robust partially coupled parameter estimation approach for the nonlinear exponential autoregressive model with non-Gaussian noise based on the Cauchy kernel correntropy
• Parameter and order estimation algorithms and convergence analysis for lithium‐ion batteries
• Recursive least-squares estimation for Hammerstein nonlinear systems with nonuniform sampling
• Auxiliary model maximum likelihood gradient-based iterative identification for feedback nonlinear systems
• Gradient based iterative parameter identification for Wiener nonlinear systems
• Recursive identification of time-varying systems: self-tuning and matrix RLS algorithms
• Two identification methods for dual-rate sampled-data nonlinear output-error systems
• The data filtering based generalized stochastic gradient parameter estimation algorithms for multivariate output-error autoregressive systems using the auxiliary model
• Auxiliary model based multi-innovation algorithms for multivariable nonlinear systems
• Multi-innovation extended stochastic gradient algorithm and its performance analysis
• An adaptive stochastic gradient method with variance reduction for smooth optimization problems
• Joint state and parameter estimation for the fractional-order Wiener state space system based on the Kalman filtering
• Multi-stage auxiliary model based recursive least squares estimation for pseudo-linear system with ARMA noise
• Auxiliary model maximum likelihood moving-data-window generalized extended gradient-based iterative algorithm for multivariable autoregressive output-error autoregressive moving-average systems
• Analysis of stochastic gradient algorithms for linear regression problems
• Modified stochastic gradient identification algorithms with fast convergence rates
• Correntropy-based robust interval-varying recursive estimation method for nonlinear systems with spline networks and outliers
• On-line parameter estimation for a class of time-varying continuous systems with bounded disturbances
• Sliding window iterative identification for nonlinear closed-loop systems based on the maximum likelihood principle
• Distributed online multi‐task sparse identification for multiple systems with asynchronous updates
• Iterative estimation methods for Hammerstein controlled autoregressive moving average systems based on the key-term separation principle
• The innovation algorithms for multivariable state-space models

This page was built for publication: Performance analysis of stochastic gradient algorithms under weak conditions

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q948509)