An overview of stochastic quasi-Newton methods for large-scale machine learning (Q6097379): Difference between revisions

@@ Property / cites work @@
+A Stochastic Approximation Method
@@ Property / cites work: A Stochastic Approximation Method / rank @@
+Normal rank
@@ Property / cites work @@
+Momentum and stochastic momentum for stochastic gradient, Newton, proximal point and subspace descent methods
+Normal rank
@@ Property / cites work @@
+On the Influence of Momentum Acceleration on Online Learning
+Normal rank
@@ Property / cites work @@
+An optimal method for stochastic composite optimization
+Normal rank
@@ Property / cites work @@
+Optimal Stochastic Approximation Algorithms for Strongly Convex Stochastic Composite Optimization I: A Generic Algorithmic Framework
+Normal rank
@@ Property / cites work @@
+Optimization Methods for Large-Scale Machine Learning
+Normal rank
@@ Property / cites work @@
+Erratum to: ``Minimizing finite sums with the stochastic average gradient''
+Normal rank
@@ Property / cites work @@
+On the Use of Stochastic Hessian Information in Optimization Methods for Machine Learning
+Normal rank
@@ Property / cites work @@
+Sample size selection in optimization methods for machine learning
+Normal rank
@@ Property / cites work @@
+Sub-sampled Newton methods
@@ Property / cites work: Sub-sampled Newton methods / rank @@
+Normal rank
@@ Property / cites work @@
+Exact and inexact subsampled Newton methods for optimization
+Normal rank
@@ Property / cites work @@
+Newton Sketch: A Near Linear-Time Optimization Algorithm with Linear-Quadratic Convergence
+Normal rank
@@ Property / cites work @@
+An investigation of Newton-Sketch and subsampled Newton methods
+Normal rank
@@ Property / cites work @@
+Methods of conjugate gradients for solving linear systems
+Normal rank
@@ Property / cites work @@
+Q4637040
@@ Property / cites work: Q4637040 / rank @@
+Normal rank
@@ Property / cites work @@
+Q2880947
@@ Property / cites work: Q2880947 / rank @@
+Normal rank
@@ Property / cites work @@
+A Stochastic Quasi-Newton Method for Large-Scale Optimization
+Normal rank
@@ Property / cites work @@
+Fast Curvature Matrix-Vector Products for Second-Order Gradient Descent
+Normal rank
@@ Property / cites work @@
+Q5148924
@@ Property / cites work: Q5148924 / rank @@
+Normal rank
@@ Property / cites work @@
+Newton-type methods for non-convex optimization under inexact Hessian information
+Normal rank
@@ Property / cites work @@
+RES: Regularized Stochastic BFGS Algorithm
@@ Property / cites work: RES: Regularized Stochastic BFGS Algorithm / rank @@
+Normal rank
@@ Property / cites work @@
+Stochastic Quasi-Newton Methods for Nonconvex Stochastic Optimization
+Normal rank
@@ Property / cites work @@
+IQN: An Incremental Quasi-Newton Method with Local Superlinear Convergence Rate
+Normal rank
@@ Property / cites work @@
+A Variable Sample-Size Stochastic Quasi-Newton Method for Smooth and Nonsmooth Stochastic Convex Optimization
+Normal rank
@@ Property / cites work @@
+A Noise-Tolerant Quasi-Newton Algorithm for Unconstrained Optimization
+Normal rank
@@ Property / cites work @@
+A distributed optimisation framework combining natural gradient with Hessian-free for discriminative sequence training
+Normal rank
@@ Property / cites work @@
+A Theoretical and Experimental Study of the Symmetric Rank-One Update
+Normal rank
@@ Property / cites work @@
+Convergence of quasi-Newton matrices generated by the symmetric rank one update
+Normal rank
@@ Property / cites work @@
+Q5491447
@@ Property / cites work: Q5491447 / rank @@
+Normal rank
@@ Property / cites work @@
+A Rapidly Convergent Descent Method for Minimization
+Normal rank
@@ Property / cites work @@
+Variations on Variable-Metric Methods
@@ Property / cites work: Variations on Variable-Metric Methods / rank @@
+Normal rank
@@ Property / cites work @@
+Quasi-Newton Methods and their Application to Function Minimisation
+Normal rank
@@ Property / cites work @@
+A new approach to variable metric algorithms
@@ Property / cites work: A new approach to variable metric algorithms / rank @@
+Normal rank
@@ Property / cites work @@
+A Family of Variable-Metric Methods Derived by Variational Means
+Normal rank
@@ Property / cites work @@
+Conditioning of Quasi-Newton Methods for Function Minimization
+Normal rank
@@ Property / cites work @@
+Adjustment of an Inverse Matrix Corresponding to a Change in One Element of a Given Matrix
+Normal rank
@@ Property / cites work @@
+Updating Quasi-Newton Matrices with Limited Storage
+Normal rank
@@ Property / cites work @@
+On the limited memory BFGS method for large scale optimization
+Normal rank
@@ Property / cites work @@
+Stochastic quasi-Newton with line-search regularisation
+Normal rank
@@ Property / cites work @@
+Global Convergence of Online Limited Memory BFGS
@@ Property / cites work: Global Convergence of Online Limited Memory BFGS / rank @@
+Normal rank
@@ Property / cites work @@
+Semi-stochastic coordinate descent
@@ Property / cites work: Semi-stochastic coordinate descent / rank @@
+Normal rank
@@ Property / cites work @@
+Stochastic L-BFGS: Improved Convergence Rates and Practical Acceleration Strategies
+Normal rank
@@ Property / cites work @@
+Block BFGS Methods
@@ Property / cites work: Block BFGS Methods / rank @@
+Normal rank
@@ Property / cites work @@
+A robust multi-batch L-BFGS method for machine learning
+Normal rank
@@ Property / cites work @@
+Quasi-Newton methods for machine learning: forget the past, just sample
+Normal rank
@@ Property / cites work @@
+Probabilistic Interpretation of Linear Solvers
@@ Property / cites work: Probabilistic Interpretation of Linear Solvers / rank @@
+Normal rank
@@ Property / cites work @@
+Randomized Quasi-Newton Updates Are Linearly Convergent Matrix Inversion Algorithms
+Normal rank
@@ Property / cites work @@
+Sizing and Least-Change Secant Methods
@@ Property / cites work: Sizing and Least-Change Secant Methods / rank @@
+Normal rank
@@ Property / cites work @@
+Probabilistic Line Searches for Stochastic Optimization
+Normal rank
@@ Property / cites work @@
+Adaptive Sampling Strategies for Stochastic Optimization
+Normal rank
@@ Property / cites work @@
+Analysis of the BFGS Method with Errors
@@ Property / cites work: Analysis of the BFGS Method with Errors / rank @@
+Normal rank
@@ Property / cites work @@
+Q2896142
@@ Property / cites work: Q2896142 / rank @@
+Normal rank
@@ Property / cites work @@
+On Stochastic and Deterministic Quasi-Newton Methods for Nonstrongly Convex Optimization: Asymptotic Convergence and Rate Analysis
+Normal rank
@@ Property / cites work @@
+Accelerated gradient methods for nonconvex nonlinear and stochastic programming
+Normal rank
@@ Property / cites work @@
+A Quasi-Newton Approach to Nonsmooth Convex Optimization Problems in Machine Learning
+Normal rank
@@ Property / cites work @@
+First-Order Methods in Optimization
@@ Property / cites work: First-Order Methods in Optimization / rank @@
+Normal rank
@@ Property / cites work @@
+Q4633055
@@ Property / cites work: Q4633055 / rank @@
+Normal rank
@@ Property / cites work @@
+Stochastic proximal quasi-Newton methods for non-convex composite optimization
+Normal rank
@@ Property / cites work @@
+A stochastic extra-step quasi-Newton method for nonsmooth nonconvex optimization
+Normal rank
@@ Property / cites work @@
+On the Global Convergence of the BFGS Method for Nonconvex Unconstrained Optimization Problems
+Normal rank
@@ Property / cites work @@
+Algorithms for nonlinear constraints that use lagrangian functions
+Normal rank
@@ Property / cites work @@
+Adaptive, Limited-Memory BFGS Algorithms for Unconstrained Optimization
+Normal rank
@@ Property / cites work @@
+Limited-memory BFGS with displacement aggregation
@@ Property / cites work: Limited-memory BFGS with displacement aggregation / rank @@
+Normal rank
@@ Property / cites work @@
+Q4783863
@@ Property / cites work: Q4783863 / rank @@
+Normal rank