Optimization problems for machine learning: a survey
From MaRDI portal
Publication:2029894
Classification and discrimination; cluster analysis (statistical aspects) (62H30) Learning and adaptive systems in artificial intelligence (68T05) Artificial neural networks and deep learning (68T07) Research exposition (monographs, survey articles) pertaining to operations research and mathematical programming (90-02) Computational methods for problems pertaining to operations research and mathematical programming (90-08)
Abstract: This paper surveys the machine learning literature and presents in an optimization framework several commonly used machine learning approaches. Particularly, mathematical optimization models are presented for regression, classification, clustering, deep learning, and adversarial learning, as well as new emerging applications in machine teaching, empirical model learning, and Bayesian network structure learning. Such models can benefit from the advancement of numerical optimization techniques which have already played a distinctive role in several machine learning settings. The strengths and the shortcomings of these models are discussed and potential research directions and open problems are highlighted.
Recommendations
- Machine learning problems from optimization perspective
- scientific article; zbMATH DE number 1786133
- The interplay of optimization and machine learning research
- Machine learning for combinatorial optimization: a methodological tour d'horizon
- Some approaches to the solution of optimization problems in supervised learning
- Optimization models and dualities study in machine learning
- Optimization methods for large-scale machine learning
- Survey of solving the optimization problems for sparse learning
- Special issue optimization for machine learning guest editorial
Cites work
- scientific article; zbMATH DE number 3860199 (Why is no real title available?)
- scientific article; zbMATH DE number 1274356 (Why is no real title available?)
- scientific article; zbMATH DE number 1332320 (Why is no real title available?)
- scientific article; zbMATH DE number 1906319 (Why is no real title available?)
- scientific article; zbMATH DE number 1391397 (Why is no real title available?)
- scientific article; zbMATH DE number 7246283 (Why is no real title available?)
- scientific article; zbMATH DE number 6276119 (Why is no real title available?)
- scientific article; zbMATH DE number 3340881 (Why is no real title available?)
- 10.1162/153244303321897726
- A Limited Memory Algorithm for Bound Constrained Optimization
- A clustering technique for the identification of piecewise affine systems
- A comparative study of the leading machine learning techniques and two new optimization algorithms
- A distance-based point-reassignment heuristic for the \(k\)-hyperplane clustering problem
- A mixed integer linear model for clustering with variable selection
- A mixed-integer programming approach to the clustering problem with an application in customer segmentation
- A model for clustering data from heterogeneous dissimilarities
- A new nonsmooth optimization algorithm for minimum sum-of-squares clustering problems
- A scatter search heuristic for the capacitated clustering problem
- A special ordered set approach for optimizing a discontinuous separable piecewise linear function
- Accelerating the branch-and-price algorithm using machine learning
- An Algorithm for Constructing Optimal Binary Decision Trees
- An algorithm for the mixed-integer nonlinear bilevel programming problem
- An application of special ordered sets to a periodic milk collection problem
- An improved column generation algorithm for minimum sum-of-squares clustering
- An introduction to statistical learning. With applications in R
- Approximation by superpositions of a sigmoidal function
- Auction optimization using regression trees and linear models as integer programs
- BEST SUBSET SELECTION FOR ELIMINATING MULTICOLLINEARITY
- Best subset selection via a modern optimization lens
- Bi-criteria optimization of decision trees with applications to data analysis
- Bilevel programming with discrete lower level problems
- Binarized support vector machines
- Biobjective sparse principal component analysis
- CLOVES: a cluster-and-search heuristic to solve the vehicle routing problem with delivery and pick-up
- Characterization of the equivalence of robustification and regularization in linear and matrix regression
- Classification and Regression via Integer Optimization
- Cluster Analysis: An Application of Lagrangian Relaxation
- Cluster Newton method for sampling multiple solutions of underdetermined inverse problems: application to a parameter identification problem in pharmacokinetics
- Cluster analysis and mathematical programming
- Clustering heuristics for set covering
- Clustering search algorithm for the capacitated centered clustering problem
- Complete large margin linear discriminant analysis using mathematical programming approach
- Constructing optimal binary decision trees is NP-complete
- Continuous location of dimensional structures.
- Deep learning
- Deep neural networks and mixed integer linear optimization
- Discrete optimization methods to fit piecewise affine models to data points
- Efficient structure learning of Bayesian networks using constraints
- Empirical decision model learning
- Evaluating feature selection methods for learning in data mining applications.
- Feature selection for support vector machines using generalized Benders decomposition
- Feature selection for support vector machines via mixed integer linear programming
- Fitting piecewise linear continuous functions
- Gene selection for cancer classification using support vector machines
- Generalized additive models
- Global optimization of nonlinear bilevel programming problems
- Heuristic least-cost computation of discrete classification functions with uncertain argument values
- High dimensional data classification and feature selection using support vector machines
- Improvements to the cluster Newton method for underdetermined inverse problems
- Improving heuristics for network modularity maximization using an exact algorithm
- Integer linear programming for the Bayesian network structure learning problem
- Lagrangian relaxation for SVM feature selection
- Learning MILP resolution outcomes before reaching time-limit
- Learning a classification of mixed-integer quadratic programming problems
- Learning bounded tree-width Bayesian networks via sampling
- Learning decision trees with flexible constraints and objectives using integer optimization
- Learning optimal Bayesian networks: a shortest path perspective
- Learning to classify with missing and corrupted features
- Least angle regression. (With discussion)
- Linear dimensionality reduction: survey, insights, and generalizations
- Locating hyperplanes to fitting set of points: a general framework
- Machine learning meets mathematical optimization to predict the optimal production of offshore wind parks
- Massive data discrimination via linear support vector machines
- Mathematical programming techniques in water network optimization
- Mixed integer quadratic optimization formulations for eliminating multicollinearity based on variance inflation factor
- Mixed integer second-order cone programming formulations for variable selection in linear regression
- Mixed-integer models for nonseparable piecewise-linear optimization: unifying framework and extensions
- Model selection for primal SVM
- Model-based capacitated clustering with posterior regularization
- Modern Multivariate Statistical Techniques
- Multi-stage optimization of decision and inhibitory trees for decision tables with many-valued decisions
- Neural architecture search: a survey
- New approaches to regression by generalized additive models and continuous optimization for modern applications in finance, science and technology
- New diagonal bundle method for clustering problems in large data sets
- Nonlinear integer bilevel programming
- OR forum: An algorithmic approach to linear regression
- On learning and branching: a survey
- On mathematical programming with indicator constraints
- On the complexity of teaching
- Operational research from Taylorism to terabytes: a research agenda for the analytics age
- Operations research and data mining
- Optimal classification trees
- Optimistic MILP modeling of non-linear optimization problems
- Optimization methods for large-scale machine learning
- Optimization problems in statistical learning: duality and optimality conditions
- Permutation-based multivariate regression analysis: The case for least sum of absolute deviations regression
- Prediction of ordinal classes using regression trees
- Reformulation of a model for hierarchical divisive graph modularity maximization
- Regularization and Variable Selection Via the Elastic Net
- Reluplex: an efficient SMT solver for verifying deep neural networks
- Review of nonlinear mixed-integer and disjunctive programming techniques
- Robust ordinal regression in preference learning and ranking
- Scikit-learn: machine learning in Python
- Segmented concave least squares: a nonparametric piecewise linear regression
- Simultaneous classification and feature selection via convex quadratic programming with application to HIV-associated neurocognitive disorder assessment
- Sparse Approximate Solutions to Linear Systems
- Sparse high-dimensional regression: exact scalable algorithms and phase transitions
- Sparse principal component regression with adaptive loading
- Sparsity in optimal randomized classification trees
- Static prediction games for adversarial learning problems
- Supervised classification and mathematical optimization
- Support Vector Ordinal Regression
- Support-vector networks
- Synergies between operations research and data mining: the emerging use of multi-objective approaches
- Teachability in computational learning
- The p-Median Problem for Cluster Analysis: A Comparative Test Using the Mixture Model Approach
- The capacitated centred clustering problem
- The doubly regularized support vector machine
- The elements of statistical learning. Data mining, inference, and prediction
- The interplay of optimization and machine learning research
- The nonlinear bilevel programming problem:formulations,regularity and optimality conditions
- The security of machine learning
- The teaching dimension of linear learners
- Variable neighborhood search for minimum sum-of-squares clustering on networks
- \(rs\)-sparse principal component analysis: a mixed integer nonlinear programming approach with VNS
Cited in
(50)- A branch-and-price procedure for clustering data that are graph connected
- Learning generalized strong branching for set covering, set packing, and 0-1 knapsack problems
- The backbone method for ultra-high dimensional sparse machine learning
- Mathematical optimization in classification and regression trees
- Margin optimal classification trees
- Machine learning problems from optimization perspective
- An integer programming approach for the hyper-rectangular clustering problem with axis-parallel clusters and outliers
- The min-Knapsack problem with compactness constraints and applications in statistics
- Machine learning algorithms of relaxation subgradient method with space extension
- Optimization models and dualities study in machine learning
- Special issue optimization for machine learning guest editorial
- Navigational guidance -- a deep learning approach
- Designing topological data to forecast bankruptcy using convolutional neural networks
- Network flow problem heuristic reduction using machine learning
- Gradient methods for optimizing metaparameters in the knowledge distillation problem
- Machine learning for combinatorial optimization: a methodological tour d'horizon
- On optimizing ensemble models using column generation
- Hierarchical distributed optimization of constraint-coupled convex and mixed-integer programs using approximations of the dual function
- A maximum-margin multisphere approach for binary multiple instance learning
- Blockchain application for the supply chain optimization
- The interplay of optimization and machine learning research
- Optimization for deep learning: an overview
- Lipschitz energy functional for anisotropic diffusion applications
- Sublinear optimization for machine learning
- A model-agnostic and data-independent tabu search algorithm to generate counterfactuals for tabular, image, and text data
- Explainable real-time predictive analytics on employee workload in digital railway control rooms
- Optimization in machine learning: a distribution-space approach
- A review of the role of heuristics in stochastic optimisation: from metaheuristics to learnheuristics
- scientific article; zbMATH DE number 67282 (Why is no real title available?)
- Majorized iPADMM for Nonseparable Convex Minimization Models with Quadratic Coupling Terms
- A survey of deep network techniques all classifiers can adopt
- Optimization of sparsity-constrained neural networks as a mixed integer linear program
- Survey on parallel and distributed optimization algorithms for scalable machine learning
- Tuning parameters of deep neural network training algorithms pays off: a computational study
- On mathematical optimization for clustering categories in contingency tables
- From inexact optimization to learning via gradient concentration
- Tutorial on Amortized Optimization
- Operational research and artificial intelligence methods in banking
- Benchmark and survey of automated machine learning frameworks
- From numerical optimization method to learning optimization method
- A regularised fast recursive algorithm for fraction model identification of nonlinear dynamic systems
- An exact algorithm for semi-supervised minimum sum-of-squares clustering
- scientific article; zbMATH DE number 1786133 (Why is no real title available?)
- On constrained smoothing and out-of-range prediction using \(P\)-splines: a conic optimization approach
- Some approaches to the solution of optimization problems in supervised learning
- How can machine learning and optimization help each other better?
- Semi-supervised \(k\)-means clustering via DC programming approach
- On sparse ensemble methods: an application to short-term predictions of the evolution of COVID-19
- Global optimization: a machine learning approach
- An integrated data envelopment analysis and regression tree method for new product price estimation
Describes a project that uses
Uses Software
This page was built for publication: Optimization problems for machine learning: a survey
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2029894)
