Fast Bayesian hyperparameter optimization on large datasets

DOI10.1214/17-EJS1335SIMaRDI QIDQ1688974zbMATH OpenFDO

Authors Peng Zhang

Publication date 12 January 2018

Published in Electronic Journal of Statistics (Search for Journal in Brave)

Full work available at URL https://projecteuclid.org/euclid.ejs/1513306864

zbMATH Keywords

hyperparameter optimizationGaussian processacquisition functionentropy search

Mathematics Subject Classification ID

Bayesian inference (62F15) Neural nets and related approaches to inference from stochastic processes (62M45) Computational methods for problems pertaining to operations research and mathematical programming (90-08)

Recommendations

• Hyperband: a novel bandit-based approach to hyperparameter optimization
• scientific article; zbMATH DE number 6276119
• Bayesian optimization in a billion dimensions via random embeddings
• No-regret Bayesian optimization with unknown hyperparameters
• Scalable Gaussian process-based transfer surrogates for hyperparameter optimization

Cited in

(23)

• SMAC3: a versatile Bayesian optimization package for hyperparameter optimization
• Neural architecture search: a survey
• \texttt{CAMERA}: a method for cost-aware, adaptive, multifidelity, efficient reliability analysis
• Hyperband: a novel bandit-based approach to hyperparameter optimization
• A Fast and Scalable Computational Framework for Large-Scale High-Dimensional Bayesian Optimal Experimental Design
• Automatic model training under restrictive time constraints
• scientific article; zbMATH DE number 7306883 (Why is no real title available?)
• Use of static surrogates in hyperparameter optimization
• Output Space Entropy Search Framework for Multi-Objective Bayesian Optimization
• Bayesian optimization in a billion dimensions via random embeddings
• Bilevel Methods for Image Reconstruction
• Bayesian optimization for policy search via online-offline experimentation
• An efficient modified Hyperband and trust-region-based mode-pursuing sampling hybrid method for hyperparameter optimization
• Benchmark and survey of automated machine learning frameworks
• Surrogate optimization of deep neural networks for groundwater predictions
• Automated Reinforcement Learning (AutoRL): A Survey and Open Problems
• Estimating shape parameters of piecewise linear-quadratic problems
• Identifying material parameters in crystal plasticity by Bayesian optimization
• Performance analysis of hyperparameter optimization methods for ensemble learning with small and medium sized medical datasets
• scientific article; zbMATH DE number 7626750 (Why is no real title available?)
• Scalable Gaussian process-based transfer surrogates for hyperparameter optimization
• scientific article; zbMATH DE number 7164723 (Why is no real title available?)
• Reproducible Hyperparameter Optimization

This page was built for publication: Fast Bayesian hyperparameter optimization on large datasets

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1688974)