Surrogate optimization of deep neural networks for groundwater predictions
From MaRDI portal
Publication:2046338
Abstract: Sustainable management of groundwater resources under changing climatic conditions require an application of reliable and accurate predictions of groundwater levels. Mechanistic multi-scale, multi-physics simulation models are often too hard to use for this purpose, especially for groundwater managers who do not have access to the complex compute resources and data. Therefore, we analyzed the applicability and performance of four modern deep learning computational models for predictions of groundwater levels. We compare three methods for optimizing the models' hyperparameters, including two surrogate model-based algorithms and a random sampling method. The models were tested using predictions of the groundwater level in Butte County, California, USA, taking into account the temporal variability of streamflow, precipitation, and ambient temperature. Our numerical study shows that the optimization of the hyperparameters can lead to reasonably accurate performance of all models (root mean squared errors of groundwater predictions of 2 meters or less), but the simplest network, namely a multilayer perceptron (MLP) performs overall better for learning and predicting groundwater data than the more advanced long short-term memory or convolutional neural networks in terms of prediction accuracy and time-to-solution, making the MLP a suitable candidate for groundwater prediction.
Recommendations
- Approximating a finite element model by neural network prediction for facility optimization in groundwater engineering
- Groundwater management using a new coupled model of meshless local Petrov-Galerkin method and modified artificial bee colony algorithm
- A deep-learning-based surrogate model for data assimilation in dynamic subsurface flow problems
- Accelerating uncertainty quantification of groundwater flow modelling using a deep neural network proxy
- Machine learning and transport simulations for groundwater anomaly detection
Cites work
- A kriging based method for the solution of mixed-integer nonlinear programs containing black-box functions
- A mesh adaptive direct search algorithm for multiobjective optimization
- A radial basis function method for global optimization
- A Stochastic Approximation Method
- A stochastic radial basis function method for the global optimization of expensive functions
- Accelerated random search for constrained global optimization assisted by radial basis function surrogates
- Algorithm 909: NOMAD: nonlinear optimization with the MADS algorithm
- An adaptive radial basis algorithm (ARBF) for expensive black-box global optimization
- An adaptive radial basis algorithm (ARBF) for expensive black-box mixed-integer constrained global optimization
- An algorithmic framework for the optimization of computationally expensive bi-fidelity black-box problems
- Blackbox and derivative-free optimization: theory, algorithms and applications
- Data-driven identification of parametric partial differential equations
- Derivative-free and blackbox optimization
- Efficient global optimization of expensive black-box functions
- Fast Bayesian hyperparameter optimization on large datasets
- Global convergence of radial basis function trust-region algorithms for derivative-free optimization
- GOSAC: global optimization with surrogate approximation of constraints
- scientific article; zbMATH DE number 5964910 (Why is no real title available?)
- scientific article; zbMATH DE number 124386 (Why is no real title available?)
- scientific article; zbMATH DE number 1131224 (Why is no real title available?)
- scientific article; zbMATH DE number 1361578 (Why is no real title available?)
- scientific article; zbMATH DE number 928746 (Why is no real title available?)
- scientific article; zbMATH DE number 6276119 (Why is no real title available?)
- Large-scale machine learning with stochastic gradient descent
- Learning representations by back-propagating errors
- Mesh Adaptive Direct Search Algorithms for Constrained Optimization
- Mesh adaptive direct search algorithms for mixed variable optimization
- MISO: mixed-integer surrogate optimization framework
- Multi-fidelity optimization via surrogate modelling
- Nonparametric guidance of autoencoder representations using label information
- Reactive transport codes for subsurface environmental simulation
- Response surface methodology. Process and product optimization using designed experiments
- Scikit-learn: machine learning in Python
- SO-I: a surrogate model algorithm for expensive nonlinear integer programming problems including global optimization applications
- SO-MI: a surrogate model algorithm for computationally expensive nonlinear mixed-integer black-box global optimization problems
- SOCEMO: Surrogate Optimization of Computationally Expensive Multiobjective Problems
- Stochastic radial basis function algorithms for large-scale optimization involving expensive black-box objective and constraint functions
- Surrogate Optimization of Computationally Expensive Black-Box Problems with Hidden Constraints
- The mesh adaptive direct search algorithm with treed Gaussian process surrogates
Cited in
(6)- Data-driven spatial branch-and-bound algorithms for box-constrained simulation-based optimization
- Quantifying uncertainty with ensembles of surrogates for blackbox optimization
- Efficient and data-driven prediction of water breakthrough in subsurface systems using deep long short-term memory machine learning
- Approximating a finite element model by neural network prediction for facility optimization in groundwater engineering
- Surrogate-based branch-and-bound algorithms for simulation-based black-box optimization
- Data-driven Lipschitz-informed convex underestimators for branch-and-bound optimization of black-box functions
Describes a project that uses
Uses Software
This page was built for publication: Surrogate optimization of deep neural networks for groundwater predictions
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2046338)
