Approximation bounds for convolutional neural networks in operator learning
From MaRDI portal
Abstract: Recently, deep Convolutional Neural Networks (CNNs) have proven to be successful when employed in areas such as reduced order modeling of parametrized PDEs. Despite their accuracy and efficiency, the approaches available in the literature still lack a rigorous justification on their mathematical foundations. Motivated by this fact, in this paper we derive rigorous error bounds for the approximation of nonlinear operators by means of CNN models. More precisely, we address the case in which an operator maps a finite dimensional input onto a functional output , and a neural network model is used to approximate a discretized version of the input-to-output map. The resulting error estimates provide a clear interpretation of the hyperparameters defining the neural network architecture. All the proofs are constructive, and they ultimately reveal a deep connection between CNNs and the Fourier transform. Finally, we complement the derived error bounds by numerical experiments that illustrate their application.
Cites work
- A comprehensive deep learning-based approach to reduced order modeling of nonlinear time-dependent parametrized PDEs
- A deep learning approach to Reduced Order Modelling of parameter dependent partial differential equations
- A Generalization of Hermite's Interpolation Formula
- Approximation by superpositions of a sigmoidal function
- Enhancing Accuracy of Deep Learning Algorithms by Training with Low-Discrepancy Sequences
- Equivalence of approximation by convolutional neural networks and fully-connected networks
- Error estimates for DeepONets: a deep learning framework in infinite dimensions
- High-order approximation rates for shallow neural networks with cosine and \(\mathrm{ReLU}^k\) activation functions
- scientific article; zbMATH DE number 7626805 (Why is no real title available?)
- scientific article; zbMATH DE number 3271087 (Why is no real title available?)
- Model reduction of dynamical systems on nonlinear manifolds using deep convolutional autoencoders
- Numerical approximation of parametrized problems in cardiac electrophysiology by a local reduced basis method
- POD-DL-ROM: enhancing deep learning-based reduced order models for nonlinear parametrized PDEs by proper orthogonal decomposition
- Reduced basis methods for partial differential equations. An introduction
- Universality of deep convolutional neural networks
Cited in
(14)- Improved architectures and training algorithms for deep operator networks
- On Lipschitz Bounds of General Convolutional Neural Networks
- Operator learning using random features: a tool for scientific computing
- On the latent dimension of deep autoencoders for reduced order modeling of PDEs parametrized by random fields
- Application of deep learning reduced-order modeling for single-phase flow in faulted porous media
- Learning the solution operator of two-dimensional incompressible Navier-Stokes equations using physics-aware convolutional neural networks
- Dual-branch neural operator for enhanced out-of-distribution generalization
- Deep learning enhanced cost-aware multi-fidelity uncertainty quantification of a computational model for radiotherapy
- A practical existence theorem for reduced order models based on convolutional autoencoders
- Fully discrete analysis of the Galerkin POD neural network approximation with application to 3D acoustic wave scattering
- Deep orthogonal decomposition: a continuously adaptive neural network approach to model order reduction of parametrized partial differential equations
- Enhancing Fourier neural operators with local spatial features
- Latent dynamics graph convolutional networks for model order reduction of parameterized time-dependent PDEs
- Application of adjoint operators to neural learning
This page was built for publication: Approximation bounds for convolutional neural networks in operator learning
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6403941)
