Model reduction of dynamical systems on nonlinear manifolds using deep convolutional autoencoders

DOI10.1016/j.jcp.2019.108973zbMath1454.65184arXiv1812.08373OpenAlexW2986795381WikidataQ126807875 ScholiaQ126807875MaRDI QIDQ2223001

Kevin T. Carlberg, Kookjin Lee

Publication date: 28 January 2021

Published in: Journal of Computational Physics (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/1812.08373

zbMATH Keywords

model reductionmachine learningdeep learningautoencodersnonlinear manifoldsoptimal projection

Mathematics Subject Classification ID

Artificial neural networks and deep learning (68T07) Approximation methods and numerical treatment of dynamical systems (37M99) Numerical problems in dynamical systems (65P99)

Related Items (only showing first 100 items - show all)

A probabilistic generative model for semi-supervised training of coarse-grained surrogates and enforcing physical constraints through virtual observables ⋮ On the stability of projection-based model order reduction for convection-dominated laminar and turbulent flows ⋮ A long short-term memory embedding for hybrid uplifted reduced order models ⋮ Non intrusive reduced order modeling of parametrized PDEs by kernel POD and neural networks ⋮ Manifold Approximations via Transported Subspaces: Model Reduction for Transport-Dominated Problems ⋮ Symplectic Model Reduction of Hamiltonian Systems on Nonlinear Manifolds and Approximation with Weakly Symplectic Autoencoder ⋮ Reduced basis methods for time-dependent problems ⋮ Fourier Collocation and Reduced Basis Methods for Fast Modeling of Compressible Flows ⋮ A comprehensive deep learning-based approach to reduced order modeling of nonlinear time-dependent parametrized PDEs ⋮ Physics-informed machine learning for reduced-order modeling of nonlinear problems ⋮ Meta-mgnet: meta multigrid networks for solving parameterized partial differential equations ⋮ Model reduction for multi-scale transport problems using model-form preserving least-squares projections with variable transformation ⋮ A fast and accurate physics-informed neural network reduced order model with shallow masked autoencoder ⋮ Machine learning moment closure models for the radiative transfer equation. I: Directly learning a gradient based closure ⋮ Fast $L^2$ Optimal Mass Transport via Reduced Basis Methods for the Monge--Ampère Equation ⋮ Registration-based model reduction of parameterized two-dimensional conservation laws ⋮ Projection-tree reduced-order modeling for fast \(N\)-body computations ⋮ The neural network shifted-proper orthogonal decomposition: a machine learning approach for non-linear reduction of hyperbolic equations ⋮ A comparison of neural network architectures for data-driven reduced-order modeling ⋮ Physics-informed cluster analysis and a priori efficiency criterion for the construction of local reduced-order bases ⋮ A deep learning approach to Reduced Order Modelling of parameter dependent partial differential equations ⋮ Rank-adaptive structure-preserving model order reduction of Hamiltonian systems ⋮ A non-intrusive neural network model order reduction algorithm for parameterized parabolic PDEs ⋮ Proper orthogonal decomposition and physical field reconstruction with artificial neural networks (ANN) for supercritical flow problems ⋮ Modern Koopman Theory for Dynamical Systems ⋮ Inadequacy of linear methods for minimal sensor placement and feature selection in nonlinear systems: a new approach using secants ⋮ Model order reduction for compressible flows solved using the discontinuous Galerkin methods ⋮ Optimizing Oblique Projections for Nonlinear Systems using Trajectories ⋮ A FOM/ROM hybrid approach for accelerating numerical simulations ⋮ A pruning algorithm preserving modeling capabilities for polycrystalline data ⋮ Synthetic nonlinear second-order oscillators on Riemannian manifolds and their numerical simulation ⋮ Piecewise-Global Nonlinear Model Order Reduction for PDE-Constrained Optimization in High-Dimensional Parameter Spaces ⋮ A reduced order modeling method based on GNAT-embedded hybrid snapshot simulation ⋮ Quadratic approximation manifold for mitigating the Kolmogorov barrier in nonlinear projection-based model order reduction ⋮ Time-series machine-learning error models for approximate solutions to parameterized dynamical systems ⋮ Deep Neural Network Surrogates for Nonsmooth Quantities of Interest in Shape Uncertainty Quantification ⋮ LaSDI: parametric latent space dynamics identification ⋮ Minimally-invasive parametric model-order reduction for sweep-based radiation transport ⋮ DRIPS: a framework for dimension reduction and interpolation in parameter space ⋮ A two-stage deep learning architecture for model reduction of parametric time-dependent problems ⋮ Neural-network-augmented projection-based model order reduction for mitigating the Kolmogorov barrier to reducibility ⋮ Model Reduction for Nonlinear Systems by Balanced Truncation of State and Gradient Covariance ⋮ Nonlinear reduced-order modeling for three-dimensional turbulent flow by large-scale machine learning ⋮ A non‐linear non‐intrusive reduced order model of fluid flow by auto‐encoder and self‐attention deep learning methods ⋮ Canonical and noncanonical Hamiltonian operator inference ⋮ Hybrid analysis and modeling, eclecticism, and multifidelity computing toward digital twin revolution ⋮ Kolmogorov n-width and Lagrangian physics-informed neural networks: a causality-conforming manifold for convection-dominated PDEs ⋮ Multi-fidelity surrogate modeling using long short-term memory networks ⋮ A neural network‐enhanced reproducing kernel particle method for modeling strain localization ⋮ Deep learning‐based reduced order models for the real‐time simulation of the nonlinear dynamics of microstructures ⋮ Preconditioned least‐squares Petrov–Galerkin reduced order models ⋮ Optimization problems for PDEs in weak space-time form. Abstracts from the workshop held March 5--10, 2023 ⋮ Bayesian operator inference for data-driven reduced-order modeling ⋮ Operator inference for non-intrusive model reduction with quadratic manifolds ⋮ A Registration Method for Model Order Reduction: Data Compression and Geometry Reduction ⋮ Parametric dynamic mode decomposition for reduced order modeling ⋮ Adaptive sparse interpolation for accelerating nonlinear stochastic reduced-order modeling with time-dependent bases ⋮ Model reduction for the material point method via an implicit neural representation of the deformation map ⋮ Leveraging reduced-order models for state estimation using deep learning ⋮ Reduced order modeling for parametrized generalized Newtonian fluid flows ⋮ Model order reduction of positive real systems based on mixed Gramian balanced truncation with error bounds ⋮ On the structure of time-delay embedding in linear models of non-linear dynamical systems ⋮ Machine learning for fast and reliable solution of time-dependent differential equations ⋮ Domain-decomposition least-squares Petrov-Galerkin (DD-LSPG) nonlinear model reduction ⋮ Model Order Reduction of Combustion Processes with Complex Front Dynamics ⋮ Data-driven reduced bond graph for nonlinear multiphysics dynamic systems ⋮ Windowed space-time least-squares Petrov-Galerkin model order reduction for nonlinear dynamical systems ⋮ Data-driven closure of projection-based reduced order models for unsteady compressible flows ⋮ Data-driven model order reduction for problems with parameter-dependent jump-discontinuities ⋮ Data-driven nonintrusive reduced order modeling for dynamical systems with moving boundaries using Gaussian process regression ⋮ Deep learning of thermodynamics-aware reduced-order models from data ⋮ Numerical solution of the parametric diffusion equation by deep neural networks ⋮ Model reduction and neural networks for parametric PDEs ⋮ Registration-based model reduction in complex two-dimensional geometries ⋮ The Random Feature Model for Input-Output Maps between Banach Spaces ⋮ POD-DL-ROM: enhancing deep learning-based reduced order models for nonlinear parametrized PDEs by proper orthogonal decomposition ⋮ Reduced order models for Lagrangian hydrodynamics ⋮ Adaptive POD-Galerkin technique for reservoir simulation and optimization ⋮ Projection-based model reduction of dynamical systems using space-time subspace and machine learning ⋮ Multi-fidelity regression using artificial neural networks: efficient approximation of parameter-dependent output quantities ⋮ Deep learning of conjugate mappings ⋮ Modeling synchronization in globally coupled oscillatory systems using model order reduction ⋮ Projection-based model reduction with dynamically transformed modes ⋮ Optimization-Based Modal Decomposition for Systems with Multiple Transports ⋮ Mapping of coherent structures in parameterized flows by learning optimal transportation with Gaussian models ⋮ A learning-based projection method for model order reduction of transport problems ⋮ A Tailored Convolutional Neural Network for Nonlinear Manifold Learning of Computational Physics Data Using Unstructured Spatial Discretizations ⋮ Space-time registration-based model reduction of parameterized one-dimensional hyperbolic PDEs ⋮ Modal decomposition of flow data via gradient-based transport optimization ⋮ Adaptive machine learning-based surrogate modeling to accelerate PDE-constrained optimization in enhanced oil recovery ⋮ Multilevel Fine-Tuning: Closing Generalization Gaps in Approximation of Solution Maps under a Limited Budget for Training Data ⋮ Local Lagrangian reduced-order modeling for the Rayleigh-Taylor instability by solution manifold decomposition ⋮ On the role of nonlinear correlations in reduced-order modelling ⋮ Deep-HyROMnet: a deep learning-based operator approximation for hyper-reduction of nonlinear parametrized PDEs ⋮ Model reduction of convection-dominated partial differential equations via optimization-based implicit feature tracking ⋮ From snapshots to manifolds – a tale of shear flows ⋮ Reinforcement-learning-based actuator selection method for active flow control ⋮ Latent-space time evolution of non-intrusive reduced-order models using Gaussian process emulation ⋮ A theoretical analysis of deep neural networks and parametric PDEs ⋮ Mesh-informed neural networks for operator learning in finite element spaces

Uses Software

• darch
• TensorFlow
• AdaGrad
• RMSprop
• Adam
• t-SNE

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Approximated Lax pairs for the reduced order integration of nonlinear evolution equations
• Nonlinear reduced basis approximation of parameterized evolution equations via the method of freezing
• The GNAT method for nonlinear model reduction: effective implementation and application to computational fluid dynamics and turbulent flows
• Self-organized formation of topologically correct feature maps
• Practical quasi-Newton methods for solving nonlinear systems
• Galerkin v. least-squares Petrov-Galerkin projection in nonlinear model reduction
• Decreasing the temporal complexity for nonlinear, implicit reduced-order models by forecasting
• Model order reduction for parametrized nonlinear hyperbolic problems as an application to uncertainty quantification
• Neural network modeling for near wall turbulent flow.
• Conservative model reduction for finite-volume models
• Efficient non-linear model reduction via a least-squares Petrov-Galerkin projection and compressive tensor approximations
• A low-cost, goal-oriented ‘compact proper orthogonal decomposition’ basis for model reduction of static systems
• Adaptive Reduced Basis Methods for Nonlinear Convection–Diffusion Equations
• Online Adaptive Model Reduction for Nonlinear Systems via Low-Rank Updates
• Nonlinear model order reduction based on local reduced-order bases
• Progressive construction of a parametric reduced‐order model for PDE‐constrained optimization
• Adaptiveh-refinement for reduced-order models
• Kolmogorov widths and low-rank approximations of parametric elliptic PDEs
• Convergence Rates for Greedy Algorithms in Reduced Basis Methods
• Reducing the Dimensionality of Data with Neural Networks
• Interpolatory Projection Methods for Parameterized Model Reduction
• $\mathcal{H}_2$ Model Reduction for Large-Scale Linear Dynamical Systems
• Principal component analysis in linear systems: Controllability, observability, and model reduction
• Turbulence, Coherent Structures, Dynamical Systems and Symmetry
• A subspace approach to balanced truncation for model reduction of nonlinear control systems
• The Shifted Proper Orthogonal Decomposition: A Mode Decomposition for Multiple Transport Phenomena
• Optimization Methods for Large-Scale Machine Learning
• Laplacian Eigenmaps for Dimensionality Reduction and Data Representation
• Model Order Reduction for Problems with Large Convection Effects
• Reduced basis techniques for nonlinear conservation laws
• MODEL REDUCTION FOR FLUIDS, USING BALANCED PROPER ORTHOGONAL DECOMPOSITION
• Interpolation of Functions with Parameter Dependent Jumps by Transformed Snapshots
• Learning representations by back-propagating errors
• Linearly Recurrent Autoencoder Networks for Learning Dynamics
• Turbulence, Coherent Structures, Dynamical Systems and Symmetry
• Hessian eigenmaps: Locally linear embedding techniques for high-dimensional data
• Coupling of substructures for dynamic analyses.

This page was built for publication: Model reduction of dynamical systems on nonlinear manifolds using deep convolutional autoencoders