scientific article; zbMATH DE number 1456803
algorithmic differentiationalgorithmsautomatic differentiationcombinatorial optimizationcomputation of gradientsexamplesexercisesforward modeHessian matrixJacobian matrixmatrix compressionmonographreverse modesoftwaresparse matricesstructured matrices
Research exposition (monographs, survey articles) pertaining to numerical analysis (65-02) Numerical differentiation (65D25) Computational methods for sparse matrices (65F50) Research exposition (monographs, survey articles) pertaining to computer science (68-02) Symbolic computation and algebraic computation (68W30)
Frequently, numerical values for a composite function are calculated by a program. Algorithmic, or automatic differentiation (AD) is concerned with the efficient and accurate evaluation of derivatives for such function. The resulting derivatives can be used in numerous algorithms for nonlinear problems. The new book is written by a specialist in AD and presents a comprehensive treatment of AD. Earlier textbooks on AD [cf. \textit{L. Rall}, Automatic differentiation: Techniques and applications (1981; Zbl 0473.68025) and \textit{H. Kagiwada}, \textit{R. Kalaba}, \textit{N. Rasakhoo} and \textit{K. Spingarn}, Numerical derivatives and nonlinear analysis (1986; Zbl 0665.65017)], cover only the forward mode of AD. The book under review describes all chain-rule based techniques for evaluating derivatives of composite functions with emphasis on the reverse mode. The computation of gradients is always cheap, while the cost of evaluating Jacobian and Hessian matrices depends on the problem structure and its efficient exploitation. Attempts to minimize operations count and memory requirement lead to hard combinatorial optimization problems. This book is divided into three parts.\newline Part I (with Chapters 2-5) presents an introduction to the fundamentals of AD and its software. In general, Jacobian and Hessian matrices cannot be obtained cheaply. \newline Part II (with Chapters 6-9) examines the typical situation, where Jacobians and Hessians are sparse or structured, such that they can be computed cheaply by matrix compression.\newline Part III (with Chapters 10 - 12) contains more advanced material (very large problems, higher derivatives, generalized gradients, differentiation of codes with nondifferentiabilities) which will be of interest mostly to researchers. Each chapter concludes with many examples and exercises suitable also for students with a basic knowledge of calculus, procedural programming, and numerical linear algebra. This well written book will be very useful for graduate students, mathematicians and engineers, who are interested in efficient algorithms for nonlinear problems.
- Some methods of automatic analysis and controllable transformation of programs
- Forward and adjoint sensitivity analysis with continuous explicit Runge-Kutta schemes
- Numerical probabilistic approach to sensitivity analysis in a fatigue delamination problem of a two-layer composite
- Automatic approximation of the marginal likelihood in non-Gaussian hierarchical models
- Global convergence of quasi-Newton methods based on adjoint Broyden updates
- Enclosing all zeros of an analytic function - a rigorous approach
- On the implementation of automatic differentiation tools
- Using exact Jacobians in an implicit Newton-Krylov method
- Upwind finite volume solution of sensitivity equations for hyperbolic systems of conservation laws with discontinuous solutions
- DAG reversal is NP-complete
- A finite algorithm for the exact evaluation of higher order partial derivatives of functions of many variables
- More accuracy at fixed precision.
- Computation of state and input trajectories for flat systems using automatic differentiation.
- Automatic differentiation of algorithms
- Analytical and numerical inversion of the Laplace-Carson transform by a differential method
- Automatic finite element formulation and assembly of hyperelastic higher order structural models
- An aerodynamic design optimization framework using a discrete adjoint approach with OpenFOAM
- Invertibility properties of singular integral operators associated with the Lamé and Stokes systems on infinite sectors in two dimensions
- Taylor meshless method for solving non-linear partial differential equations
- Lifted collocation integrators for direct optimal control in ACADO toolkit
- Gradient subspace approximation: a direct search method for memetic computing
- Modified Cholesky Riemann manifold Hamiltonian Monte Carlo: exploiting sparsity for fast sampling of high-dimensional targets
- Gradient/Hessian-enhanced least square support vector regression
- Mastering uncertainty in industry. II: A survey of physical and numerical statistical modelling methods
- A technique for the calculation of evaporation from the soil surface based on moisture profiles
- Performance of the Taylor series method for ODEs/DAEs
- A polyhedral branch-and-cut approach to global optimization
- Evaluation of functions, gradients, and Jacobians
- FastDer++, efficient automatic differentiation for non-linear PDE solvers
- Robust optimal onboard reentry guidance of a space shuttle: Dynamic game approach and guidance synthesis via neural networks
- A formalism for the differentiation of conservation laws
- Direct gear tooth contact analysis for hypoid bevel gears
- One-shot airfoil optimisation without adjoint
- Applied optimal shape design
- Improved validated bounds for Taylor coefficients and for Taylor remainder series
- Taylor series based finite difference approximations of higher-degree derivatives
- Fitting general stochastic volatility models using Laplace accelerated sequential importance sampling
- Effective sub-simulation-free upper bounds for the Monte Carlo pricing of callable derivatives and various improvements to existing methodologies
- Gradient-based methods for uncertainty quantification in hypersonic flows
- Using automatic differentiation to compute periodic orbits of delay differential equations
- Using invariant manifolds to capture an asteroid near the \(L_3\) point of the Earth-Moon bicircular model
- A computationally inexpensive algorithm for determining outer and inner enclosures of nonlinear mappings of ellipsoidal domains
- Active-subspace analysis of exceedance probability for shallow-water waves
- Algorithmic differentiation of hyperbolic flow problems
- \texttt{acados} -- a modular open-source framework for fast embedded optimal control
- Direct optimal control for time-delay systems via a lifted multiple shooting algorithm
- An efficient adjoint computational method based on lifted IRK integrator and exact penalty function for optimal control problems involving continuous inequality constraints
- Automatic differentiation using operator overloading (ADOO) for implicit resolution of hyperbolic single phase and two-phase flow models
- A one-dimensional full-range two-phase model to efficiently compute bifurcation diagrams in sub-cooled boiling flows in vertical heated tube
- Efficient solution techniques for two-phase flow in heterogeneous porous media using exact Jacobians
- Learning viscoelasticity models from indirect data using deep neural networks
- Fitting psychometric models with methods based on automatic differentiation
- Adjoint code generator
- OSiL: An instance language for optimization
- A sequential computational approach to optimal control problems for differential-algebraic systems based on efficient implicit Runge-Kutta integration
- A near-stationary subspace for ridge approximation
- Topology optimization of turbulent flows
- Structural analysis based dummy derivative selection for differential algebraic equations
- Goal-oriented uncertainty propagation using stochastic adjoints
- On the handling of turbulence equations in RANS adjoint solvers
- Practical global oceanic state estimation
- A general framework for convexity analysis in deterministic global optimization
- A note on the convergence of parametrised non-resonant invariant manifolds
- Parallel fluid flow control and optimisation with lattice Boltzmann methods and automatic differentiation
- An improved inexact Newton method
- Shape optimization in ship hydrodynamics using computational fluid dynamics
- Optimal Jacobian accumulation is NP-complete
- Graph coloring in the estimation of sparse derivative matrices: Instances and applications
- Transition to turbulence, small disturbances, and sensitivity analysis. I: A motivating problem
- Adjoint-based optimization of PDEs in moving domains
- Computation of multiple Lie derivatives by algorithmic differentiation
- Polynomial cost for solving IVP for high-index DAE
- Sensitivity tools vs. Poincaré sections
- General explicit difference formulas for numerical differentiation
- An approximation technique for robust nonlinear optimization
- Newton's method with deflation for isolated singularities of polynomial systems
- There is no efficient reverse derivation mode for discrete derivatives
- Solving differential-algebraic equations by Taylor series. I: Computing Taylor coefficients
- Applications of one-shot methods in PDEs constrained shape optimization
- Sensitivity analysis based multi-scale methods of coupled path-dependent problems
- Numerical integration of high-order variational equations of ODEs
- A curvilinear search algorithm for unconstrained optimization by automatic differentiation
- Automatic differentiation of algorithms. From simulation to optimization. Selected papers from the 3rd international conference, Nice, France, June 2000. Incl. 1 CD-ROM
- Adaptive step size selection for Hessian-based manifold Langevin samplers
- Algorithmic differentiation of numerical methods: tangent and adjoint solvers for parameterized systems of nonlinear equations
- Perspectives on automatic differentiation: fast, present, and future?
- Parameter identification and observer-based control for distributed heating systems - the basis for temperature control of solid oxide fuel cell stacks
- Term graphs for computing derivatives in imperative languages
- AD Model Builder: using automatic differentiation for statistical inference of highly parameterized complex nonlinear models
- Coloring Jacobians revisited: a new algorithm for star and acyclic bicoloring
- Automatic differentiation of quadrature
- On evaluating higher-order derivatives of the QR decomposition of tall matrices with full column rank in forward and reverse mode algorithmic differentiation
- Verified analysis of a biomechanics-related system
- Hierarchical algorithmic differentiation: a case study
- Computing derivatives in a meshless simulation using permutations in ADOL-C
- Approximate Bayesian inference for latent Gaussian models by using integrated nested Laplace approximations (with discussion)
- The Directed Search Method for Pareto Front Approximations with Maximum Dominated Hypervolume
- Coupling of polynomial approximations with application to a boundary meshless method
- Design of a nonlinear observer using automatic differentiation
- Discrete mechanics and optimal control: An analysis
This page was built for publication:
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4954403)
