Optimized sparse matrix operations for reverse mode automatic differentiation

DOI10.1137/24M1711832MaRDI QIDQ6914811zbMATH OpenFDO

Authors Nicolas Nytko, Ali Taghibakhshi, Tareq Uz Zaman, Scott P. MacLachlan, Luke Olson, M. West

Publication date 15 October 2025

Published in SIAM Journal on Scientific Computing (Search for Journal in Brave)

Full work available at URL https://doi.org/10.1137/24M1711832

zbMATH Keywords

automatic differentiationbackpropagationnumerical optimizationscientific machine learningsparse matrix operations

Mathematics Subject Classification ID

Numerical differentiation (65D25) Iterative numerical methods for linear systems (65F10) Computational methods for sparse matrices (65F50) Multigrid methods; domain decomposition for boundary value problems involving PDEs (65N55) Learning and adaptive systems in artificial intelligence (68T05)

Cites work

• A Genetic Search for Optimal Multigrid Components Within a Fourier Analysis Setting
• A local Fourier analysis of additive Vanka relaxation for the Stokes equations
• A Multigrid Tutorial, Second Edition
• A Supernodal Approach to Sparse Partial Pivoting
• Achieving finite element mesh quality via optimization of the Jacobian matrix norm and associated quantities. Part I?a framework for surface mesh optimization
• Best Robin parameters for optimized Schwarz methods at cross points
• Collected matrix derivative results for forward and reverse mode algorithmic differentiation
• Exposing fine-grained parallelism in algebraic multigrid methods
• Factorized Sparse Approximate Inverse Preconditionings I. Theory
• Factorized sparse approximate inverses for preconditioning
• Fine-grained parallel incomplete LU factorization
• Graph theory and sparse matrix computation. Proceedings of a workshop that was an integral part of the 1991-92 IMA program on Applied linear algebra, Minneapolis, MN (USA)
• scientific article; zbMATH DE number 1953444 (Why is no real title available?)
• scientific article; zbMATH DE number 6982909 (Why is no real title available?)
• scientific article; zbMATH DE number 2113718 (Why is no real title available?)
• Learning Optimal Multigrid Smoothers via Neural Networks
• Local Fourier Analysis of p-Multigrid for High-Order Finite Element Operators
• On local Fourier analysis of multigrid methods for PDEs with jumping and random coefficients
• Optimizing sparse matrix-matrix multiplication for the GPU
• Parallel Preconditioning with Sparse Approximate Inverses
• Some methods of speeding up the convergence of iteration methods
• Sparse approximate inverse preconditioners on high performance GPU platforms
• Sparse approximate inverse smoothers for geometric and algebraic multigrid
• The University of Florida sparse matrix collection
• Tuning Multigrid Methods with Robust Optimization and Local Fourier Analysis

This page was built for publication: Optimized sparse matrix operations for reverse mode automatic differentiation

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6914811)