Deep Convolutional Neural Network for Inverse Problems in Imaging
From MaRDI portal
Publication:4619040
DOI10.1109/TIP.2017.2713099zbMATH Open1409.94275DBLPjournals/tip/JinMFU17arXiv1611.03679OpenAlexW2574952845WikidataQ47792056 ScholiaQ47792056MaRDI QIDQ4619040FDOQ4619040
Authors: Kyong Hwan Jin, Michael T. McCann, Emmanuel Froustey, M. Unser 
Publication date: 5 February 2019
Published in: IEEE Transactions on Image Processing (Search for Journal in Brave)
Abstract: In this paper, we propose a novel deep convolutional neural network (CNN)-based algorithm for solving ill-posed inverse problems. Regularized iterative algorithms have emerged as the standard approach to ill-posed inverse problems in the past few decades. These methods produce excellent results, but can be challenging to deploy in practice due to factors including the high computational cost of the forward and adjoint operators and the difficulty of hyper parameter selection. The starting point of our work is the observation that unrolled iterative methods have the form of a CNN (filtering followed by point-wise non-linearity) when the normal operator (H*H, the adjoint of H times H) of the forward model is a convolution. Based on this observation, we propose using direct inversion followed by a CNN to solve normal-convolutional inverse problems. The direct inversion encapsulates the physical model of the system, but leads to artifacts when the problem is ill-posed; the CNN combines multiresolution decomposition and residual learning in order to learn to remove these artifacts while preserving image structure. We demonstrate the performance of the proposed network in sparse-view reconstruction (down to 50 views) on parallel beam X-ray computed tomography in synthetic phantoms as well as in real experimental sinograms. The proposed network outperforms total variation-regularized iterative reconstruction for the more realistic phantoms and requires less than a second to reconstruct a 512 x 512 image on GPU.
Full work available at URL: https://arxiv.org/abs/1611.03679
Image processing (compression, reconstruction, etc.) in information and communication theory (94A08)
Cited In (98)
- Adversarially learned iterative reconstruction for imaging inverse problems
- Networks for nonlinear diffusion problems in imaging
- Regularization by architecture: a deep prior approach for inverse problems
- Bilevel optimization, deep learning and fractional Laplacian regularization with applications in tomography
- Determination of singular value truncation threshold for regularization in ill-posed problems
- Constrained and unconstrained deep image prior optimization models with automatic regularization
- What Kinds of Functions Do Deep Neural Networks Learn? Insights from Variational Spline Theory
- Mini-workshop: Deep learning and inverse problems. Abstracts from the mini-workshop held March 4--10, 2018
- Deep learning architectures for nonlinear operator functions and nonlinear inverse problems
- Training Very Deep CNNs for General Non-Blind Deconvolution
- Convolutional Neural Networks in Phase Space and Inverse Problems
- Deep convolutional framelets: a general deep learning framework for inverse problems
- A nonlocal image denoising algorithm using the structural similarity metric
- Recent trends and advances in solving the inverse problem for EEG source localization
- Bilevel Methods for Image Reconstruction
- A mathematical framework for deep learning in elastic source imaging
- On the randomised stability constant for inverse problems
- Analytic continuation of noisy data using Adams Bashforth residual neural network
- A Helmholtz equation solver using unsupervised learning: application to transcranial ultrasound
- Deep neural networks for inverse problems with pseudodifferential operators: an application to limited-angle tomography
- Wasserstein-based projections with applications to inverse problems
- Deep Learning--Based Dictionary Learning and Tomographic Image Reconstruction
- Non-invasive inference of thrombus material properties with physics-informed neural networks
- A new overhead crane emergency braking method with theoretical analysis and experimental verification
- Feasibility-based fixed point networks
- Equivariant neural networks for inverse problems
- Shallow neural networks for fluid flow reconstruction with limited sensors
- An introduction to the mathematics of deep learning
- A data and knowledge driven approach for SPECT using convolutional neural networks and iterative algorithms
- Deep learning for photoacoustic tomography from sparse data
- Unsupervised knowledge-transfer for learned image reconstruction
- Deep synthesis network for regularizing inverse problems
- Deep learning on image denoising: an overview
- Electrical impedance tomography with deep Calderón method
- Learning the invisible: a hybrid deep learning-shearlet framework for limited angle computed tomography
- On finite-horizon \(H_\infty\) state estimation for discrete-time delayed memristive neural networks under stochastic communication protocol
- WARPd: a linearly convergent first-order primal-dual algorithm for inverse problems with approximate sharpness conditions
- Computed tomography reconstruction using deep image prior and learned reconstruction methods
- On asymptotic behavior for a class of diffusion equations involving the fractional \(\wp (\cdot)\)-Laplacian as \(\wp (\cdot)\) goes to \(\infty\)
- Title not available (Why is that?)
- Learning to scan: a deep reinforcement learning approach for personalized scanning in CT imaging
- Invertible residual networks in the context of regularization theory for linear inverse problems
- A review on deep learning in medical image reconstruction
- Learnable Douglas-Rachford iteration and its applications in DOT imaging
- A novel physics-informed framework for reconstruction of structural defects
- Data-consistent neural networks for solving nonlinear inverse problems
- Estimating adsorption isotherm parameters in chromatography via a virtual injection promoting double feed-forward neural network
- NETT: solving inverse problems with deep neural networks
- Representation and reconstruction of covariance operators in linear inverse problems
- Numerical solution of inverse problems by weak adversarial networks
- Solving inverse problems using conditional invertible neural networks
- Title not available (Why is that?)
- On learned operator correction in inverse problems
- Deep unfolding of a proximal interior point method for image restoration
- Solving inverse problems using data-driven models
- Solving inverse-PDE problems with physics-aware neural networks
- Inverse problems on low-dimensional manifolds
- Linearized inverse Schrödinger potential problem with partial data and its deep neural network inversion
- A dataset-free deep learning method for low-dose CT image reconstruction
- A tailor-made 3-dimensional directional Haar semi-tight framelet for pMRI reconstruction
- Scaling Up Bayesian Uncertainty Quantification for Inverse Problems Using Deep Neural Networks
- Exploring structural sparsity of coil images from 3-dimensional directional tight framelets for SENSE reconstruction
- NF-ULA: normalizing flow-based unadjusted Langevin algorithm for imaging inverse problems
- Attenuating and enhancing properties of the approximate deconvolution method based on higher-order explicit and compact filters
- A Note on the Regularity of Images Generated by Convolutional Neural Networks
- Strong Solutions for PDE-Based Tomography by Unsupervised Learning
- First arrival traveltime tomography using supervised descent learning technique
- DRIP: deep regularizers for inverse problems
- Measuring Complexity of Learning Schemes Using Hessian-Schatten Total Variation
- Reversible Autoencoder: A CNN-Based Nonlinear Lifting Scheme for Image Reconstruction
- Convergent data-driven regularizations for CT reconstruction
- MiPhDUO: microwave imaging via physics-informed deep unrolled optimization
- Training adaptive reconstruction networks for blind inverse problems
- On Learning the Invisible in Photoacoustic Tomography with Flat Directionally Sensitive Detector
- Learning the sparse prior: modern approaches
- Learned iterative reconstruction
- Learned regularizers for inverse problems
- Regularization of inverse problems by neural networks
- Shearlets: from theory to deep learning
- Provably convergent learned inexact descent algorithm for low-dose CT reconstruction
- Deep learning based source reconstruction method using asymmetric encoder-decoder structure and physics-induced loss
- Neural network approximation of continuous functions in high dimensions with applications to inverse problems
- Sampling type method combined with deep learning for inverse scattering with one incident wave
- Application of machine learning regression models to inverse eigenvalue problems
- Degradation simulator for infinite horizon controlled linear time-invariant systems
- Numerical methods for identifying the diffusion coefficient in a nonlinear elliptic equation
- The mathematics of artificial intelligence
- Normalizing flow regularization for photoacoustic tomography
- Learn an index operator by CNN for solving diffusive optical tomography: a deep direct sampling method
- A blind Poisson-Gaussian noise separation using learning copula densities
- Inverse problems are solvable on real number signal processing hardware
- Neural-network-based regularization methods for inverse problems in imaging
- Data driven regularization by projection
- A point-to-point convolutional neural network for reconstructing electromagnetic parameters of multiple cavities scattering with inhomogeneous anisotropic media
- Learning sparsity-promoting regularizers using bilevel optimization
- Limitations of neural network training due to numerical instability of backpropagation
- Inverse parameter estimation using compressed sensing and POD-RBF reduced order models
- Efficient Training of Convolutional Deep Belief Networks in the Frequency Domain for Application to High-Resolution 2D and 3D Images
This page was built for publication: Deep Convolutional Neural Network for Inverse Problems in Imaging
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4619040)
