Deep convolutional framelets: a general deep learning framework for inverse problems
From MaRDI portal
Publication:4689753
DOI10.1137/17M1141771zbMATH Open1401.94024arXiv1707.00372OpenAlexW2777802649WikidataQ129923441 ScholiaQ129923441MaRDI QIDQ4689753FDOQ4689753
Authors: Jong Chul Ye, Yoseob Han, Eunju Cha 
Publication date: 17 October 2018
Published in: SIAM Journal on Imaging Sciences (Search for Journal in Brave)
Abstract: Recently, deep learning approaches with various network architectures have achieved significant performance improvement over existing iterative reconstruction methods in various imaging problems. However, it is still unclear why these deep learning architectures work for specific inverse problems. To address these issues, here we show that the long-searched-for missing link is the convolution framelets for representing a signal by convolving local and non-local bases. The convolution framelets was originally developed to generalize the theory of low-rank Hankel matrix approaches for inverse problems, and this paper further extends the idea so that we can obtain a deep neural network using multilayer convolution framelets with perfect reconstruction (PR) under rectilinear linear unit nonlinearity (ReLU). Our analysis also shows that the popular deep network components such as residual block, redundant filter channels, and concatenated ReLU (CReLU) do indeed help to achieve the PR, while the pooling and unpooling layers should be augmented with high-pass branches to meet the PR condition. Moreover, by changing the number of filter channels and bias, we can control the shrinkage behaviors of the neural network. This discovery leads us to propose a novel theory for deep convolutional framelets neural network. Using numerical experiments with various inverse problems, we demonstrated that our deep convolution framelets network shows consistent improvement over existing deep architectures.This discovery suggests that the success of deep learning is not from a magical power of a black-box, but rather comes from the power of a novel signal representation using non-local basis combined with data-driven local basis, which is indeed a natural extension of classical signal processing theory.
Full work available at URL: https://arxiv.org/abs/1707.00372
Recommendations
- Deep synthesis network for regularizing inverse problems
- Deep learning for trivial inverse problems
- Deep null space learning for inverse problems: convergence analysis and rates
- NETT: solving inverse problems with deep neural networks
- Solving ill-posed inverse problems using iterative deep neural networks
deep learninginverse problemsframeletsconvolutional neural networkReLUperfect reconstruction condition
Learning and adaptive systems in artificial intelligence (68T05) Nontrigonometric harmonic analysis involving wavelets and other special systems (42C40) Signal theory (characterization, reconstruction, filtering, etc.) (94A12) Numerical methods for wavelets (65T60) Biomedical imaging and signal processing (92C55) Image processing (compression, reconstruction, etc.) in information and communication theory (94A08) Radon transform (44A12)
Cites Work
- Convex analysis and monotone operator theory in Hilbert spaces
- Ten Lectures on Wavelets
- Title not available (Why is that?)
- Hankel matrix rank minimization with applications to system identification and realization
- Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information
- Convolutional neural networks analyzed via convolutional sparse coding
- A Review of Image Denoising Algorithms, with a New One
- Compressed sensing
- Framelets: MRA-based constructions of wavelet frames
- Split Bregman methods and frame based image restoration
- 10.1162/153244303321897690
- Image restoration: total variation, wavelet frames, and beyond
- A framelet-based image inpainting algorithm
- Matrix pencil method for estimating parameters of exponentially damped/undamped sinusoids in noise
- Convergence analysis of tight framelet approach for missing data recovery
- Neural Network Learning
- Group invariant scattering
- Sampling signals with finite rate of innovation
- Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising
- Annihilating Filter-Based Low-Rank Hankel Matrix Approach for Image Inpainting
- Deep Convolutional Neural Network for Inverse Problems in Imaging
- A tale of two bases: local-nonlocal regularization on image patches with convolution framelets
- Compressive Sampling Using Annihilating Filter-Based Low-Rank Interpolation
- Sparse and Low-Rank Decomposition of a Hankel Structured Matrix for Impulse Noise Removal
- A Mathematical Theory of Deep Convolutional Neural Networks for Feature Extraction
- Off-the-grid recovery of piecewise constant images from few Fourier samples
Cited In (22)
- Deep unrolling networks with recurrent momentum acceleration for nonlinear inverse problems
- Fluid sensing using microcantilevers: from physics-based modeling to deep learning
- Big in Japan: regularizing networks for solving inverse problems
- Networks for nonlinear diffusion problems in imaging
- Wide-band butterfly network: stable and efficient inversion via multi-frequency neural networks
- Estimating a Potential Without the Agony of the Partition Function
- Solving the wide-band inverse scattering problem via equivariant neural networks
- Bilevel Methods for Image Reconstruction
- A mathematical framework for deep learning in elastic source imaging
- Universal approximation with quadratic deep networks
- Shallow neural networks for fluid flow reconstruction with limited sensors
- A finite element based deep learning solver for parametric PDEs
- Deep learning on image denoising: an overview
- Image fusion network for dual-modal restoration
- Wavelets in the deep learning era
- Directional mean curvature for textured image demixing
- Vision graph U-Net: geometric learning enhanced encoder for medical image segmentation and restoration
- A review on deep learning in medical image reconstruction
- Solving inverse problems using data-driven models
- Accelerating Proximal Markov Chain Monte Carlo by Using an Explicit Stabilized Method
- Efficient Training of Convolutional Deep Belief Networks in the Frequency Domain for Application to High-Resolution 2D and 3D Images
- A dataset-free deep learning method for low-dose CT image reconstruction
Uses Software
This page was built for publication: Deep convolutional framelets: a general deep learning framework for inverse problems
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4689753)
