Iterative methods based on soft thresholding of hierarchical tensors

From MaRDI portal



Abstract: We construct a soft thresholding operation for rank reduction of hierarchical tensors and subsequently consider its use in iterative thresholding methods, in particular for the solution of discretized high-dimensional elliptic problems. The proposed method for the latter case automatically adjusts the thresholding parameters, based only on bounds on the spectrum of the operator, such that the arising tensor ranks of the resulting iterates remain quasi-optimal with respect to the algebraic or exponential-type decay of the hierarchical singular values of the true solution. In addition, we give a modified algorithm using inexactly evaluated residuals that retains these features. The practical efficiency of the scheme is demonstrated in numerical experiments.


The article presents a quasi-optimal alternative procedure to the very successful and largely used low-rank decomposition in order to provide a numerical approximation of high-dimensional problems, such as partial differential equations on high-dimensional domains. The technique is a variation to the truncation of the ranks of a hierarchical singular value decomposition, and it relies on soft thresholding of the singular values. It achieves similar good features in terms of complexity and quasi-optimality properties but it results to be non-expansive. The results apply to a broad class of fixed-point iterations on general contractive mappings even though the article focuses in particular on high-dimensional elliptic problems. The article contains a detailed discussion on the influence of the thresholding parameters on the approximated solution, and it proposes an algorithm to choose them while a test section illustrates, through the classic cases of a high-dimensional Poisson problem and a parametric diffusion problem, the effectiveness of the technique.



Cites work


Cited in
(20)








This page was built for publication: Iterative methods based on soft thresholding of hierarchical tensors

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2407677)