Tensors, differential geometry and statistical shading analysis

DOI10.1007/S10851-018-0815-ZzbMATH Open1398.68636arXiv1705.05902OpenAlexW2802323105WikidataQ114226040 ScholiaQ114226040MaRDI QIDQ1799554FDOQ1799554

Benjamin Kunsberg, Steven W. Zucker, Daniel N. Holtmann-Rice

Publication date: 19 October 2018

Published in: Journal of Mathematical Imaging and Vision (Search for Journal in Brave)

Abstract: We develop a linear algebraic framework for the shape-from-shading problem, because tensors arise when scalar (e.g. image) and vector (e.g. surface normal) fields are differentiated multiple times. Using this framework, we first investigate when image derivatives exhibit invariance to changing illumination by calculating the statistics of image derivatives under general distributions on the light source. Second, we apply that framework to develop Taylor-like expansions, and build a boot-strapping algorithm to find the polynomial surface solutions (under any light source) consistent with a given patch to arbitrary order. A generic constraint on the light source restricts these solutions to a 2-D subspace, plus an unknown rotation matrix. It is this unknown matrix that encapsulates the ambiguity in the problem. Finally, we use the framework to computationally validate the hypothesis that image orientations (derivatives) provide increased invariance to illumination by showing (for a Lambertian model) that a shape-from-shading algorithm matching gradients instead of intensities provides more accurate reconstructions when illumination is incorrectly estimated under a flatness prior.

Full work available at URL: https://arxiv.org/abs/1705.05902

Recommendations

• Why Shading Matters along Contours
• How shading constrains surface patches without knowledge of light sources
• Shape from shading as a partially well-constrained problem
• Shape-from-shading using multiple light sources
• scientific article; zbMATH DE number 2062592

zbMATH Keywords

tensordifferential geometryshape-from-shadingstatistical analysis

Mathematics Subject Classification ID

Computer graphics; computational geometry (digital and algorithmic aspects) (68U05) Computing methodologies for image processing (68U10) Surfaces in Euclidean and related spaces (53A05) Differential geometric aspects in vector and tensor analysis (53A45)

Cites Work

• On the limited memory BFGS method for large scale optimization
• Markov Random Field Modeling in Image Analysis
• A Multilinear Singular Value Decomposition
• Manifolds, tensor analysis, and applications.
• Title not available (Why is that?)
• Tensor Geometry
• Title not available (Why is that?)
• Title not available (Why is that?)
• The symplectic structure of the primary visual cortex
• Title not available (Why is that?)
• Title not available (Why is that?)
• Numerical shape from shading and occluding boundaries
• Shape-from-shading: a survey
• Title not available (Why is that?)
• Geometrical Computations Explain Projection Patterns of Long-Range Horizontal Connections in Visual Cortex
• Cauchy-Binet for pseudo-determinants
• Understanding image intensities
• An invitation to 3-D vision. From images to geometric models.
• Shading into texture
• Some remarks on the shape-from-shading problem in computer vision
• A unifying and rigorous shape from shading method adapted to realistic data and applications
• Tensors, differential geometry and statistical shading analysis
• How shading constrains surface patches without knowledge of light sources
• Curvature consistency improves local shading analysis
• Critical Contours: An Invariant Linking Image Flow with Salient Surface Organization

Cited In (2)

• Critical Contours: An Invariant Linking Image Flow with Salient Surface Organization
• Tensors, differential geometry and statistical shading analysis

Uses Software

• L-BFGS

This page was built for publication: Tensors, differential geometry and statistical shading analysis

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1799554)