Tensors, differential geometry and statistical shading analysis

DOI10.1007/S10851-018-0815-ZMaRDI QIDQ1799554zbMATH OpenOpenAlexWikidataFDO

Authors Daniel N. Holtmann-Rice, Benjamin Kunsberg, Steven W. Zucker

Publication date 19 October 2018

Published in Journal of Mathematical Imaging and Vision (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/1705.05902

zbMATH Keywords

tensordifferential geometryshape-from-shadingstatistical analysis

Mathematics Subject Classification ID

Computer graphics; computational geometry (digital and algorithmic aspects) (68U05) Computing methodologies for image processing (68U10) Surfaces in Euclidean and related spaces (53A05) Differential geometric aspects in vector and tensor analysis (53A45)

Abstract: We develop a linear algebraic framework for the shape-from-shading problem, because tensors arise when scalar (e.g. image) and vector (e.g. surface normal) fields are differentiated multiple times. Using this framework, we first investigate when image derivatives exhibit invariance to changing illumination by calculating the statistics of image derivatives under general distributions on the light source. Second, we apply that framework to develop Taylor-like expansions, and build a boot-strapping algorithm to find the polynomial surface solutions (under any light source) consistent with a given patch to arbitrary order. A generic constraint on the light source restricts these solutions to a 2-D subspace, plus an unknown rotation matrix. It is this unknown matrix that encapsulates the ambiguity in the problem. Finally, we use the framework to computationally validate the hypothesis that image orientations (derivatives) provide increased invariance to illumination by showing (for a Lambertian model) that a shape-from-shading algorithm matching gradients instead of intensities provides more accurate reconstructions when illumination is incorrectly estimated under a flatness prior.

Recommendations

• Why Shading Matters along Contours
• How shading constrains surface patches without knowledge of light sources
• Shape from shading as a partially well-constrained problem
• Shape-from-shading using multiple light sources
• scientific article; zbMATH DE number 2062592

Cites work

• scientific article; zbMATH DE number 5968745 (Why is no real title available?)
• scientific article; zbMATH DE number 3511136 (Why is no real title available?)
• scientific article; zbMATH DE number 3521121 (Why is no real title available?)
• scientific article; zbMATH DE number 3599182 (Why is no real title available?)
• scientific article; zbMATH DE number 3347169 (Why is no real title available?)
• A Multilinear Singular Value Decomposition
• A unifying and rigorous shape from shading method adapted to realistic data and applications
• An invitation to 3-D vision. From images to geometric models.
• Cauchy-Binet for pseudo-determinants
• Critical contours: an invariant linking image flow with salient surface organization
• Curvature consistency improves local shading analysis
• Elementary differential geometry.
• Geometrical Computations Explain Projection Patterns of Long-Range Horizontal Connections in Visual Cortex
• How shading constrains surface patches without knowledge of light sources
• Manifolds, tensor analysis, and applications.
• Markov Random Field Modeling in Image Analysis
• Numerical shape from shading and occluding boundaries
• On the limited memory BFGS method for large scale optimization
• Shading into texture
• Shape-from-shading: a survey
• Some remarks on the shape-from-shading problem in computer vision
• Tensor Geometry
• Tensors, differential geometry and statistical shading analysis
• The symplectic structure of the primary visual cortex
• Understanding image intensities

Cited in

(3)

• Gradient skewness tensors and local illumination detection for images
• Tensors, differential geometry and statistical shading analysis
• Critical contours: an invariant linking image flow with salient surface organization

Describes a project that uses

Uses Software

• L-BFGS

This page was built for publication: Tensors, differential geometry and statistical shading analysis

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1799554)