LED-based photometric stereo: modeling, calibration and numerical solution

DOI10.1007/S10851-017-0761-1zbMATH Open1437.94025arXiv1707.01018OpenAlexW2726198058MaRDI QIDQ1799474FDOQ1799474

Authors: Yvain Quéau, Bastien Durix, Tao Wu, Daniel Cremers, François Lauze, Jean-Denis Durou 

Publication date: 19 October 2018

Published in: Journal of Mathematical Imaging and Vision (Search for Journal in Brave)

Abstract: We conduct a thorough study of photometric stereo under nearby point light source illumination, from modeling to numerical solution, through calibration. In the classical formulation of photometric stereo, the luminous fluxes are assumed to be directional, which is very difficult to achieve in practice. Rather, we use light-emitting diodes (LEDs) to illuminate the scene to reconstruct. Such point light sources are very convenient to use, yet they yield a more complex photometric stereo model which is arduous to solve. We first derive in a physically sound manner this model, and show how to calibrate its parameters. Then, we discuss two state-of-the-art numerical solutions. The first one alternatingly estimates the albedo and the normals, and then integrates the normals into a depth map. It is shown empirically to be independent from the initialization, but convergence of this sequential approach is not established. The second one directly recovers the depth, by formulating photometric stereo as a system of PDEs which are partially linearized using image ratios. Although the sequential approach is avoided, initialization matters a lot and convergence is not established either. Therefore, we introduce a provably convergent alternating reweighted least-squares scheme for solving the original system of PDEs, without resorting to image ratios for linearization. Finally, we extend this study to the case of RGB images.

Full work available at URL: https://arxiv.org/abs/1707.01018

Recommendations

• Near field photometric stereo with point light sources
• Solving uncalibrated photometric stereo using fewer images by jointly optimizing low-rank matrix completion and integrability
• A direct differential approach to photometric stereo with perspective viewing
• A single-lobe photometric stereo approach for heterogeneous material
• A \(L^1\)-TV algorithm for robust perspective photometric stereo with spatially-varying lightings

zbMATH Keywords

variational methodsphotometric stereopoint light sources3D-reconstructionalternating reweighted least-squares

Mathematics Subject Classification ID

Image processing (compression, reconstruction, etc.) in information and communication theory (94A08) Numerical aspects of computer graphics, image analysis, and computational geometry (65D18)

Cites Work

• Distributed optimization and statistical learning via the alternating direction method of multipliers
• A dual algorithm for the solution of nonlinear variational problems via finite element approximation
• Title not available (Why is that?)
• Title not available (Why is that?)
• Iteratively Reweighted Least Squares: Algorithms, Convergence Analysis, and Numerical Comparisons
• Title not available (Why is that?)
• A closed-form, consistent and robust solution to uncalibrated photometric stereo via local diffuse reflectance maxima
• Approximate Gauss–Newton Methods for Nonlinear Least Squares Problems
• On the ratio of two correlated normal random variables
• Scale space and variational methods in computer vision. 6th international conference, SSVM 2017, Kolding, Denmark, June 4--8, 2017. Proceedings
• Normal integration: a survey
• A single-lobe photometric stereo approach for heterogeneous material
• Indoor Scene Reconstruction Using Near-Light Photometric Stereo
• Near field photometric stereo with point light sources

Cited In (7)

• Nonlinearities and noise reduction in 3-source photometric stereo
• Solving uncalibrated photometric stereo using fewer images by jointly optimizing low-rank matrix completion and integrability
• Design issues for a colour photometric stereo system
• Light structure from pin motion: geometric point light source calibration
• Optimisation of classic photometric stereo by non-convex variational minimisation
• Near field photometric stereo with point light sources
• Variational reflectance estimation from multi-view images

This page was built for publication: LED-based photometric stereo: modeling, calibration and numerical solution

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1799474)