Wide-angle image rectification: a survey

DOI10.1007/S11263-021-01562-9zbMATH Open1491.68249arXiv2011.12108OpenAlexW4210622169MaRDI QIDQ2118430FDOQ2118430

Authors: Yanyan Li 

Publication date: 22 March 2022

Published in: International Journal of Computer Vision (Search for Journal in Brave)

Abstract: Wide field-of-view (FOV) cameras, which capture a larger scene area than narrow FOV cameras, are used in many applications including 3D reconstruction, autonomous driving, and video surveillance. However, wide-angle images contain distortions that violate the assumptions underlying pinhole camera models, resulting in object distortion, difficulties in estimating scene distance, area, and direction, and preventing the use of off-the-shelf deep models trained on undistorted images for downstream computer vision tasks. Image rectification, which aims to correct these distortions, can solve these problems. In this paper, we comprehensively survey progress in wide-angle image rectification from transformation models to rectification methods. Specifically, we first present a detailed description and discussion of the camera models used in different approaches. Then, we summarize several distortion models including radial distortion and projection distortion. Next, we review both traditional geometry-based image rectification methods and deep learning-based methods, where the former formulate distortion parameter estimation as an optimization problem and the latter treat it as a regression problem by leveraging the power of deep neural networks. We evaluate the performance of state-of-the-art methods on public datasets and show that although both kinds of methods can achieve good results, these methods only work well for specific camera models and distortion types. We also provide a strong baseline model and carry out an empirical study of different distortion models on synthetic datasets and real-world wide-angle images. Finally, we discuss several potential research directions that are expected to further advance this area in the future.

Full work available at URL: https://arxiv.org/abs/2011.12108

Recommendations

• Automatical content-adapting stretched distortion correction algorithm for wide-angle images
• Rectangling panoramic images via warping
• Unwrapping and stereo rectification for omnidirectional images
• scientific article; zbMATH DE number 2164728

Mathematics Subject Classification ID

Computing methodologies for image processing (68U10) Machine vision and scene understanding (68T45)

Cites Work

• Title not available (Why is that?)
• Localization with monocular vision for autonomous navigation
• Catadioptric projective geometry
• A Precision Analysis of Camera Distortion Models
• Computer Vision - ECCV 2004
• Automatic line extraction in uncalibrated omnidirectional cameras with revolution symmetry
• Automatic radial distortion estimation from a single image
• Recursive context routing for object detection
• Minimal solvers for rectifying from radially-distorted scales and change of scales
• Invertibility and Estimation of Two-Parameter Polynomial and Division Lens Distortion Models
• Title not available (Why is that?)
• Model-Free Distortion Rectification Framework Bridged by Distortion Distribution Map

Uses Software

• ImageNet
• CycleGAN
• pix2pix
• KITTI
• MS-COCO
• U-Net
• CARLA
• PASCAL VOC
• ADE20k

This page was built for publication: Wide-angle image rectification: a survey

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2118430)