Spatiotemporal super-resolution reconstruction based on robust optical flow and Zernike moment for video sequences

MaRDI QIDQ474057zbMATH OpenFDO

Authors Meiyu Liang, Junping Du, Honggang Liu

Publication date 24 November 2014

Published in Mathematical Problems in Engineering (Search for Journal in Brave)

Mathematics Subject Classification ID

Pattern recognition, speech recognition (68T10) Problem solving in the context of artificial intelligence (heuristics, search strategies, etc.) (68T20) Computer graphics; computational geometry (digital and algorithmic aspects) (68U05)

Review text

Summary: In order to improve the spatiotemporal resolution of the video sequences, a novel spatiotemporal super-resolution reconstruction model (STSR) based on robust optical flow and Zernike moment is proposed in this paper, which integrates the spatial resolution reconstruction and temporal resolution reconstruction into a unified framework. The model does not rely on accurate estimation of subpixel motion and is robust to noise and rotation. Moreover, it can effectively overcome the problems of hole and block artifacts. First we propose an efficient robust optical flow motion estimation model based on motion details preserving, then we introduce the biweighted fusion strategy to implement the spatiotemporal motion compensation. Next, combining the self-adaptive region correlation judgment strategy, we construct a fast fuzzy registration scheme based on Zernike moment for better STSR with higher efficiency, and then the final video sequences with high spatiotemporal resolution can be obtained by fusion of the complementary and redundant information with nonlocal self-similarity between the adjacent video frames. Experimental results demonstrate that the proposed method outperforms the existing methods in terms of both subjective visual and objective quantitative evaluations.

Recommendations

• Video super-resolution reconstruction based on spatio-temporal non-local similarity
• Learning-based video superresolution reconstruction using spatiotemporal nonlocal similarity
• Sparse Representation-Based Multiple Frame Video Super-Resolution

Cited in

(5)

• A state-space super-resolution approach for video reconstruction
• Video superresolution via parameter-optimized particle swarm optimization
• scientific article; zbMATH DE number 2045501 (Why is no real title available?)
• Video super-resolution reconstruction based on spatio-temporal non-local similarity
• Finite dimensional dynamical sampling: an overview

This page was built for publication: Spatiotemporal super-resolution reconstruction based on robust optical flow and Zernike moment for video sequences

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q474057)