Time-causal and time-recursive spatio-temporal receptive fields

DOI10.1007/S10851-015-0613-9MaRDI QIDQ275337zbMATH OpenOpenAlexDBLPWikidataFDO

Authors Tony Lindeberg

Publication date 25 April 2016

Published in Journal of Mathematical Imaging and Vision (Search for Journal in Brave)

Copyright license Creative Commons Attribution 4.0 International

Full work available at URL https://arxiv.org/abs/1504.02648

zbMATH Keywords

scale invariancebiological visioncomputational modellingcomputer visiondifferential invariantfeature detectionnatural image transformationsreceptive fieldscale spacescale-normalized derivativespatio-temporal

Mathematics Subject Classification ID

Image processing (compression, reconstruction, etc.) in information and communication theory (94A08) Machine vision and scene understanding (68T45)

Abstract: We present an improved model and theory for time-causal and time-recursive spatio-temporal receptive fields, based on a combination of Gaussian receptive fields over the spatial domain and first-order integrators or equivalently truncated exponential filters coupled in cascade over the temporal domain. Compared to previous spatio-temporal scale-space formulations in terms of non-enhancement of local extrema or scale invariance, these receptive fields are based on different scale-space axiomatics over time by ensuring non-creation of new local extrema or zero-crossings with increasing temporal scale. Specifically, extensions are presented about (i) parameterizing the intermediate temporal scale levels, (ii) analysing the resulting temporal dynamics, (iii) transferring the theory to a discrete implementation, (iv) computing scale-normalized spatio-temporal derivative expressions for spatio-temporal feature detection and (v) computational modelling of receptive fields in the lateral geniculate nucleus (LGN) and the primary visual cortex (V1) in biological vision. We show that by distributing the intermediate temporal scale levels according to a logarithmic distribution, we obtain much faster temporal response properties (shorter temporal delays) compared to a uniform distribution. Specifically, these kernels converge very rapidly to a limit kernel possessing true self-similar scale-invariant properties over temporal scales, thereby allowing for true scale invariance over variations in the temporal scale, although the underlying temporal scale-space representation is based on a discretized temporal scale parameter. We show how scale-normalized temporal derivatives can be defined for these time-causal scale-space kernels and how the composed theory can be used for computing basic types of scale-normalized spatio-temporal derivative expressions in a computationally efficient manner.

Recommendations

• Separable time-causal and time-recursive spatio-temporal receptive fields
• scientific article; zbMATH DE number 1796933
• Generalized Gaussian scale-space axiomatics comprising linear scale-space, affine scale-space and spatio-temporal scale-space
• A time-causal and time-recursive scale-covariant scale-space representation of temporal signals and past time
• Scale-time

Cites work

• scientific article; zbMATH DE number 425393 (Why is no real title available?)
• scientific article; zbMATH DE number 41223 (Why is no real title available?)
• scientific article; zbMATH DE number 517283 (Why is no real title available?)
• scientific article; zbMATH DE number 1111402 (Why is no real title available?)
• scientific article; zbMATH DE number 2045455 (Why is no real title available?)
• scientific article; zbMATH DE number 1465030 (Why is no real title available?)
• scientific article; zbMATH DE number 1796933 (Why is no real title available?)
• scientific article; zbMATH DE number 3794378 (Why is no real title available?)
• scientific article; zbMATH DE number 2090791 (Why is no real title available?)
• scientific article; zbMATH DE number 2090814 (Why is no real title available?)
• scientific article; zbMATH DE number 1390898 (Why is no real title available?)
• scientific article; zbMATH DE number 1402217 (Why is no real title available?)
• scientific article; zbMATH DE number 3348831 (Why is no real title available?)
• scientific article; zbMATH DE number 3050726 (Why is no real title available?)
• scientific article; zbMATH DE number 3054313 (Why is no real title available?)
• scientific article; zbMATH DE number 3101307 (Why is no real title available?)
• A computational theory of visual receptive fields
• A cortical-inspired geometry for contour perception and motion integration
• Axioms and fundamental equations of image processing
• Continuous and Discrete Wavelet Transforms
• Evidence for a generalized Laguerre transform of temporal events by the visual system
• Generalized Gaussian scale-space axiomatics comprising linear scale-space, affine scale-space and spatio-temporal scale-space
• Geometry-driven diffusion in computer vision
• Image matching using generalized scale-space interest points
• Learning the Lie Groups of Visual Invariance
• Left-invariant evolutions of wavelet transforms on the similitude group
• Linear scale-space has first been proposed in Japan
• Notes on discrete Gaussian scale space
• On Totally Positive Functions, LaPlace Integrals and Entire Functions of the LaGuerre-Polya-Schur Type
• On smoothing operations and their generating functions
• On the axioms of scale space theory
• On the simulation of large populations of neurons.
• Receptive field families
• Scale selection properties of generalized scale-space interest point detectors
• Scale-space theory for auditory signals
• Scale-time
• Scaling Theorems for Zero Crossings
• Separable time-causal and time-recursive spatio-temporal receptive fields
• Temporal scale spaces
• Ten Lectures on Wavelets
• The monogenic scale-space: a unifying approach to phase-based image processing in scale-space
• The structure of images
• Time-causal and time-recursive spatio-temporal receptive fields
• Uniqueness of the Gaussian Kernel for Scale-Space Filtering
• Wavelets and their Applications

Cited in

(15)

• Time-causal and time-recursive spatio-temporal receptive fields
• A computational theory of visual receptive fields
• Spatio-temporal scale selection in video data
• Temporal scale selection in time-causal scale space
• A time-causal and time-recursive scale-covariant scale-space representation of temporal signals and past time
• Local image structure and Procrustes metrics
• Spatiotemporal kernel of a three-component differential equation model with self-control mechanism in vision
• Generalized Gaussian scale-space axiomatics comprising linear scale-space, affine scale-space and spatio-temporal scale-space
• Scale-space theory for auditory signals
• Separable time-causal and time-recursive spatio-temporal receptive fields
• Provably scale-covariant continuous hierarchical networks based on scale-normalized differential expressions coupled in cascade
• Dynamic texture recognition using time-causal and time-recursive spatio-temporal receptive fields
• Dense scale selection over space, time, and space-time
• Local spatio-temporal representation using the 3D shearlet transform
• Emergence of spatiotemporal receptive fields and its application to motion detection

This page was built for publication: Time-causal and time-recursive spatio-temporal receptive fields

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q275337)