A Diffusion and Clustering-Based Approach for Finding Coherent Motions and Understanding Crowd Scenes

DOI10.1109/TIP.2016.2531281zbMATH Open1408.94380DBLPjournals/tip/LinMWWWM16arXiv1602.04921OpenAlexW2274407394WikidataQ38395800 ScholiaQ38395800MaRDI QIDQ4616342FDOQ4616342

Authors: Weiyao Lin, Yang Mi, Weiyue Wang, Jianxin Wu, Jingdong Wang, Tao Mei 

Publication date: 4 February 2019

Published in: IEEE Transactions on Image Processing (Search for Journal in Brave)

Abstract: This paper addresses the problem of detecting coherent motions in crowd scenes and presents its two applications in crowd scene understanding: semantic region detection and recurrent activity mining. It processes input motion fields (e.g., optical flow fields) and produces a coherent motion filed, named as thermal energy field. The thermal energy field is able to capture both motion correlation among particles and the motion trends of individual particles which are helpful to discover coherency among them. We further introduce a two-step clustering process to construct stable semantic regions from the extracted time-varying coherent motions. These semantic regions can be used to recognize pre-defined activities in crowd scenes. Finally, we introduce a cluster-and-merge process which automatically discovers recurrent activities in crowd scenes by clustering and merging the extracted coherent motions. Experiments on various videos demonstrate the effectiveness of our approach.

Full work available at URL: https://arxiv.org/abs/1602.04921

Mathematics Subject Classification ID

Image processing (compression, reconstruction, etc.) in information and communication theory (94A08)

This page was built for publication: A Diffusion and Clustering-Based Approach for Finding Coherent Motions and Understanding Crowd Scenes

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4616342)