Energy Level-Based Abnormal Crowd Behavior Detection

The change of crowd energy is a fundamental measurement for describing a crowd behavior. In this paper, we present a crowd abnormal detection method based on the change of energy-level distribution. The method can not only reduce the camera perspective effect, but also detect crowd abnormal behavior...

Full description

Bibliographic Details
Main Authors: Xuguang Zhang, Qian Zhang, Shuo Hu, Chunsheng Guo, Hui Yu
Format: Article
Language:English
Published: MDPI AG 2018-02-01
Series:Sensors
Subjects:
Online Access:http://www.mdpi.com/1424-8220/18/2/423
id doaj-7aef85aba36c45ae9da7dbfe4dda2730
record_format Article
spelling doaj-7aef85aba36c45ae9da7dbfe4dda27302020-11-24T22:17:02ZengMDPI AGSensors1424-82202018-02-0118242310.3390/s18020423s18020423Energy Level-Based Abnormal Crowd Behavior DetectionXuguang Zhang0Qian Zhang1Shuo Hu2Chunsheng Guo3Hui Yu4The Institute of Electrical Engineering, YanShan University, Qinhuangdao 066004, ChinaThe Institute of Electrical Engineering, YanShan University, Qinhuangdao 066004, ChinaThe Institute of Electrical Engineering, YanShan University, Qinhuangdao 066004, ChinaSchool of Communication Engineering, Hangzhou Dianzi University, Hangzhou 310018, ChinaSchool of Creative Technologies, University of Portsmouth, Portsmouth PO1 2DJ, UKThe change of crowd energy is a fundamental measurement for describing a crowd behavior. In this paper, we present a crowd abnormal detection method based on the change of energy-level distribution. The method can not only reduce the camera perspective effect, but also detect crowd abnormal behavior in time. Pixels in the image are treated as particles, and the optical flow method is adopted to extract the velocities of particles. The qualities of different particles are distributed as different value according to the distance between the particle and the camera to reduce the camera perspective effect. Then a crowd motion segmentation method based on flow field texture representation is utilized to extract the motion foreground, and a linear interpolation calculation is applied to pedestrian’s foreground area to determine their distance to the camera. This contributes to the calculation of the particle qualities in different locations. Finally, the crowd behavior is analyzed according to the change of the consistency, entropy and contrast of the three descriptors for co-occurrence matrix. By calculating a threshold, the timestamp when the crowd abnormal happens is determined. In this paper, multiple sets of videos from three different scenes in UMN dataset are employed in the experiment. The results show that the proposed method is effective in characterizing anomalies in videos.http://www.mdpi.com/1424-8220/18/2/423crowd abnormal detectionenergy-levelflow field visualizationco-occurrence matrix
collection DOAJ
language English
format Article
sources DOAJ
author Xuguang Zhang
Qian Zhang
Shuo Hu
Chunsheng Guo
Hui Yu
spellingShingle Xuguang Zhang
Qian Zhang
Shuo Hu
Chunsheng Guo
Hui Yu
Energy Level-Based Abnormal Crowd Behavior Detection
Sensors
crowd abnormal detection
energy-level
flow field visualization
co-occurrence matrix
author_facet Xuguang Zhang
Qian Zhang
Shuo Hu
Chunsheng Guo
Hui Yu
author_sort Xuguang Zhang
title Energy Level-Based Abnormal Crowd Behavior Detection
title_short Energy Level-Based Abnormal Crowd Behavior Detection
title_full Energy Level-Based Abnormal Crowd Behavior Detection
title_fullStr Energy Level-Based Abnormal Crowd Behavior Detection
title_full_unstemmed Energy Level-Based Abnormal Crowd Behavior Detection
title_sort energy level-based abnormal crowd behavior detection
publisher MDPI AG
series Sensors
issn 1424-8220
publishDate 2018-02-01
description The change of crowd energy is a fundamental measurement for describing a crowd behavior. In this paper, we present a crowd abnormal detection method based on the change of energy-level distribution. The method can not only reduce the camera perspective effect, but also detect crowd abnormal behavior in time. Pixels in the image are treated as particles, and the optical flow method is adopted to extract the velocities of particles. The qualities of different particles are distributed as different value according to the distance between the particle and the camera to reduce the camera perspective effect. Then a crowd motion segmentation method based on flow field texture representation is utilized to extract the motion foreground, and a linear interpolation calculation is applied to pedestrian’s foreground area to determine their distance to the camera. This contributes to the calculation of the particle qualities in different locations. Finally, the crowd behavior is analyzed according to the change of the consistency, entropy and contrast of the three descriptors for co-occurrence matrix. By calculating a threshold, the timestamp when the crowd abnormal happens is determined. In this paper, multiple sets of videos from three different scenes in UMN dataset are employed in the experiment. The results show that the proposed method is effective in characterizing anomalies in videos.
topic crowd abnormal detection
energy-level
flow field visualization
co-occurrence matrix
url http://www.mdpi.com/1424-8220/18/2/423
work_keys_str_mv AT xuguangzhang energylevelbasedabnormalcrowdbehaviordetection
AT qianzhang energylevelbasedabnormalcrowdbehaviordetection
AT shuohu energylevelbasedabnormalcrowdbehaviordetection
AT chunshengguo energylevelbasedabnormalcrowdbehaviordetection
AT huiyu energylevelbasedabnormalcrowdbehaviordetection
_version_ 1725786877201481728