Image-Based Crowd Stability Analysis Using Improved Multi-Column Convolutional Neural Network

Crowd stability analysis is an important yet challenging task, as it is difficult to obtain the quantitative information regarding a crowd in motion, for instance, the crowd count and crowd density in a pedestrian merging area. This paper proposes a novel model that can be used to accurately analyze the crowd stability based on images obtained from a real-time video surveillance system (VSS) in dense crowd scenarios. To enhance the accuracy of the human head recognition for the crowd counting and crowd density estimation, we improve the conventional convolution-neural-network (CNN) model with more columns and merged features, obtaining a four-column convolutional neural network (4C-CNN). Using more columns with receptive fields of deferent sizes, more merged features can be learned, to be adaptive to variations in pedestrian head size due to image resolution. Furthermore, the crowd density of different areas is calculated with image rectification against the perspective distortion. By utilizing the stability criterion based on crowd density, we propose a crowd stability analysis model (CSAM) with the capability of quantitative computation dynamically. The results of extensive experiments performed on public datasets indicate that this improved CNN model exhibits a better performance for crowd counting than the typical multi-column CNN models. In addition, the experiment results pertaining to Shanghai Hongqiao Railway Station demonstrate the effectiveness of the crowd stability analysis model. Thus, this integrated approach can simultaneously conduct the processes of crowd counting, image rectification, density map calculation and crowd stability analysis by using dense crowd images from a VSS.

Automated summary

This paper proposes a novel model for crowd stability analysis using images from a real-time video surveillance system. By enhancing the accuracy of human head recognition for crowd counting and density estimation, a four-column convolutional neural network (4C-CNN) is developed. This model calculates crowd density in different areas with image rectification against perspective distortion, and utilizes a stability criterion for quantitative computation dynamically. Additionally, experiments demonstrate that this improved CNN model outperforms typical multi-column CNN models for crowd counting, and the effectiveness of the crowd stability analysis model is validated at Shanghai Hongqiao Railway Station.