Journal
COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING
Volume 35, Issue 9, Pages 965-978Publisher
WILEY
DOI: 10.1111/mice.12538
Keywords
-
Categories
Funding
- Innovation and Technology Commission (ITC) of Hong Kong [ITP/020/18LP]
Ask authors/readers for more resources
Automatic activity recognition plays an important role in addressing the efficiency issue of site management. In recent years, there has been an increasing interest in vision-based activity recognition, while its relatively low recognition accuracy and speed impede the practical application. This paper introduces a discriminative model to combine deep activity features and contextual information to improve the recognition of activities of workers on foot in site surveillance videos. Specifically, a conditional random field (CRF) model is designed based on deep activity features, which are extracted with a single-stream deep activity recognition network, and spatial relevance, which are obtained with a tracking-by-detection multiple-object tracking method. We have evaluated various deep activity features, including action features, activity features, and joint features. Also, we have parameterized the contextual information of activities in terms of spatial relevance and represent the context with graphs of K-nearest neighbors. The experimental results show that the CRF model based on deep activity features and activity context can significantly improve activity recognition performance to 98.77% average accuracy by 22.10% from the baseline 77.67%, which is obtained using the single-stream deep activity recognition network, with a small computational overhead of 0.025 ms per segment.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available