4.3 Article

Point-supervised temporal action localisation based on multi-branch attention

Journal

ENTERPRISE INFORMATION SYSTEMS
Volume -, Issue -, Pages -

Publisher

TAYLOR & FRANCIS LTD
DOI: 10.1080/17517575.2023.2197318

Keywords

Temporal action localisation; point supervision; mechanism of attention; pseudo-background label; frame-level label

Ask authors/readers for more resources

This study proposes a multi-branch attention network and a pseudo-background label generation method to address the problem of temporal action localisation in video understanding. Experimental results show that the proposed method can improve the separation effect of action instances, background, and action context, and achieves excellent performance on the THUMOS-14 dataset.
Temporal action localisation is a key research direction for video understanding in the field of computer vision. Current methods of using an attention mechanism only divides the video frame into an action instance frame and a background frame. As a result, the action context, which should belong to the background is misclassified into an action instance In addition, during the training phase of using point-supervised frame-level labels, action samples and background samples are unbalanced. The lack of background samples leads to the reduction of the activation score of the background so that the imbalance of samples will affect the separation of action examples from the background. All these reduce the accuracy of action classification and temporal localisation. Therefore, this paper proposesa multi-branch attention network and a pseudo-background label generation method. Experimental results show that the proposed method can improve the separation effect of action instances, background, and action context. Moreover, the proposed model achieves excellent performance on the THUMOS-14 dataset.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.3
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

No Data Available
No Data Available