Skip to Main content Skip to Navigation
Journal articles

RecapNet: Action Proposal Generation Mimicking Human Cognitive Process

Abstract : Generating action proposals in untrimmed videos is a challenging task, since video sequences usually contain lots of irrelevant contents and the duration of an action instance is arbitrary. The quality of action proposals is key to action detection performance. The previous methods mainly rely on sliding windows or anchor boxes to cover all ground-truth actions, but this is infeasible and computationally inefficient. To this end, this article proposes a RecapNet--a novel framework for generating action proposal, by mimicking the human cognitive process of understanding video content. Specifically, this RecapNet includes a residual causal convolution module to build a short memory of the past events, based on which the joint probability actionness density ranking mechanism is designed to retrieve the action proposals. The RecapNet can handle videos with arbitrary length and more important, a video sequence will need to be processed only in one single pass in order to generate all action proposals. The experiments show that the proposed RecapNet outperforms the state of the art under all metrics on the benchmark THUMOS14 and ActivityNet-1.3 datasets. The code is available publicly at https://github.com/tianwangbuaa/RecapNet.
Document type :
Journal articles
Complete list of metadatas

https://hal-utt.archives-ouvertes.fr/hal-02461499
Contributor : Jean-Baptiste Vu Van <>
Submitted on : Thursday, January 30, 2020 - 4:51:06 PM
Last modification on : Tuesday, June 16, 2020 - 4:04:02 PM

Identifiers

Collections

ROSAS | UTT | CNRS

Citation

Tian Wang, Yang Chen, Zhiwei Lin, Aichun Zhu, Yong Li, et al.. RecapNet: Action Proposal Generation Mimicking Human Cognitive Process. IEEE Transactions on Cybernetics, IEEE, In press, pp.1-12. ⟨10.1109/TCYB.2020.2965196⟩. ⟨hal-02461499⟩

Share

Metrics

Record views

51