Hierarchical graphical-based human pose estimation via local multi-resolution convolutional neural network

Aichun Zhu (1) , Tian Wang (2) , Hichem Snoussi (3)

1 NanJing University of Technology
2 BUAA - Beihang University
3 LM2S - Laboratoire Modélisation et Sûreté des Systèmes

This paper addresses the problems of the graphical-based human pose estimation in still images, including the diversity of appearances and confounding background clutter. We present a new architecture for estimating human pose using a Convolutional Neural Network (CNN). Firstly, a Relative Mixture Deformable Model (RMDM) is defined by each pair of connected parts to compute the relative spatial information in the graphical model. Secondly, a Local Multi-Resolution Convolutional Neural Network (LMR-CNN) is proposed to train and learn the multi-scale representation of each body parts by combining different levels of part context. Thirdly, a LMR-CNN based hierarchical model is defined to explore the context information of limb parts. Finally, the experimental results demonstrate the effectiveness of the proposed deep learning approach for human pose estimation.

Domains: Engineering Sciences [physics]; Signal and Image processing

Aichun Zhu, Tian Wang, Hichem Snoussi. Hierarchical graphical-based human pose estimation via local multi-resolution convolutional neural network. AIP Advances, 2018, 8 (3), pp.035215. ⟨10.1063/1.5024463⟩. ⟨hal-03320694⟩