Paper ID | 3D-1.8 | ||
Paper Title | RGB-D FUSION FOR POINT-CLOUD-BASED 3D HUMAN POSE ESTIMATION | ||
Authors | Jiaming Ying, Xu Zhao, Shanghai Jiao Tong University, China | ||
Session | 3D-1: Point Cloud Processing 1 | ||
Location | Area J | ||
Session Time: | Tuesday, 21 September, 15:30 - 17:00 | ||
Presentation Time: | Tuesday, 21 September, 15:30 - 17:00 | ||
Presentation | Poster | ||
Topic | Three-Dimensional Image and Video Processing: Point cloud processing | ||
IEEE Xplore Open Preview | Click here to view in IEEE Xplore | ||
Abstract | 3D human pose estimation is an important and challenging task in computer vision. In this paper, we propose a method to estimate 3D human pose from RGB-D images. We adopt a 2D pose estimator to extract color features from the RGB image. The color features are integrated with the depth image in the form of point cloud. To fully exploit geometric information, we design a 3D learning module to extract point-wise features. To take advantage of local information as well as facilitate the convergence of the model, we design a dense prediction module. It estimates the offset vectors and closeness scores from points to target keypoints. The point-wise estimations are weighted and summed up to a final 3D pose. Experimental results show that our method achieves state-of-the-art performance on MHAD and SURREAL datasets. |