Paper ID | MLR-APPL-IVASR-2.2 | ||
Paper Title | MULTI-VIEW HUMAN MODEL FITTING USING BONE ORIENTATION CONSTRAINT AND JOINTS TRIANGULATION | ||
Authors | Jordy Ajanohoun, Eric Paquette, Carlos Vázquez, École de technologie supérieure, Canada | ||
Session | MLR-APPL-IVASR-2: Machine learning for image and video analysis, synthesis, and retrieval 2 | ||
Location | Area D | ||
Session Time: | Monday, 20 September, 15:30 - 17:00 | ||
Presentation Time: | Monday, 20 September, 15:30 - 17:00 | ||
Presentation | Poster | ||
Topic | Applications of Machine Learning: Machine learning for image & video analysis, synthesis, and retrieval | ||
IEEE Xplore Open Preview | Click here to view in IEEE Xplore | ||
Abstract | We address 3D human pose and shape estimations from multi-view images. We use the SMPL body model, and regress the model parameters that best fit the shape and pose. To solve for the parameters, we first compute 3D joint positions from 2D joint estimations on images by using a linear algebraic triangulation. Then, we fit the 3D parametric body model to the 3D joints while imposing a bone orientation constraint between the 3D model and the corresponding body parts detected in the images. We do so by minimizing a new set of objective functions through a two-step optimization process that provides a good initialization for the refinement of the shape and pose parameters. Our approach is evaluated on the Human3.6M and HumanEva benchmarks, showing superior results with respect to state-of-the-art methods. |