3D human pose estimation based on multi view information fusion

Shuo Zhang; Ming Liu; Yuejin Zhao; Liquan Dong; Lingqin Kong

doi:10.1117/12.2643718

19 December 2022 3D human pose estimation based on multi view information fusion

Shuo Zhang, Ming Liu, Yuejin Zhao, Liquan Dong, Lingqin Kong

Proceedings Volume 12319, Optical Metrology and Inspection for Industrial Applications IX; 123191I (2022) https://doi.org/10.1117/12.2643718
Event: SPIE/COS Photonics Asia, 2022, Online Only

Conference Poster

Abstract

3D human pose estimation refers to recovering the pose of the human body in the three-dimensional space from the image, which is estimating the coordinates of the key points of the human body in the three-dimensional coordinate system. The human skeleton model composed of these keypoints describes the human pose in the image.The traditional pose estimation method uses motion capture equipment, which requires athletes to wear auxiliary equipment and affects the normal training of athletes. With the development of deep learning, convolutional neural network has shown strong representational capabilities in the process of image feature extraction, and is an effective method to achieve human pose estimation. However, in the actual complex and changeable three-dimensional space, the environment is noisy and the limbs are occluded. The monocular capture of human posture has the problems of low accuracy and instability, and cannot provide sufficient semantic information. To solve this poroblem, this paper designs a multi-view information fusion algorithm. First, a two-dimensional attitude feature extraction module is designed. By connecting and interacting heat maps of different resolving power in parallel, the heat map always maintains a higher resolving power for higher precision. It extracts the two-dimensional human pose from a single perspective, and then uses the multi-view information fusion technology proposed in this paper to complete and correct the pose information from different perspectives to obtain a more accurate two-dimensional pose. Then, through the camera pose transformation, the three-dimensional human pose estimation is realized, and the experimental verification is carried out on the multi-eye machine vision pan-tilt zoom tracking shooting system.

Citation Download Citation

Shuo Zhang, Ming Liu, Yuejin Zhao, Liquan Dong, and Lingqin Kong "3D human pose estimation based on multi view information fusion", Proc. SPIE 12319, Optical Metrology and Inspection for Industrial Applications IX, 123191I (19 December 2022); https://doi.org/10.1117/12.2643718

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available