Fall detection of personnel working in deep pits of power transmission lines based on human pose estimation and transformer

Jun Xu; Lei Qian; Peilun Zhang; Jinlong Qi; Min Xie

doi:10.1117/12.3030290

5 June 2024 Fall detection of personnel working in deep pits of power transmission lines based on human pose estimation and transformer

Jun Xu, Lei Qian, Peilun Zhang, Jinlong Qi, Min Xie

Author Affiliations +

Proceedings Volume 13163, Fourth International Conference on Mechanical, Electronics, and Electrical and Automation Control (METMS 2024); 131633M (2024) https://doi.org/10.1117/12.3030290
Event: International Conference on Mechanical, Electronics, and Electrical and Automation Control (METMS 2024), 2024, Xi'an, China

Abstract

To enhance construction safety, we propose a real-time monitoring system using deep learning for detecting falls in complex pit environments. To address this issue, we propose a novel approach that combines human body pose estimation and a Transformer-based method for detecting personnel falls in deep foundation pit operations. Firstly, we extract the key point poses of the human body from the video footage to eliminate interference from complex background information. Then, we encode these estimated key point poses into pose vectors across consecutive frames and use a Transformer network to model the correlation between the sequence of key point poses and personnel fall events. This approach overcomes the limitations of traditional methods that rely on high-quality and large quantities of labeled data, thereby enhancing the ability to detect personnel falls in the deep foundation pit operations of transmission lines. We validate the effectiveness of our proposed method at various deep pit operation sites for transmission lines. The method accurately identifies abnormal events of personnel falls, enabling above-ground managers to promptly perceive the safety conditions of underground operators and take accurate rescue measures. Moreover, our method has potential applications in the power industry and other similar operation scenarios.

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Jun Xu, Lei Qian, Peilun Zhang, Jinlong Qi, and Min Xie "Fall detection of personnel working in deep pits of power transmission lines based on human pose estimation and transformer", Proc. SPIE 13163, Fourth International Conference on Mechanical, Electronics, and Electrical and Automation Control (METMS 2024), 131633M (5 June 2024); https://doi.org/10.1117/12.3030290

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
8 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Data modeling

Transformers

Safety

Pose estimation

Video

Environmental sensing

Machine learning

Show All Keywords

Keywords/Phrases

Search In:

Publication Years