Tai chi action recognition based on structural LSTM with attention module

Lingxiao Dong; Dongmei Li; Shaobin Li; Shanzhen Lan; Pengcheng Wang

doi:10.1117/12.2538431

27 November 2019 Tai chi action recognition based on structural LSTM with attention module

Lingxiao Dong, Dongmei Li, Shaobin Li, Shanzhen Lan, Pengcheng Wang

Proceedings Volume 11321, 2019 International Conference on Image and Video Processing, and Artificial Intelligence; 113211O (2019) https://doi.org/10.1117/12.2538431
Event: The Second International Conference on Image, Video Processing and Artifical Intelligence, 2019, Shanghai, China

Abstract

Tai chi is a traditional Chinese sport, which is popular all over the world. It is expressed by slow, soft, and continuously flowing moves. At present, studies on action recognition are generally aimed at common actions, such as walking, jumping. These algorithms are not very suitable for Tai chi recognition. Because Tai chi actions have unique characteristics. Through careful analysis of Tai chi moves and research of existing Tai chi dataset, we propose and build a Tai chi dataset, named Sub-Tai chi. This dataset is based on joints and skeleton, consisting of 15 representative basic actions of different body parts. For Tai chi action recognition, we use Structural LSTM with Attention Module, which is an action recognition method based on neural network. We use RNN to capture action features and use the full connected layer to classify actions. In this paper, we introduce the velocity features and acceleration features to improve Tai chi actions. Experimental results show that the method proposed in this paper has accuracy about 79%, which is nearly 7% higher than the original algorithm.

Citation Download Citation

Lingxiao Dong, Dongmei Li, Shaobin Li, Shanzhen Lan, and Pengcheng Wang "Tai chi action recognition based on structural LSTM with attention module", Proc. SPIE 11321, 2019 International Conference on Image and Video Processing, and Artificial Intelligence, 113211O (27 November 2019); https://doi.org/10.1117/12.2538431

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available