A method of combination word recognition based on word structure features

Zhengwei Lou; Zhigeng Pan; Haiyan Jin; Beibei Zhang

doi:10.1117/12.2589472

27 January 2021 A method of combination word recognition based on word structure features

Zhengwei Lou, Zhigeng Pan, Haiyan Jin, Beibei Zhang

Proceedings Volume 11720, Twelfth International Conference on Graphics and Image Processing (ICGIP 2020); 117201D (2021) https://doi.org/10.1117/12.2589472
Event: Twelfth International Conference on Graphics and Image Processing, 2020, Xi'an, China

Abstract

With the continuous expansion and deepening of the human knowledge system, various compound words have been created to express new concepts. Since the combined words cannot be recorded in the thesaurus in time, which lead to the word segmentation system cannot recognize them. Hence they are generally recognized as the unite of the smallest word (atomic word). So it is very urgent and meaningful to study the recognition method of compound words. In this paper, we propose a word structure based combinatorial word discovery algorithm, which makes full use of the following three word structure characteristics: word spacing, word frequency, and grammatical rules. According to the distance and position relationship between different words, the algorithm makes a comprehensive evaluation based on the rule judgment and the occurrence frequency of words. By experiments on different corpora, the results show that this method has higher accuracy.

Citation Download Citation

Zhengwei Lou, Zhigeng Pan, Haiyan Jin, and Beibei Zhang "A method of combination word recognition based on word structure features", Proc. SPIE 11720, Twelfth International Conference on Graphics and Image Processing (ICGIP 2020), 117201D (27 January 2021); https://doi.org/10.1117/12.2589472

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available