Mental model for handwritten keyword spotting

Youcef Brik; Djemel Ziou

doi:10.1117/1.JEI.27.5.053027

4 October 2018 Mental model for handwritten keyword spotting

Youcef Brik, Djemel Ziou

Author Affiliations +

Journal of Electronic Imaging, Vol. 27, Issue 5, 053027 (October 2018). https://doi.org/10.1117/1.JEI.27.5.053027

Abstract

Most of existing approaches in keyword spotting are system-oriented, which did not take into consideration the user’s needs. However, a user may want to find words, sentences, or texts that match his target image in his mind. The challenge here is how to formulate one’s mental image to reach what he is looking for. The key idea is to design and build a model that properly adapts the human reasoning in information searching through an interactive process. We propose a mental model for handwritten keyword spotting based on relevance feedback, feature weighting, and optimization. This model meets simultaneously the user’s needs, the system behavior, and the user–system relationship. In an appropriate feature space, the query is progressively built from user-supplied keywords, old queries, and spotted images. This dynamic process not only converges toward the desired word images, but also helps the hesitant user to clarify progressively what he is looking for. The proposed model was showcased via a user-friendly interface, which we tested including real users on three well-known handwritten datasets; Institute for Communications, Braunschweig University, Germany/École Nationale d’Ingénieurs de Tunis, Tunisia, Institut für informatik und Angewandte Mathematik, and George Washington. The experimental results show that the proposed method provides promising scores with a reasonable number of refinements.

Citation Download Citation

Youcef Brik and Djemel Ziou "Mental model for handwritten keyword spotting," Journal of Electronic Imaging 27(5), 053027 (4 October 2018). https://doi.org/10.1117/1.JEI.27.5.053027

Received: 23 May 2018; Accepted: 13 September 2018; Published: 4 October 2018

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $24.00

Non-members: $28.00 ADD TO CART

JOURNAL ARTICLE
16 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Systems modeling

Data modeling

Image retrieval

Performance modeling

Statistical modeling

Mathematical modeling

Image processing

Show All Keywords

Keywords/Phrases

Search In:

Publication Years