Medical case-based retrieval: integrating query MeSH terms for query-adaptive multi-modal fusion

Alba G. Seco de Herrera; Antonio Foncubierta-Rodríguez; Henning Müller

doi:10.1117/12.2082028

17 March 2015 Medical case-based retrieval: integrating query MeSH terms for query-adaptive multi-modal fusion

Alba G. Seco de Herrera, Antonio Foncubierta-Rodríguez, Henning Müller

Proceedings Volume 9418, Medical Imaging 2015: PACS and Imaging Informatics: Next Generation and Innovations; 94180S (2015) https://doi.org/10.1117/12.2082028
Event: SPIE Medical Imaging, 2015, Orlando, Florida, United States

Abstract

Advances in medical knowledge give clinicians more objective information for a diagnosis. Therefore, there is an increasing need for bibliographic search engines that can provide services helping to facilitate faster information search.

The ImageCLEFmed benchmark proposes a medical case-based retrieval task. This task aims at retrieving articles from the biomedical literature that are relevant for differential diagnosis of query cases including a textual description and several images. In the context of this campaign many approaches have been investigated showing that the fusion of visual and text information can improve the precision of the retrieval. However, fusion does not always lead to better results.

In this paper, a new query-adaptive fusion criterion to decide when to use multi-modal (text and visual) or only text approaches is presented. The proposed method integrates text information contained in MeSH (Medical Subject Headings) terms extracted and visual features of the images to find synonym relations between them. Given a text query, the query-adaptive fusion criterion decides when it is suitable to also use visual information for the retrieval.

Results show that this approach can decide if a text or multi{modal approach should be used with 77.15% of accuracy.

Citation Download Citation

Alba G. Seco de Herrera, Antonio Foncubierta-Rodríguez, and Henning Müller "Medical case-based retrieval: integrating query MeSH terms for query-adaptive multi-modal fusion", Proc. SPIE 9418, Medical Imaging 2015: PACS and Imaging Informatics: Next Generation and Innovations, 94180S (17 March 2015); https://doi.org/10.1117/12.2082028

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available