Optimal observer framework and categorization observer framework for three-class ROC analysis

X. He; E. C. Frey

doi:10.1117/12.654172

17 March 2006 Optimal observer framework and categorization observer framework for three-class ROC analysis

X. He, E. C. Frey

Proceedings Volume 6146, Medical Imaging 2006: Image Perception, Observer Performance, and Technology Assessment; 61460B (2006) https://doi.org/10.1117/12.654172
Event: Medical Imaging, 2006, San Diego, California, United States

Abstract

ROC analysis has been an important tool for system evaluation and optimization in medical imaging. Despite its success in evaluating binary classification tasks, ROC analysis does not provide a direct way for evaluating performance on classification tasks that involve more than two diagnostic alternatives. We have previously developed a three-class ROC analysis method that provides a practical way to evaluate three-class task performance. Based on two-class ROC analysis and the proposed three-class ROC analysis method, this work proposes two frameworks, the optimal observer framework and the categorization observer framework, for three-class ROC analysis. The optimal observer framework seeks three-class decision rules and decision variables based on a formal decision strategy; it provides a ROC surface for system comparison on the basis of optimal performance with respect to this strategy. A categorization procedure is the generalization to 3-D of a 2-alternative forced choice procedure and is an important concept in the categorization observer framework. The categorization observer framework seeks three-class decision rules, decision variables and ROC surface such that task performance as measured by volume under the ROC surface (VUS) and the percent correct on the categorization procedure are equal. We then show that how our previously-proposed three-class ROC method fits into both frameworks.

Citation Download Citation

X. He and E. C. Frey "Optimal observer framework and categorization observer framework for three-class ROC analysis", Proc. SPIE 6146, Medical Imaging 2006: Image Perception, Observer Performance, and Technology Assessment, 61460B (17 March 2006); https://doi.org/10.1117/12.654172

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
9 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Lawrencium

Statistical analysis

Signal to noise ratio

Binary data

Medical imaging

Data modeling

Imaging systems

Show All Keywords

Keywords/Phrases

Search In:

Publication Years