Eye movements and voice as interface modalities to computer systems

Mohsen M. Farid; Fionn D. Murtagh

doi:10.1117/12.463748

19 March 2003 Eye-movements and Voice as Interface Modalities to Computer Systems

Mohsen M. Farid, Fionn D. Murtagh

Proceedings Volume 4877, Opto-Ireland 2002: Optical Metrology, Imaging, and Machine Vision; (2003) https://doi.org/10.1117/12.463748
Event: OPTO Ireland, 2002, Galway, Ireland

Abstract

We investigate the visual and vocal modalities of interaction with computer systems. We focus our attention on the integration of visual and vocal interface as possible replacement and/or additional modalities to enhance human-computer interaction. We present a new framework for employing eye gaze as a modality of interface. While voice commands, as means of interaction with computers, have been around for a number of years, integration of both the vocal interface and the visual interface, in terms of detecting user's eye movements through an eye-tracking device, is novel and promises to open the horizons for new applications where a hand-mouse interface provides little or no apparent support to the task to be accomplished. We present an array of applications to illustrate the new framework and eye-voice integration.

Citation Download Citation

Mohsen M. Farid and Fionn D. Murtagh "Eye-movements and Voice as Interface Modalities to Computer Systems", Proc. SPIE 4877, Opto-Ireland 2002: Optical Metrology, Imaging, and Machine Vision, (19 March 2003); https://doi.org/10.1117/12.463748

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available