Efficient multimodal cuing of spatial attention

Robert Gray, Charles Spence, Cristy Ho, Hong Z. Tan

Research output: Contribution to journalArticle

6 Citations (Scopus)

Abstract

Behavioral studies of multisensory integration and cross-modal spatial attention have identified many potential benefits of using interfaces that engage more than just a single sense in complex operating environments. Particularly relevant in terms of application, the latest research highlights that: 1) multimodal signals can be used to reorient spatial attention effectively under conditions of high operator workload in which unimodal signals may be ineffective; 2) multimodal signals are less likely to be masked in noisy environments; and 3) there are natural links between specific signals and particular behavioral responses (e.g., head turning). However, taking advantage of these potential benefits requires that interface designers take into account the limitations of the human operator. In particular, multimodal interfaces should normally be designed so as to minimize any spatial incongruence between component warning signals presented in different sensory modalities that relate to the same event. Building on this rapidly growing cognitive neuroscience knowledge base, the last decade has witnessed the development of a number of highly effective multimodal interfaces for driving, aviation, the military, medicine, and sports.

Original languageEnglish (US)
Article number6403488
Pages (from-to)2113-2122
Number of pages10
JournalProceedings of the IEEE
Volume101
Issue number9
DOIs
StatePublished - 2013
Externally publishedYes

Fingerprint

Sports
Aviation
Medicine

Keywords

  • Crossmodal
  • interface design
  • multimodal
  • multisensory
  • spatial attention

ASJC Scopus subject areas

  • Electrical and Electronic Engineering

Cite this

Efficient multimodal cuing of spatial attention. / Gray, Robert; Spence, Charles; Ho, Cristy; Tan, Hong Z.

In: Proceedings of the IEEE, Vol. 101, No. 9, 6403488, 2013, p. 2113-2122.

Research output: Contribution to journalArticle

Gray, R, Spence, C, Ho, C & Tan, HZ 2013, 'Efficient multimodal cuing of spatial attention', Proceedings of the IEEE, vol. 101, no. 9, 6403488, pp. 2113-2122. https://doi.org/10.1109/JPROC.2012.2225811
Gray, Robert ; Spence, Charles ; Ho, Cristy ; Tan, Hong Z. / Efficient multimodal cuing of spatial attention. In: Proceedings of the IEEE. 2013 ; Vol. 101, No. 9. pp. 2113-2122.
@article{f6e614c84d5a49ec953ae5913a10441c,
title = "Efficient multimodal cuing of spatial attention",
abstract = "Behavioral studies of multisensory integration and cross-modal spatial attention have identified many potential benefits of using interfaces that engage more than just a single sense in complex operating environments. Particularly relevant in terms of application, the latest research highlights that: 1) multimodal signals can be used to reorient spatial attention effectively under conditions of high operator workload in which unimodal signals may be ineffective; 2) multimodal signals are less likely to be masked in noisy environments; and 3) there are natural links between specific signals and particular behavioral responses (e.g., head turning). However, taking advantage of these potential benefits requires that interface designers take into account the limitations of the human operator. In particular, multimodal interfaces should normally be designed so as to minimize any spatial incongruence between component warning signals presented in different sensory modalities that relate to the same event. Building on this rapidly growing cognitive neuroscience knowledge base, the last decade has witnessed the development of a number of highly effective multimodal interfaces for driving, aviation, the military, medicine, and sports.",
keywords = "Crossmodal, interface design, multimodal, multisensory, spatial attention",
author = "Robert Gray and Charles Spence and Cristy Ho and Tan, {Hong Z.}",
year = "2013",
doi = "10.1109/JPROC.2012.2225811",
language = "English (US)",
volume = "101",
pages = "2113--2122",
journal = "Proceedings of the IEEE",
issn = "0018-9219",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
number = "9",

}

TY - JOUR

T1 - Efficient multimodal cuing of spatial attention

AU - Gray, Robert

AU - Spence, Charles

AU - Ho, Cristy

AU - Tan, Hong Z.

PY - 2013

Y1 - 2013

N2 - Behavioral studies of multisensory integration and cross-modal spatial attention have identified many potential benefits of using interfaces that engage more than just a single sense in complex operating environments. Particularly relevant in terms of application, the latest research highlights that: 1) multimodal signals can be used to reorient spatial attention effectively under conditions of high operator workload in which unimodal signals may be ineffective; 2) multimodal signals are less likely to be masked in noisy environments; and 3) there are natural links between specific signals and particular behavioral responses (e.g., head turning). However, taking advantage of these potential benefits requires that interface designers take into account the limitations of the human operator. In particular, multimodal interfaces should normally be designed so as to minimize any spatial incongruence between component warning signals presented in different sensory modalities that relate to the same event. Building on this rapidly growing cognitive neuroscience knowledge base, the last decade has witnessed the development of a number of highly effective multimodal interfaces for driving, aviation, the military, medicine, and sports.

AB - Behavioral studies of multisensory integration and cross-modal spatial attention have identified many potential benefits of using interfaces that engage more than just a single sense in complex operating environments. Particularly relevant in terms of application, the latest research highlights that: 1) multimodal signals can be used to reorient spatial attention effectively under conditions of high operator workload in which unimodal signals may be ineffective; 2) multimodal signals are less likely to be masked in noisy environments; and 3) there are natural links between specific signals and particular behavioral responses (e.g., head turning). However, taking advantage of these potential benefits requires that interface designers take into account the limitations of the human operator. In particular, multimodal interfaces should normally be designed so as to minimize any spatial incongruence between component warning signals presented in different sensory modalities that relate to the same event. Building on this rapidly growing cognitive neuroscience knowledge base, the last decade has witnessed the development of a number of highly effective multimodal interfaces for driving, aviation, the military, medicine, and sports.

KW - Crossmodal

KW - interface design

KW - multimodal

KW - multisensory

KW - spatial attention

UR - http://www.scopus.com/inward/record.url?scp=84883051072&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84883051072&partnerID=8YFLogxK

U2 - 10.1109/JPROC.2012.2225811

DO - 10.1109/JPROC.2012.2225811

M3 - Article

VL - 101

SP - 2113

EP - 2122

JO - Proceedings of the IEEE

JF - Proceedings of the IEEE

SN - 0018-9219

IS - 9

M1 - 6403488

ER -