Improved foveation- and saliency-based visual attention prediction under a quality assessment task

Milind S. Gide, Lina Karam

Research output: Chapter in Book/Report/Conference proceedingConference contribution

7 Scopus citations

Abstract

Image quality assessment is one application out of many that can be aided by the use of computational saliency models. Existing visual saliency models have not been extensively tested under a quality assessment context. Also, these models are typically geared towards predicting saliency in non-distorted images. Recent work has also focussed on mimicking the human visual system in order to predict fixation points from saliency maps. One such technique (GAFFE) that uses foveation has been found to perform well for non-distorted images. This work extends the foveation framework by integrating it with saliency maps from well known saliency models. The performance of the foveated saliency models is evaluated based on a comparison with human ground-truth eye-tracking data. For comparison, the performance of the original non-foveated saliency predictions is also presented. It is shown that the integration of saliency models with a foveation based fixation finding framework significantly improves the prediction performance of existing saliency models over different distortion types. It is also found that the information maximization based saliency maps perform the best consistently over different distortion types and levels under this foveation based framework.

Original languageEnglish (US)
Title of host publication2012 4th International Workshop on Quality of Multimedia Experience, QoMEX 2012
Pages200-205
Number of pages6
DOIs
StatePublished - Oct 1 2012
Event2012 4th International Workshop on Quality of Multimedia Experience, QoMEX 2012 - Melbourne, VIC, Australia
Duration: Jul 5 2012Jul 7 2012

Publication series

Name2012 4th International Workshop on Quality of Multimedia Experience, QoMEX 2012

Other

Other2012 4th International Workshop on Quality of Multimedia Experience, QoMEX 2012
Country/TerritoryAustralia
CityMelbourne, VIC
Period7/5/127/7/12

Keywords

  • Foveation
  • Gaze
  • Information Maximization
  • Quality Assessment
  • Visual Attention

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Computer Vision and Pattern Recognition
  • Software

Fingerprint

Dive into the research topics of 'Improved foveation- and saliency-based visual attention prediction under a quality assessment task'. Together they form a unique fingerprint.

Cite this