Objective video quality assessment methods: A classification, review, and performance comparison

Shyamprasad Chikkerur, Vijay Sundaram, Martin Reisslein, Lina Karam

Research output: Contribution to journalArticle

382 Citations (Scopus)

Abstract

With the increasing demand for video-based applications, the reliable prediction of video quality has increased in importance. Numerous video quality assessment methods and metrics have been proposed over the past years with varying computational complexity and accuracy. In this paper, we introduce a classification scheme for full-reference and reduced-reference media-layer objective video quality assessment methods. Our classification scheme first classifies a method according to whether natural visual characteristics or perceptual (human visual system) characteristics are considered. We further subclassify natural visual characteristics methods into methods based on natural visual statistics or natural visual features. We subclassify perceptual characteristics methods into frequency- or pixel-domain methods. According to our classification scheme, we comprehensively review and compare the media-layer objective video quality models for both standard resolution and high definition video. We find that the natural visual statistics based MultiScale-Structural SIMilarity index (MS-SSIM), the natural visual feature based Video Quality Metric (VQM), and the perceptual spatio-temporal frequency-domain based MOtion-based Video Integrity Evaluation (MOVIE) index give the best performance for the LIVE Video Quality Database.

Original languageEnglish (US)
Article number5710601
Pages (from-to)165-182
Number of pages18
JournalIEEE Transactions on Broadcasting
Volume57
Issue number2 PART 1
DOIs
StatePublished - Jun 2011

Fingerprint

Statistics
Computational complexity
Pixels

Keywords

  • Full-reference metric
  • objective video quality
  • perceptual video quality
  • reduced-reference metric

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Media Technology

Cite this

Objective video quality assessment methods : A classification, review, and performance comparison. / Chikkerur, Shyamprasad; Sundaram, Vijay; Reisslein, Martin; Karam, Lina.

In: IEEE Transactions on Broadcasting, Vol. 57, No. 2 PART 1, 5710601, 06.2011, p. 165-182.

Research output: Contribution to journalArticle

Chikkerur, Shyamprasad ; Sundaram, Vijay ; Reisslein, Martin ; Karam, Lina. / Objective video quality assessment methods : A classification, review, and performance comparison. In: IEEE Transactions on Broadcasting. 2011 ; Vol. 57, No. 2 PART 1. pp. 165-182.
@article{e3977a666ee54df6b4c91c57c4ab1bfc,
title = "Objective video quality assessment methods: A classification, review, and performance comparison",
abstract = "With the increasing demand for video-based applications, the reliable prediction of video quality has increased in importance. Numerous video quality assessment methods and metrics have been proposed over the past years with varying computational complexity and accuracy. In this paper, we introduce a classification scheme for full-reference and reduced-reference media-layer objective video quality assessment methods. Our classification scheme first classifies a method according to whether natural visual characteristics or perceptual (human visual system) characteristics are considered. We further subclassify natural visual characteristics methods into methods based on natural visual statistics or natural visual features. We subclassify perceptual characteristics methods into frequency- or pixel-domain methods. According to our classification scheme, we comprehensively review and compare the media-layer objective video quality models for both standard resolution and high definition video. We find that the natural visual statistics based MultiScale-Structural SIMilarity index (MS-SSIM), the natural visual feature based Video Quality Metric (VQM), and the perceptual spatio-temporal frequency-domain based MOtion-based Video Integrity Evaluation (MOVIE) index give the best performance for the LIVE Video Quality Database.",
keywords = "Full-reference metric, objective video quality, perceptual video quality, reduced-reference metric",
author = "Shyamprasad Chikkerur and Vijay Sundaram and Martin Reisslein and Lina Karam",
year = "2011",
month = "6",
doi = "10.1109/TBC.2011.2104671",
language = "English (US)",
volume = "57",
pages = "165--182",
journal = "IEEE Transactions on Broadcasting",
issn = "0018-9316",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
number = "2 PART 1",

}

TY - JOUR

T1 - Objective video quality assessment methods

T2 - A classification, review, and performance comparison

AU - Chikkerur, Shyamprasad

AU - Sundaram, Vijay

AU - Reisslein, Martin

AU - Karam, Lina

PY - 2011/6

Y1 - 2011/6

N2 - With the increasing demand for video-based applications, the reliable prediction of video quality has increased in importance. Numerous video quality assessment methods and metrics have been proposed over the past years with varying computational complexity and accuracy. In this paper, we introduce a classification scheme for full-reference and reduced-reference media-layer objective video quality assessment methods. Our classification scheme first classifies a method according to whether natural visual characteristics or perceptual (human visual system) characteristics are considered. We further subclassify natural visual characteristics methods into methods based on natural visual statistics or natural visual features. We subclassify perceptual characteristics methods into frequency- or pixel-domain methods. According to our classification scheme, we comprehensively review and compare the media-layer objective video quality models for both standard resolution and high definition video. We find that the natural visual statistics based MultiScale-Structural SIMilarity index (MS-SSIM), the natural visual feature based Video Quality Metric (VQM), and the perceptual spatio-temporal frequency-domain based MOtion-based Video Integrity Evaluation (MOVIE) index give the best performance for the LIVE Video Quality Database.

AB - With the increasing demand for video-based applications, the reliable prediction of video quality has increased in importance. Numerous video quality assessment methods and metrics have been proposed over the past years with varying computational complexity and accuracy. In this paper, we introduce a classification scheme for full-reference and reduced-reference media-layer objective video quality assessment methods. Our classification scheme first classifies a method according to whether natural visual characteristics or perceptual (human visual system) characteristics are considered. We further subclassify natural visual characteristics methods into methods based on natural visual statistics or natural visual features. We subclassify perceptual characteristics methods into frequency- or pixel-domain methods. According to our classification scheme, we comprehensively review and compare the media-layer objective video quality models for both standard resolution and high definition video. We find that the natural visual statistics based MultiScale-Structural SIMilarity index (MS-SSIM), the natural visual feature based Video Quality Metric (VQM), and the perceptual spatio-temporal frequency-domain based MOtion-based Video Integrity Evaluation (MOVIE) index give the best performance for the LIVE Video Quality Database.

KW - Full-reference metric

KW - objective video quality

KW - perceptual video quality

KW - reduced-reference metric

UR - http://www.scopus.com/inward/record.url?scp=79957780748&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=79957780748&partnerID=8YFLogxK

U2 - 10.1109/TBC.2011.2104671

DO - 10.1109/TBC.2011.2104671

M3 - Article

AN - SCOPUS:79957780748

VL - 57

SP - 165

EP - 182

JO - IEEE Transactions on Broadcasting

JF - IEEE Transactions on Broadcasting

SN - 0018-9316

IS - 2 PART 1

M1 - 5710601

ER -