Adaptive bitstream switching of scalable video

Osama A. Lotfallah, Geert Van der Auwera, Martin Reisslein

Research output: Contribution to journalArticle

3 Citations (Scopus)

Abstract

With scalable video coding that provides fine-granular quality degradation, such as fine granularity scalability (FGS) and progressive FGS (PFGS), or H.264 scalable video coding's (SVC) adaptive reference FGS (AR-FGS) coding, video can flexibly be streamed to receivers of heterogeneous bandwidths. However, the transmitted video is only efficiently encoded when the transmission bit rate is in the vicinity of the encoding bit rate. In this paper, we develop and evaluate a comprehensive suite of network-aware adaptive bitstream switching policies for point-to-point and point-to-multipoint streaming of fine granular scalable coded video to address this coding efficiency issue. Our approach stores a small number of encodings (versions) with different encoding bit rates for each video sequence and estimates the reconstructed quality using the motion activity levels of the underlying visual content (or, in general, any content descriptor(s) that highly correlate with the reconstructed quality). For unicast streaming, we then: (i) adaptively switch between the different encodings at the server, to improve the reconstructed video quality and (ii) adaptively drop packets during network congestion to ensure fairness between multiple unicast streams. For multicast streaming, we also adaptively switch between the different encodings to maximize the average video quality. Our adaptive bitstream switching policies consider the visual content descriptors as well as the network channel variability, while requiring only sample points from the rate-distortion curve of the video stream. From our extensive simulations with PFGS coding, we find that our adaptive unicast bitstream switching policy achieves on average a 0.8 dB improvement over the optimal non-adaptive streaming for a diverse 200-shot sequence from Star Wars IV. We have also verified our key findings with the latest scalable video coding standard, H.264 SVC.

Original languageEnglish (US)
Pages (from-to)809-832
Number of pages24
JournalSignal Processing: Image Communication
Volume22
Issue number10
DOIs
StatePublished - Nov 2007

Fingerprint

Scalable video coding
Scalability
Switches
Packet networks
Image coding
Stars
Servers
Bandwidth
Degradation

Keywords

  • Adaptive streaming
  • Congestion control
  • Motion activity
  • Multicast
  • PFGS
  • Simulcast
  • SVC AR-FGS

ASJC Scopus subject areas

  • Computer Vision and Pattern Recognition
  • Signal Processing
  • Electrical and Electronic Engineering

Cite this

Adaptive bitstream switching of scalable video. / Lotfallah, Osama A.; Van der Auwera, Geert; Reisslein, Martin.

In: Signal Processing: Image Communication, Vol. 22, No. 10, 11.2007, p. 809-832.

Research output: Contribution to journalArticle

Lotfallah, Osama A. ; Van der Auwera, Geert ; Reisslein, Martin. / Adaptive bitstream switching of scalable video. In: Signal Processing: Image Communication. 2007 ; Vol. 22, No. 10. pp. 809-832.
@article{8f975227605e4e5184fee521eeda2366,
title = "Adaptive bitstream switching of scalable video",
abstract = "With scalable video coding that provides fine-granular quality degradation, such as fine granularity scalability (FGS) and progressive FGS (PFGS), or H.264 scalable video coding's (SVC) adaptive reference FGS (AR-FGS) coding, video can flexibly be streamed to receivers of heterogeneous bandwidths. However, the transmitted video is only efficiently encoded when the transmission bit rate is in the vicinity of the encoding bit rate. In this paper, we develop and evaluate a comprehensive suite of network-aware adaptive bitstream switching policies for point-to-point and point-to-multipoint streaming of fine granular scalable coded video to address this coding efficiency issue. Our approach stores a small number of encodings (versions) with different encoding bit rates for each video sequence and estimates the reconstructed quality using the motion activity levels of the underlying visual content (or, in general, any content descriptor(s) that highly correlate with the reconstructed quality). For unicast streaming, we then: (i) adaptively switch between the different encodings at the server, to improve the reconstructed video quality and (ii) adaptively drop packets during network congestion to ensure fairness between multiple unicast streams. For multicast streaming, we also adaptively switch between the different encodings to maximize the average video quality. Our adaptive bitstream switching policies consider the visual content descriptors as well as the network channel variability, while requiring only sample points from the rate-distortion curve of the video stream. From our extensive simulations with PFGS coding, we find that our adaptive unicast bitstream switching policy achieves on average a 0.8 dB improvement over the optimal non-adaptive streaming for a diverse 200-shot sequence from Star Wars IV. We have also verified our key findings with the latest scalable video coding standard, H.264 SVC.",
keywords = "Adaptive streaming, Congestion control, Motion activity, Multicast, PFGS, Simulcast, SVC AR-FGS",
author = "Lotfallah, {Osama A.} and {Van der Auwera}, Geert and Martin Reisslein",
year = "2007",
month = "11",
doi = "10.1016/j.image.2007.06.002",
language = "English (US)",
volume = "22",
pages = "809--832",
journal = "Signal Processing: Image Communication",
issn = "0923-5965",
publisher = "Elsevier",
number = "10",

}

TY - JOUR

T1 - Adaptive bitstream switching of scalable video

AU - Lotfallah, Osama A.

AU - Van der Auwera, Geert

AU - Reisslein, Martin

PY - 2007/11

Y1 - 2007/11

N2 - With scalable video coding that provides fine-granular quality degradation, such as fine granularity scalability (FGS) and progressive FGS (PFGS), or H.264 scalable video coding's (SVC) adaptive reference FGS (AR-FGS) coding, video can flexibly be streamed to receivers of heterogeneous bandwidths. However, the transmitted video is only efficiently encoded when the transmission bit rate is in the vicinity of the encoding bit rate. In this paper, we develop and evaluate a comprehensive suite of network-aware adaptive bitstream switching policies for point-to-point and point-to-multipoint streaming of fine granular scalable coded video to address this coding efficiency issue. Our approach stores a small number of encodings (versions) with different encoding bit rates for each video sequence and estimates the reconstructed quality using the motion activity levels of the underlying visual content (or, in general, any content descriptor(s) that highly correlate with the reconstructed quality). For unicast streaming, we then: (i) adaptively switch between the different encodings at the server, to improve the reconstructed video quality and (ii) adaptively drop packets during network congestion to ensure fairness between multiple unicast streams. For multicast streaming, we also adaptively switch between the different encodings to maximize the average video quality. Our adaptive bitstream switching policies consider the visual content descriptors as well as the network channel variability, while requiring only sample points from the rate-distortion curve of the video stream. From our extensive simulations with PFGS coding, we find that our adaptive unicast bitstream switching policy achieves on average a 0.8 dB improvement over the optimal non-adaptive streaming for a diverse 200-shot sequence from Star Wars IV. We have also verified our key findings with the latest scalable video coding standard, H.264 SVC.

AB - With scalable video coding that provides fine-granular quality degradation, such as fine granularity scalability (FGS) and progressive FGS (PFGS), or H.264 scalable video coding's (SVC) adaptive reference FGS (AR-FGS) coding, video can flexibly be streamed to receivers of heterogeneous bandwidths. However, the transmitted video is only efficiently encoded when the transmission bit rate is in the vicinity of the encoding bit rate. In this paper, we develop and evaluate a comprehensive suite of network-aware adaptive bitstream switching policies for point-to-point and point-to-multipoint streaming of fine granular scalable coded video to address this coding efficiency issue. Our approach stores a small number of encodings (versions) with different encoding bit rates for each video sequence and estimates the reconstructed quality using the motion activity levels of the underlying visual content (or, in general, any content descriptor(s) that highly correlate with the reconstructed quality). For unicast streaming, we then: (i) adaptively switch between the different encodings at the server, to improve the reconstructed video quality and (ii) adaptively drop packets during network congestion to ensure fairness between multiple unicast streams. For multicast streaming, we also adaptively switch between the different encodings to maximize the average video quality. Our adaptive bitstream switching policies consider the visual content descriptors as well as the network channel variability, while requiring only sample points from the rate-distortion curve of the video stream. From our extensive simulations with PFGS coding, we find that our adaptive unicast bitstream switching policy achieves on average a 0.8 dB improvement over the optimal non-adaptive streaming for a diverse 200-shot sequence from Star Wars IV. We have also verified our key findings with the latest scalable video coding standard, H.264 SVC.

KW - Adaptive streaming

KW - Congestion control

KW - Motion activity

KW - Multicast

KW - PFGS

KW - Simulcast

KW - SVC AR-FGS

UR - http://www.scopus.com/inward/record.url?scp=35648974686&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=35648974686&partnerID=8YFLogxK

U2 - 10.1016/j.image.2007.06.002

DO - 10.1016/j.image.2007.06.002

M3 - Article

AN - SCOPUS:35648974686

VL - 22

SP - 809

EP - 832

JO - Signal Processing: Image Communication

JF - Signal Processing: Image Communication

SN - 0923-5965

IS - 10

ER -