On the minimization of glass-to-glass and glass-to-algorithm delay in video communication

Christoph Bachhuber; Eckehard Steinbach; Martin Freundl; Martin Reisslein

doi:10.1109/TMM.2017.2726189

On the minimization of glass-to-glass and glass-to-algorithm delay in video communication

Christoph Bachhuber, Eckehard Steinbach, Martin Freundl, Martin Reisslein

Research output: Contribution to journal › Article › peer-review

25 Scopus citations

Abstract

Video cameras are increasingly used to provide real-time feedback in automatic control systems, such as autonomous driving and robotics systems. For such highly dynamic applications, the glass-to-glass (G2G) and glass-to-algorithm (G2A) latencies are critical. In this paper, we analyze the latencies in a point-to-point video transmission system and propose novel frame skipping and preemption approaches to reduce the G2G and G2A delays. We implement the proposed approaches in a prototype that shows significantly reduced G2G and G2A latencies as well as reduced transmission bitrate requirements compared with traditional video transmission schemes. In our low-delay video communication prototype, a VGA resolution video is transmitted with averageG2Gand G2A delays of 21.2 and 11.5 ms, respectively, with off-the-shelf hardware.

Original language	English (US)
Pages (from-to)	238-252
Number of pages	15
Journal	IEEE Transactions on Multimedia
Volume	20
Issue number	1
DOIs	https://doi.org/10.1109/TMM.2017.2726189
State	Published - Jan 2018

Keywords

Delay analysis
Delay measurement
Frame skipping
Preemption
Prototype system

ASJC Scopus subject areas

Signal Processing
Media Technology
Computer Science Applications
Electrical and Electronic Engineering

Access to Document

10.1109/TMM.2017.2726189

Cite this

@article{8d8ad5d927604c26991e4ac78ba57946,

title = "On the minimization of glass-to-glass and glass-to-algorithm delay in video communication",

abstract = "Video cameras are increasingly used to provide real-time feedback in automatic control systems, such as autonomous driving and robotics systems. For such highly dynamic applications, the glass-to-glass (G2G) and glass-to-algorithm (G2A) latencies are critical. In this paper, we analyze the latencies in a point-to-point video transmission system and propose novel frame skipping and preemption approaches to reduce the G2G and G2A delays. We implement the proposed approaches in a prototype that shows significantly reduced G2G and G2A latencies as well as reduced transmission bitrate requirements compared with traditional video transmission schemes. In our low-delay video communication prototype, a VGA resolution video is transmitted with averageG2Gand G2A delays of 21.2 and 11.5 ms, respectively, with off-the-shelf hardware.",

keywords = "Delay analysis, Delay measurement, Frame skipping, Preemption, Prototype system",

author = "Christoph Bachhuber and Eckehard Steinbach and Martin Freundl and Martin Reisslein",

note = "Publisher Copyright: {\textcopyright} 2017 IEEE. Personal use is permitted.",

year = "2018",

month = jan,

doi = "10.1109/TMM.2017.2726189",

language = "English (US)",

volume = "20",

pages = "238--252",

journal = "IEEE Transactions on Multimedia",

issn = "1520-9210",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

number = "1",

}

TY - JOUR

T1 - On the minimization of glass-to-glass and glass-to-algorithm delay in video communication

AU - Bachhuber, Christoph

AU - Steinbach, Eckehard

AU - Freundl, Martin

AU - Reisslein, Martin

PY - 2018/1

Y1 - 2018/1

N2 - Video cameras are increasingly used to provide real-time feedback in automatic control systems, such as autonomous driving and robotics systems. For such highly dynamic applications, the glass-to-glass (G2G) and glass-to-algorithm (G2A) latencies are critical. In this paper, we analyze the latencies in a point-to-point video transmission system and propose novel frame skipping and preemption approaches to reduce the G2G and G2A delays. We implement the proposed approaches in a prototype that shows significantly reduced G2G and G2A latencies as well as reduced transmission bitrate requirements compared with traditional video transmission schemes. In our low-delay video communication prototype, a VGA resolution video is transmitted with averageG2Gand G2A delays of 21.2 and 11.5 ms, respectively, with off-the-shelf hardware.

AB - Video cameras are increasingly used to provide real-time feedback in automatic control systems, such as autonomous driving and robotics systems. For such highly dynamic applications, the glass-to-glass (G2G) and glass-to-algorithm (G2A) latencies are critical. In this paper, we analyze the latencies in a point-to-point video transmission system and propose novel frame skipping and preemption approaches to reduce the G2G and G2A delays. We implement the proposed approaches in a prototype that shows significantly reduced G2G and G2A latencies as well as reduced transmission bitrate requirements compared with traditional video transmission schemes. In our low-delay video communication prototype, a VGA resolution video is transmitted with averageG2Gand G2A delays of 21.2 and 11.5 ms, respectively, with off-the-shelf hardware.

KW - Delay analysis

KW - Delay measurement

KW - Frame skipping

KW - Preemption

KW - Prototype system

UR - http://www.scopus.com/inward/record.url?scp=85023645352&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85023645352&partnerID=8YFLogxK

U2 - 10.1109/TMM.2017.2726189

DO - 10.1109/TMM.2017.2726189

M3 - Article

AN - SCOPUS:85023645352

SN - 1520-9210

VL - 20

SP - 238

EP - 252

JO - IEEE Transactions on Multimedia

JF - IEEE Transactions on Multimedia

IS - 1

ER -

On the minimization of glass-to-glass and glass-to-algorithm delay in video communication

Abstract

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this