Boosting output distributions in finite blocklength channel coding converse bounds

Oliver Kosut

doi:10.1109/ITW.2015.7133158

Boosting output distributions in finite blocklength channel coding converse bounds

Oliver Kosut

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

1 Scopus citations

Abstract

Point-to-point channel coding is studied in the finite blocklength regime. Many existing converse bounds involve an optimization over a distribution on the channel output. This paper provides a method for generating good, if not optimal, output distributions. In particular, given any candidate output distribution, a "boosting" procedure is given that constructs a new distribution which improves the converse bound derived from the divergence spectrum. For discrete memoryless channels, it is shown that using the i.i.d. capacity-achieving output distribution as an initial guess in this procedure results in an output distribution that is good enough to derive the third-order coding rate for most channels. The finite blocklengths bounds are then applied to the Z channel.

Original language	English (US)
Title of host publication	2015 IEEE Information Theory Workshop, ITW 2015
Publisher	Institute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)	9781479955268
DOIs	https://doi.org/10.1109/ITW.2015.7133158
State	Published - Jun 24 2015
Event	2015 IEEE Information Theory Workshop, ITW 2015 - Jerusalem, Israel Duration: Apr 26 2015 → May 1 2015

Publication series

Name	2015 IEEE Information Theory Workshop, ITW 2015

Other

Other	2015 IEEE Information Theory Workshop, ITW 2015
Country/Territory	Israel
City	Jerusalem
Period	4/26/15 → 5/1/15

ASJC Scopus subject areas

Electrical and Electronic Engineering
Computer Networks and Communications
Information Systems
Computational Theory and Mathematics

Access to Document

10.1109/ITW.2015.7133158

Cite this

Kosut, O 2015, Boosting output distributions in finite blocklength channel coding converse bounds. in 2015 IEEE Information Theory Workshop, ITW 2015., 7133158, 2015 IEEE Information Theory Workshop, ITW 2015, Institute of Electrical and Electronics Engineers Inc., 2015 IEEE Information Theory Workshop, ITW 2015, Jerusalem, Israel, 4/26/15. https://doi.org/10.1109/ITW.2015.7133158

@inproceedings{efebc0ad33cd45fe95191cbdea0eceff,

title = "Boosting output distributions in finite blocklength channel coding converse bounds",

abstract = "Point-to-point channel coding is studied in the finite blocklength regime. Many existing converse bounds involve an optimization over a distribution on the channel output. This paper provides a method for generating good, if not optimal, output distributions. In particular, given any candidate output distribution, a {"}boosting{"} procedure is given that constructs a new distribution which improves the converse bound derived from the divergence spectrum. For discrete memoryless channels, it is shown that using the i.i.d. capacity-achieving output distribution as an initial guess in this procedure results in an output distribution that is good enough to derive the third-order coding rate for most channels. The finite blocklengths bounds are then applied to the Z channel.",

author = "Oliver Kosut",

note = "Publisher Copyright: {\textcopyright} 2015 IEEE.; 2015 IEEE Information Theory Workshop, ITW 2015 ; Conference date: 26-04-2015 Through 01-05-2015",

year = "2015",

month = jun,

day = "24",

doi = "10.1109/ITW.2015.7133158",

language = "English (US)",

series = "2015 IEEE Information Theory Workshop, ITW 2015",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

booktitle = "2015 IEEE Information Theory Workshop, ITW 2015",

}

TY - GEN

T1 - Boosting output distributions in finite blocklength channel coding converse bounds

AU - Kosut, Oliver

PY - 2015/6/24

Y1 - 2015/6/24

N2 - Point-to-point channel coding is studied in the finite blocklength regime. Many existing converse bounds involve an optimization over a distribution on the channel output. This paper provides a method for generating good, if not optimal, output distributions. In particular, given any candidate output distribution, a "boosting" procedure is given that constructs a new distribution which improves the converse bound derived from the divergence spectrum. For discrete memoryless channels, it is shown that using the i.i.d. capacity-achieving output distribution as an initial guess in this procedure results in an output distribution that is good enough to derive the third-order coding rate for most channels. The finite blocklengths bounds are then applied to the Z channel.

AB - Point-to-point channel coding is studied in the finite blocklength regime. Many existing converse bounds involve an optimization over a distribution on the channel output. This paper provides a method for generating good, if not optimal, output distributions. In particular, given any candidate output distribution, a "boosting" procedure is given that constructs a new distribution which improves the converse bound derived from the divergence spectrum. For discrete memoryless channels, it is shown that using the i.i.d. capacity-achieving output distribution as an initial guess in this procedure results in an output distribution that is good enough to derive the third-order coding rate for most channels. The finite blocklengths bounds are then applied to the Z channel.

UR - http://www.scopus.com/inward/record.url?scp=84938936811&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84938936811&partnerID=8YFLogxK

U2 - 10.1109/ITW.2015.7133158

DO - 10.1109/ITW.2015.7133158

M3 - Conference contribution

AN - SCOPUS:84938936811

T3 - 2015 IEEE Information Theory Workshop, ITW 2015

BT - 2015 IEEE Information Theory Workshop, ITW 2015

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 2015 IEEE Information Theory Workshop, ITW 2015

Y2 - 26 April 2015 through 1 May 2015

ER -

Boosting output distributions in finite blocklength channel coding converse bounds

Abstract

Publication series

Other

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this