Boosting output distributions in finite blocklength channel coding converse bounds

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Point-to-point channel coding is studied in the finite blocklength regime. Many existing converse bounds involve an optimization over a distribution on the channel output. This paper provides a method for generating good, if not optimal, output distributions. In particular, given any candidate output distribution, a "boosting" procedure is given that constructs a new distribution which improves the converse bound derived from the divergence spectrum. For discrete memoryless channels, it is shown that using the i.i.d. capacity-achieving output distribution as an initial guess in this procedure results in an output distribution that is good enough to derive the third-order coding rate for most channels. The finite blocklengths bounds are then applied to the Z channel.

Original languageEnglish (US)
Title of host publication2015 IEEE Information Theory Workshop, ITW 2015
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Print)9781479955268
DOIs
StatePublished - Jun 24 2015
Event2015 IEEE Information Theory Workshop, ITW 2015 - Jerusalem, Israel
Duration: Apr 26 2015May 1 2015

Other

Other2015 IEEE Information Theory Workshop, ITW 2015
CountryIsrael
CityJerusalem
Period4/26/155/1/15

Fingerprint

Channel coding

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Computer Networks and Communications
  • Information Systems
  • Computational Theory and Mathematics

Cite this

Kosut, O. (2015). Boosting output distributions in finite blocklength channel coding converse bounds. In 2015 IEEE Information Theory Workshop, ITW 2015 [7133158] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ITW.2015.7133158

Boosting output distributions in finite blocklength channel coding converse bounds. / Kosut, Oliver.

2015 IEEE Information Theory Workshop, ITW 2015. Institute of Electrical and Electronics Engineers Inc., 2015. 7133158.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Kosut, O 2015, Boosting output distributions in finite blocklength channel coding converse bounds. in 2015 IEEE Information Theory Workshop, ITW 2015., 7133158, Institute of Electrical and Electronics Engineers Inc., 2015 IEEE Information Theory Workshop, ITW 2015, Jerusalem, Israel, 4/26/15. https://doi.org/10.1109/ITW.2015.7133158
Kosut O. Boosting output distributions in finite blocklength channel coding converse bounds. In 2015 IEEE Information Theory Workshop, ITW 2015. Institute of Electrical and Electronics Engineers Inc. 2015. 7133158 https://doi.org/10.1109/ITW.2015.7133158
Kosut, Oliver. / Boosting output distributions in finite blocklength channel coding converse bounds. 2015 IEEE Information Theory Workshop, ITW 2015. Institute of Electrical and Electronics Engineers Inc., 2015.
@inproceedings{efebc0ad33cd45fe95191cbdea0eceff,
title = "Boosting output distributions in finite blocklength channel coding converse bounds",
abstract = "Point-to-point channel coding is studied in the finite blocklength regime. Many existing converse bounds involve an optimization over a distribution on the channel output. This paper provides a method for generating good, if not optimal, output distributions. In particular, given any candidate output distribution, a {"}boosting{"} procedure is given that constructs a new distribution which improves the converse bound derived from the divergence spectrum. For discrete memoryless channels, it is shown that using the i.i.d. capacity-achieving output distribution as an initial guess in this procedure results in an output distribution that is good enough to derive the third-order coding rate for most channels. The finite blocklengths bounds are then applied to the Z channel.",
author = "Oliver Kosut",
year = "2015",
month = "6",
day = "24",
doi = "10.1109/ITW.2015.7133158",
language = "English (US)",
isbn = "9781479955268",
booktitle = "2015 IEEE Information Theory Workshop, ITW 2015",
publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

TY - GEN

T1 - Boosting output distributions in finite blocklength channel coding converse bounds

AU - Kosut, Oliver

PY - 2015/6/24

Y1 - 2015/6/24

N2 - Point-to-point channel coding is studied in the finite blocklength regime. Many existing converse bounds involve an optimization over a distribution on the channel output. This paper provides a method for generating good, if not optimal, output distributions. In particular, given any candidate output distribution, a "boosting" procedure is given that constructs a new distribution which improves the converse bound derived from the divergence spectrum. For discrete memoryless channels, it is shown that using the i.i.d. capacity-achieving output distribution as an initial guess in this procedure results in an output distribution that is good enough to derive the third-order coding rate for most channels. The finite blocklengths bounds are then applied to the Z channel.

AB - Point-to-point channel coding is studied in the finite blocklength regime. Many existing converse bounds involve an optimization over a distribution on the channel output. This paper provides a method for generating good, if not optimal, output distributions. In particular, given any candidate output distribution, a "boosting" procedure is given that constructs a new distribution which improves the converse bound derived from the divergence spectrum. For discrete memoryless channels, it is shown that using the i.i.d. capacity-achieving output distribution as an initial guess in this procedure results in an output distribution that is good enough to derive the third-order coding rate for most channels. The finite blocklengths bounds are then applied to the Z channel.

UR - http://www.scopus.com/inward/record.url?scp=84938936811&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84938936811&partnerID=8YFLogxK

U2 - 10.1109/ITW.2015.7133158

DO - 10.1109/ITW.2015.7133158

M3 - Conference contribution

SN - 9781479955268

BT - 2015 IEEE Information Theory Workshop, ITW 2015

PB - Institute of Electrical and Electronics Engineers Inc.

ER -