Third-order coding rate for universal compression of Markov sources

Nematollah Iri, Oliver Kosut

Research output: Chapter in Book/Report/Conference proceedingConference contribution

12 Citations (Scopus)

Abstract

We consider the universal source coding problem for first-order stationary, irreducible and aperiodic Markov sources for short blocklengths. Achievability is derived based on the previously introduced algorithm for universal compression of memoryless sources in the finite blocklengths, the Type Size Code, which encodes strings based on type class size. We derive the third-order asymptotic coding rate of the Type Size code for this model class. We also present a converse on the third-order coding rate for the general class of fixed-to-variable codes and show the optimality of Type Size codes for such Markov sources.

Original languageEnglish (US)
Title of host publicationIEEE International Symposium on Information Theory - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1996-2000
Number of pages5
Volume2015-June
ISBN (Print)9781467377041
DOIs
StatePublished - Sep 28 2015
EventIEEE International Symposium on Information Theory, ISIT 2015 - Hong Kong, Hong Kong
Duration: Jun 14 2015Jun 19 2015

Other

OtherIEEE International Symposium on Information Theory, ISIT 2015
CountryHong Kong
CityHong Kong
Period6/14/156/19/15

Fingerprint

Compression
Coding
Source Coding
Converse
Optimality
Strings
First-order
Class
Model

Keywords

  • Data compression
  • finite blocklengh analysis
  • Markov sources
  • third-order coding rate
  • universal source coding

ASJC Scopus subject areas

  • Applied Mathematics
  • Modeling and Simulation
  • Theoretical Computer Science
  • Information Systems

Cite this

Iri, N., & Kosut, O. (2015). Third-order coding rate for universal compression of Markov sources. In IEEE International Symposium on Information Theory - Proceedings (Vol. 2015-June, pp. 1996-2000). [7282805] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ISIT.2015.7282805

Third-order coding rate for universal compression of Markov sources. / Iri, Nematollah; Kosut, Oliver.

IEEE International Symposium on Information Theory - Proceedings. Vol. 2015-June Institute of Electrical and Electronics Engineers Inc., 2015. p. 1996-2000 7282805.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Iri, N & Kosut, O 2015, Third-order coding rate for universal compression of Markov sources. in IEEE International Symposium on Information Theory - Proceedings. vol. 2015-June, 7282805, Institute of Electrical and Electronics Engineers Inc., pp. 1996-2000, IEEE International Symposium on Information Theory, ISIT 2015, Hong Kong, Hong Kong, 6/14/15. https://doi.org/10.1109/ISIT.2015.7282805
Iri N, Kosut O. Third-order coding rate for universal compression of Markov sources. In IEEE International Symposium on Information Theory - Proceedings. Vol. 2015-June. Institute of Electrical and Electronics Engineers Inc. 2015. p. 1996-2000. 7282805 https://doi.org/10.1109/ISIT.2015.7282805
Iri, Nematollah ; Kosut, Oliver. / Third-order coding rate for universal compression of Markov sources. IEEE International Symposium on Information Theory - Proceedings. Vol. 2015-June Institute of Electrical and Electronics Engineers Inc., 2015. pp. 1996-2000
@inproceedings{17061f9cac04444595f6193c99a42467,
title = "Third-order coding rate for universal compression of Markov sources",
abstract = "We consider the universal source coding problem for first-order stationary, irreducible and aperiodic Markov sources for short blocklengths. Achievability is derived based on the previously introduced algorithm for universal compression of memoryless sources in the finite blocklengths, the Type Size Code, which encodes strings based on type class size. We derive the third-order asymptotic coding rate of the Type Size code for this model class. We also present a converse on the third-order coding rate for the general class of fixed-to-variable codes and show the optimality of Type Size codes for such Markov sources.",
keywords = "Data compression, finite blocklengh analysis, Markov sources, third-order coding rate, universal source coding",
author = "Nematollah Iri and Oliver Kosut",
year = "2015",
month = "9",
day = "28",
doi = "10.1109/ISIT.2015.7282805",
language = "English (US)",
isbn = "9781467377041",
volume = "2015-June",
pages = "1996--2000",
booktitle = "IEEE International Symposium on Information Theory - Proceedings",
publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

TY - GEN

T1 - Third-order coding rate for universal compression of Markov sources

AU - Iri, Nematollah

AU - Kosut, Oliver

PY - 2015/9/28

Y1 - 2015/9/28

N2 - We consider the universal source coding problem for first-order stationary, irreducible and aperiodic Markov sources for short blocklengths. Achievability is derived based on the previously introduced algorithm for universal compression of memoryless sources in the finite blocklengths, the Type Size Code, which encodes strings based on type class size. We derive the third-order asymptotic coding rate of the Type Size code for this model class. We also present a converse on the third-order coding rate for the general class of fixed-to-variable codes and show the optimality of Type Size codes for such Markov sources.

AB - We consider the universal source coding problem for first-order stationary, irreducible and aperiodic Markov sources for short blocklengths. Achievability is derived based on the previously introduced algorithm for universal compression of memoryless sources in the finite blocklengths, the Type Size Code, which encodes strings based on type class size. We derive the third-order asymptotic coding rate of the Type Size code for this model class. We also present a converse on the third-order coding rate for the general class of fixed-to-variable codes and show the optimality of Type Size codes for such Markov sources.

KW - Data compression

KW - finite blocklengh analysis

KW - Markov sources

KW - third-order coding rate

KW - universal source coding

UR - http://www.scopus.com/inward/record.url?scp=84969895471&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84969895471&partnerID=8YFLogxK

U2 - 10.1109/ISIT.2015.7282805

DO - 10.1109/ISIT.2015.7282805

M3 - Conference contribution

AN - SCOPUS:84969895471

SN - 9781467377041

VL - 2015-June

SP - 1996

EP - 2000

BT - IEEE International Symposium on Information Theory - Proceedings

PB - Institute of Electrical and Electronics Engineers Inc.

ER -