A new Type Size code for universal one-to-one compression of parametric sources

Nematollah Iri, Oliver Kosut

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)

Abstract

We consider universal source coding of an exponential family of i.i.d. distributions for short blocklengths. We present a variation of the previously introduced Type Size code, in which type classes are characterized based on the neighborhoods of the minimal sufficient statistics. We show that, there is no loss in dispersion compared to the non-universal setup. We identify the third-order coding rate of this variation of the Type Size code for compression of such parametric sources.

Original languageEnglish (US)
Title of host publicationProceedings - ISIT 2016; 2016 IEEE International Symposium on Information Theory
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1227-1231
Number of pages5
Volume2016-August
ISBN (Electronic)9781509018062
DOIs
StatePublished - Aug 10 2016
Event2016 IEEE International Symposium on Information Theory, ISIT 2016 - Barcelona, Spain
Duration: Jul 10 2016Jul 15 2016

Other

Other2016 IEEE International Symposium on Information Theory, ISIT 2016
CountrySpain
CityBarcelona
Period7/10/167/15/16

Fingerprint

Compression
Statistics
Source Coding
Sufficient Statistics
Exponential Family
Coding
Class

Keywords

  • Data compression
  • finite blocklength analysis
  • parametric sources
  • universal source coding

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Information Systems
  • Modeling and Simulation
  • Applied Mathematics

Cite this

Iri, N., & Kosut, O. (2016). A new Type Size code for universal one-to-one compression of parametric sources. In Proceedings - ISIT 2016; 2016 IEEE International Symposium on Information Theory (Vol. 2016-August, pp. 1227-1231). [7541494] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ISIT.2016.7541494

A new Type Size code for universal one-to-one compression of parametric sources. / Iri, Nematollah; Kosut, Oliver.

Proceedings - ISIT 2016; 2016 IEEE International Symposium on Information Theory. Vol. 2016-August Institute of Electrical and Electronics Engineers Inc., 2016. p. 1227-1231 7541494.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Iri, N & Kosut, O 2016, A new Type Size code for universal one-to-one compression of parametric sources. in Proceedings - ISIT 2016; 2016 IEEE International Symposium on Information Theory. vol. 2016-August, 7541494, Institute of Electrical and Electronics Engineers Inc., pp. 1227-1231, 2016 IEEE International Symposium on Information Theory, ISIT 2016, Barcelona, Spain, 7/10/16. https://doi.org/10.1109/ISIT.2016.7541494
Iri N, Kosut O. A new Type Size code for universal one-to-one compression of parametric sources. In Proceedings - ISIT 2016; 2016 IEEE International Symposium on Information Theory. Vol. 2016-August. Institute of Electrical and Electronics Engineers Inc. 2016. p. 1227-1231. 7541494 https://doi.org/10.1109/ISIT.2016.7541494
Iri, Nematollah ; Kosut, Oliver. / A new Type Size code for universal one-to-one compression of parametric sources. Proceedings - ISIT 2016; 2016 IEEE International Symposium on Information Theory. Vol. 2016-August Institute of Electrical and Electronics Engineers Inc., 2016. pp. 1227-1231
@inproceedings{36abccafc24a49ff9fc94d6cffa96f32,
title = "A new Type Size code for universal one-to-one compression of parametric sources",
abstract = "We consider universal source coding of an exponential family of i.i.d. distributions for short blocklengths. We present a variation of the previously introduced Type Size code, in which type classes are characterized based on the neighborhoods of the minimal sufficient statistics. We show that, there is no loss in dispersion compared to the non-universal setup. We identify the third-order coding rate of this variation of the Type Size code for compression of such parametric sources.",
keywords = "Data compression, finite blocklength analysis, parametric sources, universal source coding",
author = "Nematollah Iri and Oliver Kosut",
year = "2016",
month = "8",
day = "10",
doi = "10.1109/ISIT.2016.7541494",
language = "English (US)",
volume = "2016-August",
pages = "1227--1231",
booktitle = "Proceedings - ISIT 2016; 2016 IEEE International Symposium on Information Theory",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
address = "United States",

}

TY - GEN

T1 - A new Type Size code for universal one-to-one compression of parametric sources

AU - Iri, Nematollah

AU - Kosut, Oliver

PY - 2016/8/10

Y1 - 2016/8/10

N2 - We consider universal source coding of an exponential family of i.i.d. distributions for short blocklengths. We present a variation of the previously introduced Type Size code, in which type classes are characterized based on the neighborhoods of the minimal sufficient statistics. We show that, there is no loss in dispersion compared to the non-universal setup. We identify the third-order coding rate of this variation of the Type Size code for compression of such parametric sources.

AB - We consider universal source coding of an exponential family of i.i.d. distributions for short blocklengths. We present a variation of the previously introduced Type Size code, in which type classes are characterized based on the neighborhoods of the minimal sufficient statistics. We show that, there is no loss in dispersion compared to the non-universal setup. We identify the third-order coding rate of this variation of the Type Size code for compression of such parametric sources.

KW - Data compression

KW - finite blocklength analysis

KW - parametric sources

KW - universal source coding

UR - http://www.scopus.com/inward/record.url?scp=84985995874&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84985995874&partnerID=8YFLogxK

U2 - 10.1109/ISIT.2016.7541494

DO - 10.1109/ISIT.2016.7541494

M3 - Conference contribution

VL - 2016-August

SP - 1227

EP - 1231

BT - Proceedings - ISIT 2016; 2016 IEEE International Symposium on Information Theory

PB - Institute of Electrical and Electronics Engineers Inc.

ER -