Fundamental limits of universal variable-to-fixed length coding of parametric sources

Nematollah Iri, Oliver Kosut

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Universal variable-to-fixed (V-F) length coding of d-dimensional exponential family of distributions is considered. An achievable scheme is proposed, which consists of a dictionary to parse the source output stream. The previously-introduced notion of quantized type is employed for the dictionary construction. The quantized type class of a sequence is based on partitioning the space of minimal sufficient statistics into cuboids. The proposed dictionary consists of sequences in the boundaries of transition from low to high quantized type class size. Asymptotics of the -coding rate of the proposed coding scheme for large enough dictionaries is derived. In particular, we show that the third-order coding rate of the proposed scheme is H d/2 log log M/log M, where H is the entropy of the source and M is the dictionary size. We further provide a converse, showing that this rate is optimal up to the third-order term.

Original languageEnglish (US)
Title of host publication55th Annual Allerton Conference on Communication, Control, and Computing, Allerton 2017
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages31-37
Number of pages7
ISBN (Electronic)9781538632666
DOIs
StatePublished - Jul 1 2017
Event55th Annual Allerton Conference on Communication, Control, and Computing, Allerton 2017 - Monticello, United States
Duration: Oct 3 2017Oct 6 2017

Publication series

Name55th Annual Allerton Conference on Communication, Control, and Computing, Allerton 2017
Volume2018-January

Other

Other55th Annual Allerton Conference on Communication, Control, and Computing, Allerton 2017
CountryUnited States
CityMonticello
Period10/3/1710/6/17

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Hardware and Architecture
  • Signal Processing
  • Energy Engineering and Power Technology
  • Control and Optimization

Fingerprint Dive into the research topics of 'Fundamental limits of universal variable-to-fixed length coding of parametric sources'. Together they form a unique fingerprint.

  • Cite this

    Iri, N., & Kosut, O. (2017). Fundamental limits of universal variable-to-fixed length coding of parametric sources. In 55th Annual Allerton Conference on Communication, Control, and Computing, Allerton 2017 (pp. 31-37). (55th Annual Allerton Conference on Communication, Control, and Computing, Allerton 2017; Vol. 2018-January). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ALLERTON.2017.8262715