Mutual information analysis of JPEG2000 contexts

Zhen Liu, Lina Karam

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Context-based arithmetic coding has been widely adopted in image and video compression and is a key component of the new JPEG2000 image compression standard. In this paper, the contexts used in JPEG2000 are analyzed using the mutual information, which has a direct link with the compression performance. We first show that, when combining the contexts, the mutual information between the contexts and the encoded data will decrease unless the conditional probability distributions of the combined contexts are the same. Given I, the initial number of contexts, and F, the final desired number of contexts, there are S(I,F) possible context classification schemes where S(I,F) is called the Stirling number of the second kind. The optimal classification scheme is the one that gives the maximum mutual information. Instead of exhaustive search, the optimal classification scheme can be obtained through a modified Generalized Llyod algorithm with the relative entropy as the distortion metric. For binary arithmetic coding, the search complexity can be reduced by using the dynamic programming. Our experimental results show that the JPEG2000 contexts capture very well the correlations among the wavelet coefficients. At the same time, the number of contexts used as part of the standard can be reduced without loss in the coding performance.

Original languageEnglish (US)
Title of host publicationProceedings of SPIE - The International Society for Optical Engineering
EditorsB. Vasudev, T.R. Hsing, A.G. Tescher, T. Ebrahimi
Pages573-582
Number of pages10
Volume5022 I
DOIs
StatePublished - 2003
EventImage and Video Communications and Processing 2003 - Santa Clara, CA, United States
Duration: Jan 21 2003Jan 24 2003

Other

OtherImage and Video Communications and Processing 2003
CountryUnited States
CitySanta Clara, CA
Period1/21/031/24/03

Fingerprint

information analysis
Information analysis
Image compression
Dynamic programming
Probability distributions
Entropy
coding
dynamic programming
video compression
entropy

Keywords

  • Context based arithmetic coding
  • Image compression
  • JPEG2000
  • Mutual information

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Condensed Matter Physics

Cite this

Liu, Z., & Karam, L. (2003). Mutual information analysis of JPEG2000 contexts. In B. Vasudev, T. R. Hsing, A. G. Tescher, & T. Ebrahimi (Eds.), Proceedings of SPIE - The International Society for Optical Engineering (Vol. 5022 I, pp. 573-582) https://doi.org/10.1117/12.476620

Mutual information analysis of JPEG2000 contexts. / Liu, Zhen; Karam, Lina.

Proceedings of SPIE - The International Society for Optical Engineering. ed. / B. Vasudev; T.R. Hsing; A.G. Tescher; T. Ebrahimi. Vol. 5022 I 2003. p. 573-582.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Liu, Z & Karam, L 2003, Mutual information analysis of JPEG2000 contexts. in B Vasudev, TR Hsing, AG Tescher & T Ebrahimi (eds), Proceedings of SPIE - The International Society for Optical Engineering. vol. 5022 I, pp. 573-582, Image and Video Communications and Processing 2003, Santa Clara, CA, United States, 1/21/03. https://doi.org/10.1117/12.476620
Liu Z, Karam L. Mutual information analysis of JPEG2000 contexts. In Vasudev B, Hsing TR, Tescher AG, Ebrahimi T, editors, Proceedings of SPIE - The International Society for Optical Engineering. Vol. 5022 I. 2003. p. 573-582 https://doi.org/10.1117/12.476620
Liu, Zhen ; Karam, Lina. / Mutual information analysis of JPEG2000 contexts. Proceedings of SPIE - The International Society for Optical Engineering. editor / B. Vasudev ; T.R. Hsing ; A.G. Tescher ; T. Ebrahimi. Vol. 5022 I 2003. pp. 573-582
@inproceedings{da821a936e2b4da196ce51b2053f1a97,
title = "Mutual information analysis of JPEG2000 contexts",
abstract = "Context-based arithmetic coding has been widely adopted in image and video compression and is a key component of the new JPEG2000 image compression standard. In this paper, the contexts used in JPEG2000 are analyzed using the mutual information, which has a direct link with the compression performance. We first show that, when combining the contexts, the mutual information between the contexts and the encoded data will decrease unless the conditional probability distributions of the combined contexts are the same. Given I, the initial number of contexts, and F, the final desired number of contexts, there are S(I,F) possible context classification schemes where S(I,F) is called the Stirling number of the second kind. The optimal classification scheme is the one that gives the maximum mutual information. Instead of exhaustive search, the optimal classification scheme can be obtained through a modified Generalized Llyod algorithm with the relative entropy as the distortion metric. For binary arithmetic coding, the search complexity can be reduced by using the dynamic programming. Our experimental results show that the JPEG2000 contexts capture very well the correlations among the wavelet coefficients. At the same time, the number of contexts used as part of the standard can be reduced without loss in the coding performance.",
keywords = "Context based arithmetic coding, Image compression, JPEG2000, Mutual information",
author = "Zhen Liu and Lina Karam",
year = "2003",
doi = "10.1117/12.476620",
language = "English (US)",
volume = "5022 I",
pages = "573--582",
editor = "B. Vasudev and T.R. Hsing and A.G. Tescher and T. Ebrahimi",
booktitle = "Proceedings of SPIE - The International Society for Optical Engineering",

}

TY - GEN

T1 - Mutual information analysis of JPEG2000 contexts

AU - Liu, Zhen

AU - Karam, Lina

PY - 2003

Y1 - 2003

N2 - Context-based arithmetic coding has been widely adopted in image and video compression and is a key component of the new JPEG2000 image compression standard. In this paper, the contexts used in JPEG2000 are analyzed using the mutual information, which has a direct link with the compression performance. We first show that, when combining the contexts, the mutual information between the contexts and the encoded data will decrease unless the conditional probability distributions of the combined contexts are the same. Given I, the initial number of contexts, and F, the final desired number of contexts, there are S(I,F) possible context classification schemes where S(I,F) is called the Stirling number of the second kind. The optimal classification scheme is the one that gives the maximum mutual information. Instead of exhaustive search, the optimal classification scheme can be obtained through a modified Generalized Llyod algorithm with the relative entropy as the distortion metric. For binary arithmetic coding, the search complexity can be reduced by using the dynamic programming. Our experimental results show that the JPEG2000 contexts capture very well the correlations among the wavelet coefficients. At the same time, the number of contexts used as part of the standard can be reduced without loss in the coding performance.

AB - Context-based arithmetic coding has been widely adopted in image and video compression and is a key component of the new JPEG2000 image compression standard. In this paper, the contexts used in JPEG2000 are analyzed using the mutual information, which has a direct link with the compression performance. We first show that, when combining the contexts, the mutual information between the contexts and the encoded data will decrease unless the conditional probability distributions of the combined contexts are the same. Given I, the initial number of contexts, and F, the final desired number of contexts, there are S(I,F) possible context classification schemes where S(I,F) is called the Stirling number of the second kind. The optimal classification scheme is the one that gives the maximum mutual information. Instead of exhaustive search, the optimal classification scheme can be obtained through a modified Generalized Llyod algorithm with the relative entropy as the distortion metric. For binary arithmetic coding, the search complexity can be reduced by using the dynamic programming. Our experimental results show that the JPEG2000 contexts capture very well the correlations among the wavelet coefficients. At the same time, the number of contexts used as part of the standard can be reduced without loss in the coding performance.

KW - Context based arithmetic coding

KW - Image compression

KW - JPEG2000

KW - Mutual information

UR - http://www.scopus.com/inward/record.url?scp=0041625713&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0041625713&partnerID=8YFLogxK

U2 - 10.1117/12.476620

DO - 10.1117/12.476620

M3 - Conference contribution

AN - SCOPUS:0041625713

VL - 5022 I

SP - 573

EP - 582

BT - Proceedings of SPIE - The International Society for Optical Engineering

A2 - Vasudev, B.

A2 - Hsing, T.R.

A2 - Tescher, A.G.

A2 - Ebrahimi, T.

ER -