TY - JOUR

T1 - Precoding and decoding paradigms for distributed vector data compression

AU - Vosoughi, Azadeh

AU - Scaglione, Anna

N1 - Funding Information:
Manuscript received September 1, 2005; revised April 16, 2006. This work was supported by the NSF by Grant CCR-0133635. The material in this paper was presented in part at the 43th Annual Allerton Conference, Allerton, IL, October 2005. The associate editor coordinating the review of this paper and approving it for publication was Dr. Soren Holdt Jensen.

PY - 2007/4

Y1 - 2007/4

N2 - In this paper, we consider the problem of lossy coding of correlated vector sources with uncoded side information available at the decoder. In particular, we consider lossy coding of vector source x ∈ ℝN which is correlated with vector source y ∈ ℝN, known at the decoder. We propose two compression schemes, namely, distributed adaptive compression (DAC) and distributed universal compression (DUC) schemes. The DAC algorithm is inspired by the optimal solution for Gaussian sources and requires computation of the conditional Karhunen-Loève transform (CKLT) of the data at the encoder. The DUC algorithm, however, does not require knowledge of the CKLT at the encoder. The DUC algorithms are based on the approximation of the correlation model between the sources y and x through a linear model y = Hx + n in which H is a matrix and n is a random vector and independent of x. This model can be viewed as a fictitious communication channel with input x and output y. Utilizing channel equalization at the receiver, we convert the original vector source coding problem into a set of manageable scalar source coding problems. Furthermore, inspired by bit loading strategies employed in wireless communication systems, we propose for both compression schemes a rate allocation policy which minimizes the decoding error rate under a total rate constraint. Equalization and bit loading are paired with a quantization scheme for each vector source entry (a slightly simplified version of the so called DISCUS scheme). The merits of our work are as follows: 1) it provides a simple, yet optimized, implementation of Wyner-Ziv quantizers for correlated vector sources, by using the insight gained in the design of communication systems; 2) it provides encoding schemes that, with or without the knowledge of the correlation model at the encoder, enjoy distributed compression gains.

AB - In this paper, we consider the problem of lossy coding of correlated vector sources with uncoded side information available at the decoder. In particular, we consider lossy coding of vector source x ∈ ℝN which is correlated with vector source y ∈ ℝN, known at the decoder. We propose two compression schemes, namely, distributed adaptive compression (DAC) and distributed universal compression (DUC) schemes. The DAC algorithm is inspired by the optimal solution for Gaussian sources and requires computation of the conditional Karhunen-Loève transform (CKLT) of the data at the encoder. The DUC algorithm, however, does not require knowledge of the CKLT at the encoder. The DUC algorithms are based on the approximation of the correlation model between the sources y and x through a linear model y = Hx + n in which H is a matrix and n is a random vector and independent of x. This model can be viewed as a fictitious communication channel with input x and output y. Utilizing channel equalization at the receiver, we convert the original vector source coding problem into a set of manageable scalar source coding problems. Furthermore, inspired by bit loading strategies employed in wireless communication systems, we propose for both compression schemes a rate allocation policy which minimizes the decoding error rate under a total rate constraint. Equalization and bit loading are paired with a quantization scheme for each vector source entry (a slightly simplified version of the so called DISCUS scheme). The merits of our work are as follows: 1) it provides a simple, yet optimized, implementation of Wyner-Ziv quantizers for correlated vector sources, by using the insight gained in the design of communication systems; 2) it provides encoding schemes that, with or without the knowledge of the correlation model at the encoder, enjoy distributed compression gains.

KW - Binnig

KW - Conditional Karhunen-Loève transform (CKLT)

KW - Correlated vector sources

KW - Coset construction

KW - Distributed source coding

KW - Equalization

KW - Gaussian sources

KW - Llossy coding

KW - Precoding

KW - Quantization

KW - Rate allocation

KW - Source coding with side information

KW - Transform coding

KW - Wyner-Ziv encoders

UR - http://www.scopus.com/inward/record.url?scp=34147160594&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=34147160594&partnerID=8YFLogxK

U2 - 10.1109/TSP.2006.888887

DO - 10.1109/TSP.2006.888887

M3 - Article

AN - SCOPUS:34147160594

VL - 55

SP - 1445

EP - 1460

JO - IRE Transactions on Audio

JF - IRE Transactions on Audio

SN - 1053-587X

IS - 4

ER -