### Abstract

A probability density function (pdf) for the maximum likelihood (ML) signal vector estimator is derived when the estimator relies on a noise sample covariance matrix (SCM) for evaluation. By using a complex Wishart probabilistic model for the distribution of the SCM, it is shown that the pdf of the adaptive ML (AML) signal estimator (alias the SCM based minimum variance distortionless response (MVDR) beamformer output and, more generally, the SCM based linearly constrained minimum variance (LCMV) beamformer output) is, in general, the confluent hypergeometric function of a complex matrix argument known as Kummer's function. The AML signal estimator remains unbiased but only asymptotically efficient; moreover, the AML signal estimator converges in distribution to the ML signal estimator (known noise covariance). When the sample size of the estimated noise covariance matrix is fixed, it is demonstrated that there exists a dynamic tradeoff between signal-to-noise ratio (SNR) and noise adaptivity as the dimensionality of the array data (number of adaptive degrees of freedom) is varied, suggesting the existence of an optimal array data dimension that will yield the best performance.

Original language | English (US) |
---|---|

Pages (from-to) | 305-315 |

Number of pages | 11 |

Journal | IEEE Transactions on Signal Processing |

Volume | 44 |

Issue number | 2 |

DOIs | |

State | Published - Dec 1 1996 |

Externally published | Yes |

### ASJC Scopus subject areas

- Signal Processing
- Electrical and Electronic Engineering