Regularization parameter estimation for large-scale Tikhonov regularization using a priori information

Rosemary Renaut, Iveta Hnětynková, Jodi Mead

Research output: Contribution to journalArticlepeer-review

27 Scopus citations


Solutions of numerically ill-posed least squares problems Ax ≈ b for A ∈ Rmxn by Tikhonov regularization are considered. For D ∈ Rpxn, the Tikhonov regularized least squares functional is given by J(σ) = \\Ax - b||2 w + 1/σ2 ||D(x - x0) \\2 2where matrix W is a weighting matrix and X0 is given. Given a priori estimates on the covariance structure of errors in the measurement data b, the weighting matrix may be taken as W = Wb which is the inverse covariance matrix of the mean 0 normally distributed measurement errors e in b. If in addition X0 is an estimate of the mean value of x, and σ is a suitable statistically-chosen value, J evaluated at its minimizer x(σ) approximately follows a x 2 distribution with m̃ = m + p-n degrees of freedom. Using the generalized singular value decomposition of the matrix pair [Wb 1/2AD], σ can then be found such that the resulting J follows this x2 distribution. But the use of an algorithm which explicitly relies on the direct solution of the problem obtained using the generalized singular value decomposition is not practical for large-scale problems. Instead an approach using the Golub-Kahan iterative bidiagonalization of the regularized problem is presented. The original algorithm is extended for cases in which X0 is not available, but instead a set of measurement data provides an estimate of the mean value of b. The sensitivity of the Newton algorithm to the number of steps used in the Golub-Kahan iterative bidiagonalization, and the relation between the size of the projected subproblem and a are discussed. Experiments presented contrast the efficiency and robustness with other standard methods for finding the regularization parameter for a set of test problems and for the restoration of a relatively large real seismic signal. An application for image deblurring also validates the approach for large-scale problems. It is concluded that the presented approach is robust for both small and large-scale discretely ill-posed least squares problems.

Original languageEnglish (US)
Pages (from-to)3430-3445
Number of pages16
JournalComputational Statistics and Data Analysis
Issue number12
StatePublished - Dec 1 2010

ASJC Scopus subject areas

  • Statistics and Probability
  • Computational Mathematics
  • Computational Theory and Mathematics
  • Applied Mathematics


Dive into the research topics of 'Regularization parameter estimation for large-scale Tikhonov regularization using a priori information'. Together they form a unique fingerprint.

Cite this