Projection-free kernel principal component analysis for denoising

Anh Tuan Bui, Joon Ku Im, Daniel W. Apley, George Runger

    Research output: Contribution to journalArticle

    1 Scopus citations

    Abstract

    Kernel principal component analysis (KPCA) forms the basis for a class of methods commonly used for denoising a set of multivariate observations. Most KPCA algorithms involve two steps: projection and preimage approximation. We argue that this two-step procedure can be inefficient and result in poor denoising. We propose an alternative projection-free KPCA denoising approach that does not involve the usual projection and subsequent preimage approximation steps. In order to denoise an observation, our approach performs a single line search along the gradient descent direction of the squared projection error. The rationale is that this moves an observation towards the underlying manifold that represents the noiseless data in the most direct manner possible. We demonstrate that the approach is simple, computationally efficient, robust, and sometimes provides substantially better denoising than the standard KPCA algorithm.

    Original languageEnglish (US)
    Pages (from-to)163-176
    Number of pages14
    JournalNeurocomputing
    Volume357
    DOIs
    StatePublished - Sep 10 2019

      Fingerprint

    Keywords

    • Feature space
    • Image processing
    • Pattern recognition
    • Preimage problem

    ASJC Scopus subject areas

    • Computer Science Applications
    • Cognitive Neuroscience
    • Artificial Intelligence

    Cite this