Perspective distortion minimization algorithm for image repairing from a large displacement view

Chun Xiao Liu, Qun Sheng Peng, Ying Zhen Yang, Jin Wang, Wei Chen

Research output: Contribution to journalArticlepeer-review

Abstract

A coarse-to-fine perspective distortion minimization algorithm is proposed for image repairing based on an additional large displacement view (LDV) of the same scene. It works by correcting the perspective distortion in the LDV image, and then utilizing the rectified LDV image to recover the missing areas on the target image. First, under the assumption of a planar scene, the LDV image is globally warped according to a homography to generate the initial distortion correction. Second, a mismatch recognition mechanism detects the remaining distortions in the initially corrected LDV image. They are further relaxed by energy optimization of overlap correspondences with the expectations of color constancy and displacement field smoothness. Third, under the constraints of epipolar geometry, displacement field smoothness and color consistency among the neighboring pixels, the missing pixels are orderly restored according to a specially-defined repairing priority function. Poisson image blending is adopted to eliminate the ghost effect between the repaired region and its surroundings and get the seamless repairing effect. Experimental results demonstrate that this method outperforms recent state-of-the-art image completion algorithms, especially for completing large damaged area with complex structure information.

Original languageEnglish (US)
Pages (from-to)202-212
Number of pages11
JournalRuan Jian Xue Bao/Journal of Software
Volume19
Issue numberSUPPL.
StatePublished - Dec 2008
Externally publishedYes

Keywords

  • Energy optimization
  • Epipolar constraint
  • Image repairing
  • Large displacement view
  • Perspective distortion correction
  • Pixel correspondence

ASJC Scopus subject areas

  • Software

Fingerprint Dive into the research topics of 'Perspective distortion minimization algorithm for image repairing from a large displacement view'. Together they form a unique fingerprint.

Cite this