Correction of projective distortion in long-image-sequence mosaics without prior information

Chenhui Yang, Hongwei Mao, Glen Abousleman, Jennie Si

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Scopus citations

Abstract

Image mosaicking is the process of piecing together multiple video frames or still images from a moving camera to form a wide-area or panoramic view of the scene being imaged. Mosaics have widespread applications in many areas such as security surveillance, remote sensing, geographical exploration, agricultural field surveillance, virtual reality, digital video, and medical image analysis, among others. When mosaicking a large number of still images or video frames, the quality of the resulting mosaic is compromised by projective distortion. That is, during the mosaicking process, the image frames that are transformed and pasted to the mosaic become significantly scaled down and appear out of proportion with respect to the mosaic. As more frames continue to be transformed, important target information in the frames can be lost since the transformed frames become too small, which eventually leads to the inability to continue further. Some projective distortion correction techniques make use of prior information such as GPS information embedded within the image, or camera internal and external parameters. Alternatively, this paper proposes a new algorithm to reduce the projective distortion without using any prior information whatsoever. Based on the analysis of the projective distortion, we approximate the projective matrix that describes the transformation between image frames using an affine model. Using singular value decomposition, we can deduce the affine model scaling factor that is usually very close to 1. By resetting the image scale of the affine model to 1, the transformed image size remains unchanged. Even though the proposed correction introduces some error in the image matching, this error is typically acceptable and more importantly, the final mosaic preserves the original image size after transformation. We demonstrate the effectiveness of this new correction algorithm on two real-world unmanned air vehicle (UAV) sequences. The proposed method is shown to be effective and suitable for real-time implementation.

Original languageEnglish (US)
Title of host publicationAirborne Intelligence, Surveillance, Reconnaissance (ISR) Systems and Applications VII
DOIs
StatePublished - Jun 21 2010
EventAirborne Intelligence, Surveillance, Reconnaissance (ISR) Systems and Applications VII - Orlando, FL, United States
Duration: Apr 7 2010Apr 8 2010

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
Volume7668
ISSN (Print)0277-786X

Other

OtherAirborne Intelligence, Surveillance, Reconnaissance (ISR) Systems and Applications VII
CountryUnited States
CityOrlando, FL
Period4/7/104/8/10

Keywords

  • Projective distortion correction
  • affine model
  • image mosaic
  • image scale and rotation

ASJC Scopus subject areas

  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics
  • Computer Science Applications
  • Applied Mathematics
  • Electrical and Electronic Engineering

Fingerprint Dive into the research topics of 'Correction of projective distortion in long-image-sequence mosaics without prior information'. Together they form a unique fingerprint.

  • Cite this

    Yang, C., Mao, H., Abousleman, G., & Si, J. (2010). Correction of projective distortion in long-image-sequence mosaics without prior information. In Airborne Intelligence, Surveillance, Reconnaissance (ISR) Systems and Applications VII [76680Q] (Proceedings of SPIE - The International Society for Optical Engineering; Vol. 7668). https://doi.org/10.1117/12.849854