Correction of projective distortion in long-image-sequence mosaics without prior information

Chenhui Yang, Hongwei Mao, Glen Abousleman, Jennie Si

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)

Abstract

Image mosaicking is the process of piecing together multiple video frames or still images from a moving camera to form a wide-area or panoramic view of the scene being imaged. Mosaics have widespread applications in many areas such as security surveillance, remote sensing, geographical exploration, agricultural field surveillance, virtual reality, digital video, and medical image analysis, among others. When mosaicking a large number of still images or video frames, the quality of the resulting mosaic is compromised by projective distortion. That is, during the mosaicking process, the image frames that are transformed and pasted to the mosaic become significantly scaled down and appear out of proportion with respect to the mosaic. As more frames continue to be transformed, important target information in the frames can be lost since the transformed frames become too small, which eventually leads to the inability to continue further. Some projective distortion correction techniques make use of prior information such as GPS information embedded within the image, or camera internal and external parameters. Alternatively, this paper proposes a new algorithm to reduce the projective distortion without using any prior information whatsoever. Based on the analysis of the projective distortion, we approximate the projective matrix that describes the transformation between image frames using an affine model. Using singular value decomposition, we can deduce the affine model scaling factor that is usually very close to 1. By resetting the image scale of the affine model to 1, the transformed image size remains unchanged. Even though the proposed correction introduces some error in the image matching, this error is typically acceptable and more importantly, the final mosaic preserves the original image size after transformation. We demonstrate the effectiveness of this new correction algorithm on two real-world unmanned air vehicle (UAV) sequences. The proposed method is shown to be effective and suitable for real-time implementation.

Original languageEnglish (US)
Title of host publicationProceedings of SPIE - The International Society for Optical Engineering
Volume7668
DOIs
StatePublished - 2010
EventAirborne Intelligence, Surveillance, Reconnaissance (ISR) Systems and Applications VII - Orlando, FL, United States
Duration: Apr 7 2010Apr 8 2010

Other

OtherAirborne Intelligence, Surveillance, Reconnaissance (ISR) Systems and Applications VII
CountryUnited States
CityOrlando, FL
Period4/7/104/8/10

Fingerprint

Prior Information
Image Sequence
Cameras
Image matching
Singular value decomposition
Virtual reality
Image analysis
Global positioning system
Remote sensing
Surveillance
surveillance
Continue
Camera
Medical Image Analysis
cameras
Digital Video
Image Matching
Scaling Factor
Air
virtual reality

Keywords

  • affine model
  • image mosaic
  • image scale and rotation
  • Projective distortion correction

ASJC Scopus subject areas

  • Applied Mathematics
  • Computer Science Applications
  • Electrical and Electronic Engineering
  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics

Cite this

Yang, C., Mao, H., Abousleman, G., & Si, J. (2010). Correction of projective distortion in long-image-sequence mosaics without prior information. In Proceedings of SPIE - The International Society for Optical Engineering (Vol. 7668). [76680Q] https://doi.org/10.1117/12.849854

Correction of projective distortion in long-image-sequence mosaics without prior information. / Yang, Chenhui; Mao, Hongwei; Abousleman, Glen; Si, Jennie.

Proceedings of SPIE - The International Society for Optical Engineering. Vol. 7668 2010. 76680Q.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Yang, C, Mao, H, Abousleman, G & Si, J 2010, Correction of projective distortion in long-image-sequence mosaics without prior information. in Proceedings of SPIE - The International Society for Optical Engineering. vol. 7668, 76680Q, Airborne Intelligence, Surveillance, Reconnaissance (ISR) Systems and Applications VII, Orlando, FL, United States, 4/7/10. https://doi.org/10.1117/12.849854
Yang C, Mao H, Abousleman G, Si J. Correction of projective distortion in long-image-sequence mosaics without prior information. In Proceedings of SPIE - The International Society for Optical Engineering. Vol. 7668. 2010. 76680Q https://doi.org/10.1117/12.849854
Yang, Chenhui ; Mao, Hongwei ; Abousleman, Glen ; Si, Jennie. / Correction of projective distortion in long-image-sequence mosaics without prior information. Proceedings of SPIE - The International Society for Optical Engineering. Vol. 7668 2010.
@inproceedings{88a46b2dc1a54af88ee652348d89138f,
title = "Correction of projective distortion in long-image-sequence mosaics without prior information",
abstract = "Image mosaicking is the process of piecing together multiple video frames or still images from a moving camera to form a wide-area or panoramic view of the scene being imaged. Mosaics have widespread applications in many areas such as security surveillance, remote sensing, geographical exploration, agricultural field surveillance, virtual reality, digital video, and medical image analysis, among others. When mosaicking a large number of still images or video frames, the quality of the resulting mosaic is compromised by projective distortion. That is, during the mosaicking process, the image frames that are transformed and pasted to the mosaic become significantly scaled down and appear out of proportion with respect to the mosaic. As more frames continue to be transformed, important target information in the frames can be lost since the transformed frames become too small, which eventually leads to the inability to continue further. Some projective distortion correction techniques make use of prior information such as GPS information embedded within the image, or camera internal and external parameters. Alternatively, this paper proposes a new algorithm to reduce the projective distortion without using any prior information whatsoever. Based on the analysis of the projective distortion, we approximate the projective matrix that describes the transformation between image frames using an affine model. Using singular value decomposition, we can deduce the affine model scaling factor that is usually very close to 1. By resetting the image scale of the affine model to 1, the transformed image size remains unchanged. Even though the proposed correction introduces some error in the image matching, this error is typically acceptable and more importantly, the final mosaic preserves the original image size after transformation. We demonstrate the effectiveness of this new correction algorithm on two real-world unmanned air vehicle (UAV) sequences. The proposed method is shown to be effective and suitable for real-time implementation.",
keywords = "affine model, image mosaic, image scale and rotation, Projective distortion correction",
author = "Chenhui Yang and Hongwei Mao and Glen Abousleman and Jennie Si",
year = "2010",
doi = "10.1117/12.849854",
language = "English (US)",
isbn = "9780819481320",
volume = "7668",
booktitle = "Proceedings of SPIE - The International Society for Optical Engineering",

}

TY - GEN

T1 - Correction of projective distortion in long-image-sequence mosaics without prior information

AU - Yang, Chenhui

AU - Mao, Hongwei

AU - Abousleman, Glen

AU - Si, Jennie

PY - 2010

Y1 - 2010

N2 - Image mosaicking is the process of piecing together multiple video frames or still images from a moving camera to form a wide-area or panoramic view of the scene being imaged. Mosaics have widespread applications in many areas such as security surveillance, remote sensing, geographical exploration, agricultural field surveillance, virtual reality, digital video, and medical image analysis, among others. When mosaicking a large number of still images or video frames, the quality of the resulting mosaic is compromised by projective distortion. That is, during the mosaicking process, the image frames that are transformed and pasted to the mosaic become significantly scaled down and appear out of proportion with respect to the mosaic. As more frames continue to be transformed, important target information in the frames can be lost since the transformed frames become too small, which eventually leads to the inability to continue further. Some projective distortion correction techniques make use of prior information such as GPS information embedded within the image, or camera internal and external parameters. Alternatively, this paper proposes a new algorithm to reduce the projective distortion without using any prior information whatsoever. Based on the analysis of the projective distortion, we approximate the projective matrix that describes the transformation between image frames using an affine model. Using singular value decomposition, we can deduce the affine model scaling factor that is usually very close to 1. By resetting the image scale of the affine model to 1, the transformed image size remains unchanged. Even though the proposed correction introduces some error in the image matching, this error is typically acceptable and more importantly, the final mosaic preserves the original image size after transformation. We demonstrate the effectiveness of this new correction algorithm on two real-world unmanned air vehicle (UAV) sequences. The proposed method is shown to be effective and suitable for real-time implementation.

AB - Image mosaicking is the process of piecing together multiple video frames or still images from a moving camera to form a wide-area or panoramic view of the scene being imaged. Mosaics have widespread applications in many areas such as security surveillance, remote sensing, geographical exploration, agricultural field surveillance, virtual reality, digital video, and medical image analysis, among others. When mosaicking a large number of still images or video frames, the quality of the resulting mosaic is compromised by projective distortion. That is, during the mosaicking process, the image frames that are transformed and pasted to the mosaic become significantly scaled down and appear out of proportion with respect to the mosaic. As more frames continue to be transformed, important target information in the frames can be lost since the transformed frames become too small, which eventually leads to the inability to continue further. Some projective distortion correction techniques make use of prior information such as GPS information embedded within the image, or camera internal and external parameters. Alternatively, this paper proposes a new algorithm to reduce the projective distortion without using any prior information whatsoever. Based on the analysis of the projective distortion, we approximate the projective matrix that describes the transformation between image frames using an affine model. Using singular value decomposition, we can deduce the affine model scaling factor that is usually very close to 1. By resetting the image scale of the affine model to 1, the transformed image size remains unchanged. Even though the proposed correction introduces some error in the image matching, this error is typically acceptable and more importantly, the final mosaic preserves the original image size after transformation. We demonstrate the effectiveness of this new correction algorithm on two real-world unmanned air vehicle (UAV) sequences. The proposed method is shown to be effective and suitable for real-time implementation.

KW - affine model

KW - image mosaic

KW - image scale and rotation

KW - Projective distortion correction

UR - http://www.scopus.com/inward/record.url?scp=77953579621&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=77953579621&partnerID=8YFLogxK

U2 - 10.1117/12.849854

DO - 10.1117/12.849854

M3 - Conference contribution

AN - SCOPUS:77953579621

SN - 9780819481320

VL - 7668

BT - Proceedings of SPIE - The International Society for Optical Engineering

ER -