Fast and robust image mosaicking for monocular video

Huibao Lin, Jennie Si, Glen P. Abousleman

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Scopus citations

Abstract

Image mosaicking is the process of mapping an image series onto a common image grid, where the resulting mosaic forms a comprehensive view of the scene. This paper presents a near-real-time, automatic image mosaicking system that is designed to operate in real-world conditions. These conditions include arbitrary camera motion, disturbances from moving objects and annotations, and luminance variations. In the proposed algorithm, matching filters are used in conjunction with automatic corner detection to find several critical points within each image, which are then used to represent the image efficiently and accurately. Numerical techniques are used to distinguish between those points belonging to the actual scene and those resulting from a disturbance, and to determine the movement of the camera. The affine model is used to describe the frame-to-frame differences that result from camera motion. A local-adaptive fine-tuning step is used to correct the approximation error due to the use of the affine model, and to compensate for any luminance variation. The mosaic is constructed progressively as new images are being added. The proposed algorithm has been extensively tested on real-world, monocular video sequences, and it is shown to be very accurate and robust.

Original languageEnglish (US)
Title of host publicationProceedings of SPIE - The International Society for Optical Engineering
EditorsI. Kadar
Pages443-452
Number of pages10
Volume5809
DOIs
StatePublished - 2005
EventSignal Processing, Sensor Fusion, and Target Recognition XIV - Orlando, FL, United States
Duration: Mar 28 2005Mar 30 2005

Other

OtherSignal Processing, Sensor Fusion, and Target Recognition XIV
CountryUnited States
CityOrlando, FL
Period3/28/053/30/05

    Fingerprint

Keywords

  • Camera motion
  • Image mosaic
  • Image reconstruction
  • Image registration

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Condensed Matter Physics

Cite this

Lin, H., Si, J., & Abousleman, G. P. (2005). Fast and robust image mosaicking for monocular video. In I. Kadar (Ed.), Proceedings of SPIE - The International Society for Optical Engineering (Vol. 5809, pp. 443-452). [53] https://doi.org/10.1117/12.603320