Unlimited-size mosaicking of airborne image data

Nan Jiang, Changchun Li, Glen Abousleman, Jennie Si

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper presents a system that creates and navigates an unlimited-size mosaic with geographical information. The input is a sequence of airborne images with or without telemetry data, and the output is a mosaic with a combined geographical coordinate layer inherited from the input images. Rather than registering input images with an orthoimage, which is popular in existing applications, the proposed system only takes use of telemetry data as prior information. The airborne images embedded with geo-information are pair-wise registered, based on image feature correspondence. We extract feature points and form a modified EDGE-based descriptor for image registration. Subsequently, the geographical coordinate layers derived from the telemetry data stream are fused using a registration matrix computed from the previous step. However, due to the unreliability of the telemetry data, the new geodetic coordinate layer might be inconsistent with the image coordinate layer and therefore requires rectification to minimize the squared error between the mosaic coordinate layer and the warped geographical coordinate layer. The above process is incorporated into a cluster framework so that the output mosaic is extensible to an infinite size. That is, once the current mosaic size has expanded beyond computer memory limitations, the image is saved to a database. Its spatial relationship with respect to the world coordinate system is also saved to the database so that the system can navigate the collection of image mosaic data by querying the spatial database and retrieving the relevant mosaics. This method is especially suitable for video sequences spanning large regions, such as surveillance video from a micro UAV. Results with real-world UAV video are provided to demonstrate the performance of the proposed system.

Original languageEnglish (US)
Title of host publicationProceedings of SPIE - The International Society for Optical Engineering
Volume6546
DOIs
StatePublished - 2007
EventAirborne Intelligence, Surveillance, Reconnaissance (ISR) Systems and Applications IV - Orlando, FL, United States
Duration: Apr 11 2007Apr 11 2007

Other

OtherAirborne Intelligence, Surveillance, Reconnaissance (ISR) Systems and Applications IV
CountryUnited States
CityOrlando, FL
Period4/11/074/11/07

Fingerprint

Telemetering
Unmanned aerial vehicles (UAV)
telemetry
Image registration
geodetic coordinates
Data storage equipment
memory (computers)
output
rectification
surveillance
matrices

Keywords

  • Feature points
  • Georegister
  • Image registration
  • Telemetry data
  • Unlimited sized
  • Video mosaic

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Condensed Matter Physics

Cite this

Jiang, N., Li, C., Abousleman, G., & Si, J. (2007). Unlimited-size mosaicking of airborne image data. In Proceedings of SPIE - The International Society for Optical Engineering (Vol. 6546). [65460F] https://doi.org/10.1117/12.719833

Unlimited-size mosaicking of airborne image data. / Jiang, Nan; Li, Changchun; Abousleman, Glen; Si, Jennie.

Proceedings of SPIE - The International Society for Optical Engineering. Vol. 6546 2007. 65460F.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Jiang, N, Li, C, Abousleman, G & Si, J 2007, Unlimited-size mosaicking of airborne image data. in Proceedings of SPIE - The International Society for Optical Engineering. vol. 6546, 65460F, Airborne Intelligence, Surveillance, Reconnaissance (ISR) Systems and Applications IV, Orlando, FL, United States, 4/11/07. https://doi.org/10.1117/12.719833
Jiang N, Li C, Abousleman G, Si J. Unlimited-size mosaicking of airborne image data. In Proceedings of SPIE - The International Society for Optical Engineering. Vol. 6546. 2007. 65460F https://doi.org/10.1117/12.719833
Jiang, Nan ; Li, Changchun ; Abousleman, Glen ; Si, Jennie. / Unlimited-size mosaicking of airborne image data. Proceedings of SPIE - The International Society for Optical Engineering. Vol. 6546 2007.
@inproceedings{5d44c743fef1443899940a1ef9eeb0a1,
title = "Unlimited-size mosaicking of airborne image data",
abstract = "This paper presents a system that creates and navigates an unlimited-size mosaic with geographical information. The input is a sequence of airborne images with or without telemetry data, and the output is a mosaic with a combined geographical coordinate layer inherited from the input images. Rather than registering input images with an orthoimage, which is popular in existing applications, the proposed system only takes use of telemetry data as prior information. The airborne images embedded with geo-information are pair-wise registered, based on image feature correspondence. We extract feature points and form a modified EDGE-based descriptor for image registration. Subsequently, the geographical coordinate layers derived from the telemetry data stream are fused using a registration matrix computed from the previous step. However, due to the unreliability of the telemetry data, the new geodetic coordinate layer might be inconsistent with the image coordinate layer and therefore requires rectification to minimize the squared error between the mosaic coordinate layer and the warped geographical coordinate layer. The above process is incorporated into a cluster framework so that the output mosaic is extensible to an infinite size. That is, once the current mosaic size has expanded beyond computer memory limitations, the image is saved to a database. Its spatial relationship with respect to the world coordinate system is also saved to the database so that the system can navigate the collection of image mosaic data by querying the spatial database and retrieving the relevant mosaics. This method is especially suitable for video sequences spanning large regions, such as surveillance video from a micro UAV. Results with real-world UAV video are provided to demonstrate the performance of the proposed system.",
keywords = "Feature points, Georegister, Image registration, Telemetry data, Unlimited sized, Video mosaic",
author = "Nan Jiang and Changchun Li and Glen Abousleman and Jennie Si",
year = "2007",
doi = "10.1117/12.719833",
language = "English (US)",
isbn = "0819466689",
volume = "6546",
booktitle = "Proceedings of SPIE - The International Society for Optical Engineering",

}

TY - GEN

T1 - Unlimited-size mosaicking of airborne image data

AU - Jiang, Nan

AU - Li, Changchun

AU - Abousleman, Glen

AU - Si, Jennie

PY - 2007

Y1 - 2007

N2 - This paper presents a system that creates and navigates an unlimited-size mosaic with geographical information. The input is a sequence of airborne images with or without telemetry data, and the output is a mosaic with a combined geographical coordinate layer inherited from the input images. Rather than registering input images with an orthoimage, which is popular in existing applications, the proposed system only takes use of telemetry data as prior information. The airborne images embedded with geo-information are pair-wise registered, based on image feature correspondence. We extract feature points and form a modified EDGE-based descriptor for image registration. Subsequently, the geographical coordinate layers derived from the telemetry data stream are fused using a registration matrix computed from the previous step. However, due to the unreliability of the telemetry data, the new geodetic coordinate layer might be inconsistent with the image coordinate layer and therefore requires rectification to minimize the squared error between the mosaic coordinate layer and the warped geographical coordinate layer. The above process is incorporated into a cluster framework so that the output mosaic is extensible to an infinite size. That is, once the current mosaic size has expanded beyond computer memory limitations, the image is saved to a database. Its spatial relationship with respect to the world coordinate system is also saved to the database so that the system can navigate the collection of image mosaic data by querying the spatial database and retrieving the relevant mosaics. This method is especially suitable for video sequences spanning large regions, such as surveillance video from a micro UAV. Results with real-world UAV video are provided to demonstrate the performance of the proposed system.

AB - This paper presents a system that creates and navigates an unlimited-size mosaic with geographical information. The input is a sequence of airborne images with or without telemetry data, and the output is a mosaic with a combined geographical coordinate layer inherited from the input images. Rather than registering input images with an orthoimage, which is popular in existing applications, the proposed system only takes use of telemetry data as prior information. The airborne images embedded with geo-information are pair-wise registered, based on image feature correspondence. We extract feature points and form a modified EDGE-based descriptor for image registration. Subsequently, the geographical coordinate layers derived from the telemetry data stream are fused using a registration matrix computed from the previous step. However, due to the unreliability of the telemetry data, the new geodetic coordinate layer might be inconsistent with the image coordinate layer and therefore requires rectification to minimize the squared error between the mosaic coordinate layer and the warped geographical coordinate layer. The above process is incorporated into a cluster framework so that the output mosaic is extensible to an infinite size. That is, once the current mosaic size has expanded beyond computer memory limitations, the image is saved to a database. Its spatial relationship with respect to the world coordinate system is also saved to the database so that the system can navigate the collection of image mosaic data by querying the spatial database and retrieving the relevant mosaics. This method is especially suitable for video sequences spanning large regions, such as surveillance video from a micro UAV. Results with real-world UAV video are provided to demonstrate the performance of the proposed system.

KW - Feature points

KW - Georegister

KW - Image registration

KW - Telemetry data

KW - Unlimited sized

KW - Video mosaic

UR - http://www.scopus.com/inward/record.url?scp=35649025822&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=35649025822&partnerID=8YFLogxK

U2 - 10.1117/12.719833

DO - 10.1117/12.719833

M3 - Conference contribution

AN - SCOPUS:35649025822

SN - 0819466689

SN - 9780819466686

VL - 6546

BT - Proceedings of SPIE - The International Society for Optical Engineering

ER -