Computer vision based general object following for GPS-denied multirotor unmanned vehicles

Jesus Pestana, Jose Luis Sanchez-Lopez, Srikanth Saripalli, Pascual Campoy

Research output: Chapter in Book/Report/Conference proceedingConference contribution

55 Citations (Scopus)

Abstract

The motivation of this research is to show that visual based object tracking and following is reliable using a cheap GPS-denied multirotor platform such as the AR Drone 2.0. Our architecture allows the user to specify an object in the image that the robot has to follow from an approximate constant distance. At the current stage of our development, in the event of image tracking loss the system starts to hover and waits for the image tracking recovery or second detection, which requires the usage of odometry measurements for self stabilization. During the following task, our software utilizes the forward-facing camera images and part of the IMU data to calculate the references for the four on-board low-level control loops. To obtain a stronger wind disturbance rejection and an improved navigation performance, a yaw heading reference based on the IMU data is internally kept and updated by our control algorithm. We validate the architecture using an AR Drone 2.0 and the OpenTLD tracker in outdoor suburban areas. The experimental tests have shown robustness against wind perturbations, target occlusion and illumination changes, and the system's capability to track a great variety of objects present on suburban areas, for instance: walking or running people, windows, AC machines, static and moving cars and plants.

Original languageEnglish (US)
Title of host publicationProceedings of the American Control Conference
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1886-1891
Number of pages6
ISBN (Print)9781479932726
DOIs
StatePublished - 2014
Event2014 American Control Conference, ACC 2014 - Portland, OR, United States
Duration: Jun 4 2014Jun 6 2014

Other

Other2014 American Control Conference, ACC 2014
CountryUnited States
CityPortland, OR
Period6/4/146/6/14

Fingerprint

Unmanned vehicles
Computer vision
Global positioning system
Disturbance rejection
Level control
Navigation
Railroad cars
Stabilization
Lighting
Cameras
Robots
Recovery
Drones

Keywords

  • Object Following
  • Quadrotor Control
  • UAV vision based control
  • Visual Servoing

ASJC Scopus subject areas

  • Electrical and Electronic Engineering

Cite this

Pestana, J., Sanchez-Lopez, J. L., Saripalli, S., & Campoy, P. (2014). Computer vision based general object following for GPS-denied multirotor unmanned vehicles. In Proceedings of the American Control Conference (pp. 1886-1891). [6858831] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ACC.2014.6858831

Computer vision based general object following for GPS-denied multirotor unmanned vehicles. / Pestana, Jesus; Sanchez-Lopez, Jose Luis; Saripalli, Srikanth; Campoy, Pascual.

Proceedings of the American Control Conference. Institute of Electrical and Electronics Engineers Inc., 2014. p. 1886-1891 6858831.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Pestana, J, Sanchez-Lopez, JL, Saripalli, S & Campoy, P 2014, Computer vision based general object following for GPS-denied multirotor unmanned vehicles. in Proceedings of the American Control Conference., 6858831, Institute of Electrical and Electronics Engineers Inc., pp. 1886-1891, 2014 American Control Conference, ACC 2014, Portland, OR, United States, 6/4/14. https://doi.org/10.1109/ACC.2014.6858831
Pestana J, Sanchez-Lopez JL, Saripalli S, Campoy P. Computer vision based general object following for GPS-denied multirotor unmanned vehicles. In Proceedings of the American Control Conference. Institute of Electrical and Electronics Engineers Inc. 2014. p. 1886-1891. 6858831 https://doi.org/10.1109/ACC.2014.6858831
Pestana, Jesus ; Sanchez-Lopez, Jose Luis ; Saripalli, Srikanth ; Campoy, Pascual. / Computer vision based general object following for GPS-denied multirotor unmanned vehicles. Proceedings of the American Control Conference. Institute of Electrical and Electronics Engineers Inc., 2014. pp. 1886-1891
@inproceedings{aed0281c545549f18f5b27f99fd86b1b,
title = "Computer vision based general object following for GPS-denied multirotor unmanned vehicles",
abstract = "The motivation of this research is to show that visual based object tracking and following is reliable using a cheap GPS-denied multirotor platform such as the AR Drone 2.0. Our architecture allows the user to specify an object in the image that the robot has to follow from an approximate constant distance. At the current stage of our development, in the event of image tracking loss the system starts to hover and waits for the image tracking recovery or second detection, which requires the usage of odometry measurements for self stabilization. During the following task, our software utilizes the forward-facing camera images and part of the IMU data to calculate the references for the four on-board low-level control loops. To obtain a stronger wind disturbance rejection and an improved navigation performance, a yaw heading reference based on the IMU data is internally kept and updated by our control algorithm. We validate the architecture using an AR Drone 2.0 and the OpenTLD tracker in outdoor suburban areas. The experimental tests have shown robustness against wind perturbations, target occlusion and illumination changes, and the system's capability to track a great variety of objects present on suburban areas, for instance: walking or running people, windows, AC machines, static and moving cars and plants.",
keywords = "Object Following, Quadrotor Control, UAV vision based control, Visual Servoing",
author = "Jesus Pestana and Sanchez-Lopez, {Jose Luis} and Srikanth Saripalli and Pascual Campoy",
year = "2014",
doi = "10.1109/ACC.2014.6858831",
language = "English (US)",
isbn = "9781479932726",
pages = "1886--1891",
booktitle = "Proceedings of the American Control Conference",
publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

TY - GEN

T1 - Computer vision based general object following for GPS-denied multirotor unmanned vehicles

AU - Pestana, Jesus

AU - Sanchez-Lopez, Jose Luis

AU - Saripalli, Srikanth

AU - Campoy, Pascual

PY - 2014

Y1 - 2014

N2 - The motivation of this research is to show that visual based object tracking and following is reliable using a cheap GPS-denied multirotor platform such as the AR Drone 2.0. Our architecture allows the user to specify an object in the image that the robot has to follow from an approximate constant distance. At the current stage of our development, in the event of image tracking loss the system starts to hover and waits for the image tracking recovery or second detection, which requires the usage of odometry measurements for self stabilization. During the following task, our software utilizes the forward-facing camera images and part of the IMU data to calculate the references for the four on-board low-level control loops. To obtain a stronger wind disturbance rejection and an improved navigation performance, a yaw heading reference based on the IMU data is internally kept and updated by our control algorithm. We validate the architecture using an AR Drone 2.0 and the OpenTLD tracker in outdoor suburban areas. The experimental tests have shown robustness against wind perturbations, target occlusion and illumination changes, and the system's capability to track a great variety of objects present on suburban areas, for instance: walking or running people, windows, AC machines, static and moving cars and plants.

AB - The motivation of this research is to show that visual based object tracking and following is reliable using a cheap GPS-denied multirotor platform such as the AR Drone 2.0. Our architecture allows the user to specify an object in the image that the robot has to follow from an approximate constant distance. At the current stage of our development, in the event of image tracking loss the system starts to hover and waits for the image tracking recovery or second detection, which requires the usage of odometry measurements for self stabilization. During the following task, our software utilizes the forward-facing camera images and part of the IMU data to calculate the references for the four on-board low-level control loops. To obtain a stronger wind disturbance rejection and an improved navigation performance, a yaw heading reference based on the IMU data is internally kept and updated by our control algorithm. We validate the architecture using an AR Drone 2.0 and the OpenTLD tracker in outdoor suburban areas. The experimental tests have shown robustness against wind perturbations, target occlusion and illumination changes, and the system's capability to track a great variety of objects present on suburban areas, for instance: walking or running people, windows, AC machines, static and moving cars and plants.

KW - Object Following

KW - Quadrotor Control

KW - UAV vision based control

KW - Visual Servoing

UR - http://www.scopus.com/inward/record.url?scp=84905717349&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84905717349&partnerID=8YFLogxK

U2 - 10.1109/ACC.2014.6858831

DO - 10.1109/ACC.2014.6858831

M3 - Conference contribution

AN - SCOPUS:84905717349

SN - 9781479932726

SP - 1886

EP - 1891

BT - Proceedings of the American Control Conference

PB - Institute of Electrical and Electronics Engineers Inc.

ER -