Active Object Perceiver: Recognition-Guided Policy Learning for Object Searching on Mobile Robots

Xin Ye, Zhe Lin, Haoxiang Li, Shibin Zheng, Yezhou Yang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

We study the problem of learning a navigation policy for a robot to actively search for an object of interest in an indoor environment solely from its visual inputs. While scene-driven visual navigation has been widely studied, prior efforts on learning navigation policies for robots to find objects are limited. The problem is often more challenging than target scene finding as the target objects can be very small in the view and can be in an arbitrary pose. We approach the problem from an active perceiver perspective, and propose a novel framework that integrates a deep neural network based object recognition module and a deep reinforcement learning based action prediction mechanism. To validate our method, we conduct experiments on both a simulation dataset (AI2-THOR)and a real-world environment with a physical robot. We further propose a new decaying reward function to learn the control policy specific to the object searching task. Experimental results validate the efficacy of our method, which outperforms competing methods in both average trajectory length and success rate.

Original languageEnglish (US)
Title of host publication2018 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2018
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages6857-6863
Number of pages7
ISBN (Electronic)9781538680940
DOIs
StatePublished - Dec 27 2018
Event2018 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2018 - Madrid, Spain
Duration: Oct 1 2018Oct 5 2018

Publication series

NameIEEE International Conference on Intelligent Robots and Systems
ISSN (Print)2153-0858
ISSN (Electronic)2153-0866

Conference

Conference2018 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2018
CountrySpain
CityMadrid
Period10/1/1810/5/18

Fingerprint

Object recognition
Mobile robots
Navigation
Robots
Reinforcement learning
Trajectories
Experiments

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Software
  • Computer Vision and Pattern Recognition
  • Computer Science Applications

Cite this

Ye, X., Lin, Z., Li, H., Zheng, S., & Yang, Y. (2018). Active Object Perceiver: Recognition-Guided Policy Learning for Object Searching on Mobile Robots. In 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2018 (pp. 6857-6863). [8593720] (IEEE International Conference on Intelligent Robots and Systems). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/IROS.2018.8593720

Active Object Perceiver : Recognition-Guided Policy Learning for Object Searching on Mobile Robots. / Ye, Xin; Lin, Zhe; Li, Haoxiang; Zheng, Shibin; Yang, Yezhou.

2018 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2018. Institute of Electrical and Electronics Engineers Inc., 2018. p. 6857-6863 8593720 (IEEE International Conference on Intelligent Robots and Systems).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Ye, X, Lin, Z, Li, H, Zheng, S & Yang, Y 2018, Active Object Perceiver: Recognition-Guided Policy Learning for Object Searching on Mobile Robots. in 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2018., 8593720, IEEE International Conference on Intelligent Robots and Systems, Institute of Electrical and Electronics Engineers Inc., pp. 6857-6863, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2018, Madrid, Spain, 10/1/18. https://doi.org/10.1109/IROS.2018.8593720
Ye X, Lin Z, Li H, Zheng S, Yang Y. Active Object Perceiver: Recognition-Guided Policy Learning for Object Searching on Mobile Robots. In 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2018. Institute of Electrical and Electronics Engineers Inc. 2018. p. 6857-6863. 8593720. (IEEE International Conference on Intelligent Robots and Systems). https://doi.org/10.1109/IROS.2018.8593720
Ye, Xin ; Lin, Zhe ; Li, Haoxiang ; Zheng, Shibin ; Yang, Yezhou. / Active Object Perceiver : Recognition-Guided Policy Learning for Object Searching on Mobile Robots. 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2018. Institute of Electrical and Electronics Engineers Inc., 2018. pp. 6857-6863 (IEEE International Conference on Intelligent Robots and Systems).
@inproceedings{e437aa63244748dfacb450204270c556,
title = "Active Object Perceiver: Recognition-Guided Policy Learning for Object Searching on Mobile Robots",
abstract = "We study the problem of learning a navigation policy for a robot to actively search for an object of interest in an indoor environment solely from its visual inputs. While scene-driven visual navigation has been widely studied, prior efforts on learning navigation policies for robots to find objects are limited. The problem is often more challenging than target scene finding as the target objects can be very small in the view and can be in an arbitrary pose. We approach the problem from an active perceiver perspective, and propose a novel framework that integrates a deep neural network based object recognition module and a deep reinforcement learning based action prediction mechanism. To validate our method, we conduct experiments on both a simulation dataset (AI2-THOR)and a real-world environment with a physical robot. We further propose a new decaying reward function to learn the control policy specific to the object searching task. Experimental results validate the efficacy of our method, which outperforms competing methods in both average trajectory length and success rate.",
author = "Xin Ye and Zhe Lin and Haoxiang Li and Shibin Zheng and Yezhou Yang",
year = "2018",
month = "12",
day = "27",
doi = "10.1109/IROS.2018.8593720",
language = "English (US)",
series = "IEEE International Conference on Intelligent Robots and Systems",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
pages = "6857--6863",
booktitle = "2018 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2018",

}

TY - GEN

T1 - Active Object Perceiver

T2 - Recognition-Guided Policy Learning for Object Searching on Mobile Robots

AU - Ye, Xin

AU - Lin, Zhe

AU - Li, Haoxiang

AU - Zheng, Shibin

AU - Yang, Yezhou

PY - 2018/12/27

Y1 - 2018/12/27

N2 - We study the problem of learning a navigation policy for a robot to actively search for an object of interest in an indoor environment solely from its visual inputs. While scene-driven visual navigation has been widely studied, prior efforts on learning navigation policies for robots to find objects are limited. The problem is often more challenging than target scene finding as the target objects can be very small in the view and can be in an arbitrary pose. We approach the problem from an active perceiver perspective, and propose a novel framework that integrates a deep neural network based object recognition module and a deep reinforcement learning based action prediction mechanism. To validate our method, we conduct experiments on both a simulation dataset (AI2-THOR)and a real-world environment with a physical robot. We further propose a new decaying reward function to learn the control policy specific to the object searching task. Experimental results validate the efficacy of our method, which outperforms competing methods in both average trajectory length and success rate.

AB - We study the problem of learning a navigation policy for a robot to actively search for an object of interest in an indoor environment solely from its visual inputs. While scene-driven visual navigation has been widely studied, prior efforts on learning navigation policies for robots to find objects are limited. The problem is often more challenging than target scene finding as the target objects can be very small in the view and can be in an arbitrary pose. We approach the problem from an active perceiver perspective, and propose a novel framework that integrates a deep neural network based object recognition module and a deep reinforcement learning based action prediction mechanism. To validate our method, we conduct experiments on both a simulation dataset (AI2-THOR)and a real-world environment with a physical robot. We further propose a new decaying reward function to learn the control policy specific to the object searching task. Experimental results validate the efficacy of our method, which outperforms competing methods in both average trajectory length and success rate.

UR - http://www.scopus.com/inward/record.url?scp=85062969692&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85062969692&partnerID=8YFLogxK

U2 - 10.1109/IROS.2018.8593720

DO - 10.1109/IROS.2018.8593720

M3 - Conference contribution

AN - SCOPUS:85062969692

T3 - IEEE International Conference on Intelligent Robots and Systems

SP - 6857

EP - 6863

BT - 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2018

PB - Institute of Electrical and Electronics Engineers Inc.

ER -