Tell me when and why to do it! Run-time planner model updates via natural language instruction

Rehj Cantrell, Kartik Talamadupula, Paul Schermerhorn, J. Benton, Subbarao Kambhampati, Matthias Scheutz

Research output: Chapter in Book/Report/Conference proceedingConference contribution

45 Scopus citations

Abstract

Robots are currently being used in and developed for critical HRI applications such as search and rescue. In these scenarios, humans operating under changeable and high-stress conditions must communicate effectively with autonomous agents, necessitating that such agents be able to respond quickly and effectively to rapidly-changing conditions and expectations. We demonstrate a robot planner that is able to utilize new information, specifically information originating in spoken input produced by human operators. We show that the robot is able to learn the pre- and postconditions of previously-unknown action sequences from natural language constructions, and immediately update (1) its knowledge of the current state of the environment, and (2) its underlying world model, in order to produce new and updated plans that are consistent with this new information. While we demonstrate in detail the robot's successful operation with a specific example, we also discuss the dialogue module's inherent scalability, and investigate how well the robot is able to respond to natural language commands from untrained users.

Original languageEnglish (US)
Title of host publicationHRI'12 - Proceedings of the 7th Annual ACM/IEEE International Conference on Human-Robot Interaction
Pages471-478
Number of pages8
DOIs
StatePublished - Apr 26 2012
Event7th Annual ACM/IEEE International Conference on Human-Robot Interaction, HRI'12 - Boston, MA, United States
Duration: Mar 5 2012Mar 8 2012

Publication series

NameHRI'12 - Proceedings of the 7th Annual ACM/IEEE International Conference on Human-Robot Interaction

Other

Other7th Annual ACM/IEEE International Conference on Human-Robot Interaction, HRI'12
CountryUnited States
CityBoston, MA
Period3/5/123/8/12

Keywords

  • enabling technologies
  • hri communication
  • language processing
  • learning about the environment
  • learning from interaction

ASJC Scopus subject areas

  • Human-Computer Interaction

Fingerprint Dive into the research topics of 'Tell me when and why to do it! Run-time planner model updates via natural language instruction'. Together they form a unique fingerprint.

  • Cite this

    Cantrell, R., Talamadupula, K., Schermerhorn, P., Benton, J., Kambhampati, S., & Scheutz, M. (2012). Tell me when and why to do it! Run-time planner model updates via natural language instruction. In HRI'12 - Proceedings of the 7th Annual ACM/IEEE International Conference on Human-Robot Interaction (pp. 471-478). (HRI'12 - Proceedings of the 7th Annual ACM/IEEE International Conference on Human-Robot Interaction). https://doi.org/10.1145/2157689.2157840