What to do and how to do it: Translating natural language directives into temporal and dynamic logic representation for goal management and action execution

Juraj Dzifcak, Matthias Scheutz, Chitta Baral, Paul Schermerhorn

Research output: Chapter in Book/Report/Conference proceedingConference contribution

95 Scopus citations

Abstract

Robots that can be given instructions in spoken language need to be able to parse a natural language utterance quickly, determine its meaning, generate a goal representation from it, check whether the new goal conflicts with existing goals,and if acceptable, produce an action sequence to achieve the new goal (ideally being sensitive to the existing goals).In this paper, we describe an integrated robotic architecture that can achieve the above steps by translating natural language instructions incrementally and simultaneously into formal logical goal description and action languages, which can be used both to reason about the achievability of a goal as well as to generate new action scripts to pursue the goal. We demonstrate the implementation of our approach on a robot taking spoken natural language instructions in an office environment.

Original languageEnglish (US)
Title of host publication2009 IEEE International Conference on Robotics and Automation, ICRA '09
Pages4163-4168
Number of pages6
DOIs
StatePublished - Nov 2 2009
Event2009 IEEE International Conference on Robotics and Automation, ICRA '09 - Kobe, Japan
Duration: May 12 2009May 17 2009

Publication series

NameProceedings - IEEE International Conference on Robotics and Automation
ISSN (Print)1050-4729

Other

Other2009 IEEE International Conference on Robotics and Automation, ICRA '09
CountryJapan
CityKobe
Period5/12/095/17/09

ASJC Scopus subject areas

  • Software
  • Control and Systems Engineering
  • Artificial Intelligence
  • Electrical and Electronic Engineering

Fingerprint Dive into the research topics of 'What to do and how to do it: Translating natural language directives into temporal and dynamic logic representation for goal management and action execution'. Together they form a unique fingerprint.

  • Cite this

    Dzifcak, J., Scheutz, M., Baral, C., & Schermerhorn, P. (2009). What to do and how to do it: Translating natural language directives into temporal and dynamic logic representation for goal management and action execution. In 2009 IEEE International Conference on Robotics and Automation, ICRA '09 (pp. 4163-4168). [5152776] (Proceedings - IEEE International Conference on Robotics and Automation). https://doi.org/10.1109/ROBOT.2009.5152776