What to do and how to do it

Translating natural language directives into temporal and dynamic logic representation for goal management and action execution

Juraj Dzifcak, Matthias Scheutz, Chitta Baral, Paul Schermerhorn

Research output: Chapter in Book/Report/Conference proceedingConference contribution

86 Citations (Scopus)

Abstract

Robots that can be given instructions in spoken language need to be able to parse a natural language utterance quickly, determine its meaning, generate a goal representation from it, check whether the new goal conflicts with existing goals,and if acceptable, produce an action sequence to achieve the new goal (ideally being sensitive to the existing goals).In this paper, we describe an integrated robotic architecture that can achieve the above steps by translating natural language instructions incrementally and simultaneously into formal logical goal description and action languages, which can be used both to reason about the achievability of a goal as well as to generate new action scripts to pursue the goal. We demonstrate the implementation of our approach on a robot taking spoken natural language instructions in an office environment.

Original languageEnglish (US)
Title of host publicationProceedings - IEEE International Conference on Robotics and Automation
Pages4163-4168
Number of pages6
DOIs
StatePublished - 2009
Externally publishedYes
Event2009 IEEE International Conference on Robotics and Automation, ICRA '09 - Kobe, Japan
Duration: May 12 2009May 17 2009

Other

Other2009 IEEE International Conference on Robotics and Automation, ICRA '09
CountryJapan
CityKobe
Period5/12/095/17/09

Fingerprint

Robots
Robotics

ASJC Scopus subject areas

  • Software
  • Artificial Intelligence
  • Control and Systems Engineering
  • Electrical and Electronic Engineering

Cite this

Dzifcak, J., Scheutz, M., Baral, C., & Schermerhorn, P. (2009). What to do and how to do it: Translating natural language directives into temporal and dynamic logic representation for goal management and action execution. In Proceedings - IEEE International Conference on Robotics and Automation (pp. 4163-4168). [5152776] https://doi.org/10.1109/ROBOT.2009.5152776

What to do and how to do it : Translating natural language directives into temporal and dynamic logic representation for goal management and action execution. / Dzifcak, Juraj; Scheutz, Matthias; Baral, Chitta; Schermerhorn, Paul.

Proceedings - IEEE International Conference on Robotics and Automation. 2009. p. 4163-4168 5152776.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Dzifcak, J, Scheutz, M, Baral, C & Schermerhorn, P 2009, What to do and how to do it: Translating natural language directives into temporal and dynamic logic representation for goal management and action execution. in Proceedings - IEEE International Conference on Robotics and Automation., 5152776, pp. 4163-4168, 2009 IEEE International Conference on Robotics and Automation, ICRA '09, Kobe, Japan, 5/12/09. https://doi.org/10.1109/ROBOT.2009.5152776
Dzifcak J, Scheutz M, Baral C, Schermerhorn P. What to do and how to do it: Translating natural language directives into temporal and dynamic logic representation for goal management and action execution. In Proceedings - IEEE International Conference on Robotics and Automation. 2009. p. 4163-4168. 5152776 https://doi.org/10.1109/ROBOT.2009.5152776
Dzifcak, Juraj ; Scheutz, Matthias ; Baral, Chitta ; Schermerhorn, Paul. / What to do and how to do it : Translating natural language directives into temporal and dynamic logic representation for goal management and action execution. Proceedings - IEEE International Conference on Robotics and Automation. 2009. pp. 4163-4168
@inproceedings{8daebc92fc92460b84052a72d6f6c430,
title = "What to do and how to do it: Translating natural language directives into temporal and dynamic logic representation for goal management and action execution",
abstract = "Robots that can be given instructions in spoken language need to be able to parse a natural language utterance quickly, determine its meaning, generate a goal representation from it, check whether the new goal conflicts with existing goals,and if acceptable, produce an action sequence to achieve the new goal (ideally being sensitive to the existing goals).In this paper, we describe an integrated robotic architecture that can achieve the above steps by translating natural language instructions incrementally and simultaneously into formal logical goal description and action languages, which can be used both to reason about the achievability of a goal as well as to generate new action scripts to pursue the goal. We demonstrate the implementation of our approach on a robot taking spoken natural language instructions in an office environment.",
author = "Juraj Dzifcak and Matthias Scheutz and Chitta Baral and Paul Schermerhorn",
year = "2009",
doi = "10.1109/ROBOT.2009.5152776",
language = "English (US)",
isbn = "9781424427895",
pages = "4163--4168",
booktitle = "Proceedings - IEEE International Conference on Robotics and Automation",

}

TY - GEN

T1 - What to do and how to do it

T2 - Translating natural language directives into temporal and dynamic logic representation for goal management and action execution

AU - Dzifcak, Juraj

AU - Scheutz, Matthias

AU - Baral, Chitta

AU - Schermerhorn, Paul

PY - 2009

Y1 - 2009

N2 - Robots that can be given instructions in spoken language need to be able to parse a natural language utterance quickly, determine its meaning, generate a goal representation from it, check whether the new goal conflicts with existing goals,and if acceptable, produce an action sequence to achieve the new goal (ideally being sensitive to the existing goals).In this paper, we describe an integrated robotic architecture that can achieve the above steps by translating natural language instructions incrementally and simultaneously into formal logical goal description and action languages, which can be used both to reason about the achievability of a goal as well as to generate new action scripts to pursue the goal. We demonstrate the implementation of our approach on a robot taking spoken natural language instructions in an office environment.

AB - Robots that can be given instructions in spoken language need to be able to parse a natural language utterance quickly, determine its meaning, generate a goal representation from it, check whether the new goal conflicts with existing goals,and if acceptable, produce an action sequence to achieve the new goal (ideally being sensitive to the existing goals).In this paper, we describe an integrated robotic architecture that can achieve the above steps by translating natural language instructions incrementally and simultaneously into formal logical goal description and action languages, which can be used both to reason about the achievability of a goal as well as to generate new action scripts to pursue the goal. We demonstrate the implementation of our approach on a robot taking spoken natural language instructions in an office environment.

UR - http://www.scopus.com/inward/record.url?scp=70350359650&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=70350359650&partnerID=8YFLogxK

U2 - 10.1109/ROBOT.2009.5152776

DO - 10.1109/ROBOT.2009.5152776

M3 - Conference contribution

SN - 9781424427895

SP - 4163

EP - 4168

BT - Proceedings - IEEE International Conference on Robotics and Automation

ER -