Synergistic methods for using language in robotics

Ching L. Teo, Yezhou Yang, Yiannis Aloimonos, Cornelia Fermüller

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

This paper presents an overview of our work on integrating language with vision to endow robots with the ability of complex scene understanding. We propose and motivate the Vision-ActionLanguage loop as a form of cognitive dialogue that enables us to integrate current tools in linguistics, vision and AI. We present several experimental results of preliminary implementation and discuss future research directions that we view as crucial for developing the cognitive robots of the future.

Original languageEnglish (US)
Title of host publicationProceedings of the Workshop on Performance Metrics for Intelligent Systems, PerMIS 2012
Pages82-88
Number of pages7
DOIs
StatePublished - 2012
Externally publishedYes
Event11th Workshop on Performance Metrics for Intelligent Systems, PerMIS 2012 - College Park, MD, United States
Duration: Mar 20 2012Mar 22 2012

Other

Other11th Workshop on Performance Metrics for Intelligent Systems, PerMIS 2012
CountryUnited States
CityCollege Park, MD
Period3/20/123/22/12

Fingerprint

Robotics
Robots
Linguistics

Keywords

  • Cognitive robotics
  • Computational linguistics
  • Computer vision

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computer Science Applications
  • Control and Systems Engineering

Cite this

Teo, C. L., Yang, Y., Aloimonos, Y., & Fermüller, C. (2012). Synergistic methods for using language in robotics. In Proceedings of the Workshop on Performance Metrics for Intelligent Systems, PerMIS 2012 (pp. 82-88) https://doi.org/10.1145/2393091.2393109

Synergistic methods for using language in robotics. / Teo, Ching L.; Yang, Yezhou; Aloimonos, Yiannis; Fermüller, Cornelia.

Proceedings of the Workshop on Performance Metrics for Intelligent Systems, PerMIS 2012. 2012. p. 82-88.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Teo, CL, Yang, Y, Aloimonos, Y & Fermüller, C 2012, Synergistic methods for using language in robotics. in Proceedings of the Workshop on Performance Metrics for Intelligent Systems, PerMIS 2012. pp. 82-88, 11th Workshop on Performance Metrics for Intelligent Systems, PerMIS 2012, College Park, MD, United States, 3/20/12. https://doi.org/10.1145/2393091.2393109
Teo CL, Yang Y, Aloimonos Y, Fermüller C. Synergistic methods for using language in robotics. In Proceedings of the Workshop on Performance Metrics for Intelligent Systems, PerMIS 2012. 2012. p. 82-88 https://doi.org/10.1145/2393091.2393109
Teo, Ching L. ; Yang, Yezhou ; Aloimonos, Yiannis ; Fermüller, Cornelia. / Synergistic methods for using language in robotics. Proceedings of the Workshop on Performance Metrics for Intelligent Systems, PerMIS 2012. 2012. pp. 82-88
@inproceedings{ee01a5a732e943b8a22156029a0414b4,
title = "Synergistic methods for using language in robotics",
abstract = "This paper presents an overview of our work on integrating language with vision to endow robots with the ability of complex scene understanding. We propose and motivate the Vision-ActionLanguage loop as a form of cognitive dialogue that enables us to integrate current tools in linguistics, vision and AI. We present several experimental results of preliminary implementation and discuss future research directions that we view as crucial for developing the cognitive robots of the future.",
keywords = "Cognitive robotics, Computational linguistics, Computer vision",
author = "Teo, {Ching L.} and Yezhou Yang and Yiannis Aloimonos and Cornelia Ferm{\"u}ller",
year = "2012",
doi = "10.1145/2393091.2393109",
language = "English (US)",
isbn = "9781450311267",
pages = "82--88",
booktitle = "Proceedings of the Workshop on Performance Metrics for Intelligent Systems, PerMIS 2012",

}

TY - GEN

T1 - Synergistic methods for using language in robotics

AU - Teo, Ching L.

AU - Yang, Yezhou

AU - Aloimonos, Yiannis

AU - Fermüller, Cornelia

PY - 2012

Y1 - 2012

N2 - This paper presents an overview of our work on integrating language with vision to endow robots with the ability of complex scene understanding. We propose and motivate the Vision-ActionLanguage loop as a form of cognitive dialogue that enables us to integrate current tools in linguistics, vision and AI. We present several experimental results of preliminary implementation and discuss future research directions that we view as crucial for developing the cognitive robots of the future.

AB - This paper presents an overview of our work on integrating language with vision to endow robots with the ability of complex scene understanding. We propose and motivate the Vision-ActionLanguage loop as a form of cognitive dialogue that enables us to integrate current tools in linguistics, vision and AI. We present several experimental results of preliminary implementation and discuss future research directions that we view as crucial for developing the cognitive robots of the future.

KW - Cognitive robotics

KW - Computational linguistics

KW - Computer vision

UR - http://www.scopus.com/inward/record.url?scp=84870614946&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84870614946&partnerID=8YFLogxK

U2 - 10.1145/2393091.2393109

DO - 10.1145/2393091.2393109

M3 - Conference contribution

SN - 9781450311267

SP - 82

EP - 88

BT - Proceedings of the Workshop on Performance Metrics for Intelligent Systems, PerMIS 2012

ER -