Synergistic methods for using language in robotics

Ching L. Teo; Yezhou Yang; Yiannis Aloimonos; Cornelia Fermüller

doi:10.1145/2393091.2393109

Synergistic methods for using language in robotics

Ching L. Teo, Yezhou Yang, Yiannis Aloimonos, Cornelia Fermüller

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

1 Scopus citations

Abstract

This paper presents an overview of our work on integrating language with vision to endow robots with the ability of complex scene understanding. We propose and motivate the Vision-ActionLanguage loop as a form of cognitive dialogue that enables us to integrate current tools in linguistics, vision and AI. We present several experimental results of preliminary implementation and discuss future research directions that we view as crucial for developing the cognitive robots of the future.

Original language	English (US)
Title of host publication	Proceedings of the Workshop on Performance Metrics for Intelligent Systems, PerMIS 2012
Pages	82-88
Number of pages	7
DOIs	https://doi.org/10.1145/2393091.2393109
State	Published - 2012
Externally published	Yes
Event	11th Workshop on Performance Metrics for Intelligent Systems, PerMIS 2012 - College Park, MD, United States Duration: Mar 20 2012 → Mar 22 2012

Publication series

Name	Performance Metrics for Intelligent Systems (PerMIS) Workshop

Other

Other	11th Workshop on Performance Metrics for Intelligent Systems, PerMIS 2012
Country/Territory	United States
City	College Park, MD
Period	3/20/12 → 3/22/12

Keywords

Cognitive robotics
Computational linguistics
Computer vision

ASJC Scopus subject areas

Artificial Intelligence
Computer Science Applications
Control and Systems Engineering

Access to Document

10.1145/2393091.2393109

Cite this

Teo, CL, Yang, Y, Aloimonos, Y & Fermüller, C 2012, Synergistic methods for using language in robotics. in Proceedings of the Workshop on Performance Metrics for Intelligent Systems, PerMIS 2012. Performance Metrics for Intelligent Systems (PerMIS) Workshop, pp. 82-88, 11th Workshop on Performance Metrics for Intelligent Systems, PerMIS 2012, College Park, MD, United States, 3/20/12. https://doi.org/10.1145/2393091.2393109

@inproceedings{ee01a5a732e943b8a22156029a0414b4,

title = "Synergistic methods for using language in robotics",

abstract = "This paper presents an overview of our work on integrating language with vision to endow robots with the ability of complex scene understanding. We propose and motivate the Vision-ActionLanguage loop as a form of cognitive dialogue that enables us to integrate current tools in linguistics, vision and AI. We present several experimental results of preliminary implementation and discuss future research directions that we view as crucial for developing the cognitive robots of the future.",

keywords = "Cognitive robotics, Computational linguistics, Computer vision",

author = "Teo, {Ching L.} and Yezhou Yang and Yiannis Aloimonos and Cornelia Ferm{\"u}ller",

year = "2012",

doi = "10.1145/2393091.2393109",

language = "English (US)",

isbn = "9781450311267",

series = "Performance Metrics for Intelligent Systems (PerMIS) Workshop",

pages = "82--88",

booktitle = "Proceedings of the Workshop on Performance Metrics for Intelligent Systems, PerMIS 2012",

note = "11th Workshop on Performance Metrics for Intelligent Systems, PerMIS 2012 ; Conference date: 20-03-2012 Through 22-03-2012",

}

TY - GEN

T1 - Synergistic methods for using language in robotics

AU - Teo, Ching L.

AU - Yang, Yezhou

AU - Aloimonos, Yiannis

AU - Fermüller, Cornelia

PY - 2012

Y1 - 2012

N2 - This paper presents an overview of our work on integrating language with vision to endow robots with the ability of complex scene understanding. We propose and motivate the Vision-ActionLanguage loop as a form of cognitive dialogue that enables us to integrate current tools in linguistics, vision and AI. We present several experimental results of preliminary implementation and discuss future research directions that we view as crucial for developing the cognitive robots of the future.

AB - This paper presents an overview of our work on integrating language with vision to endow robots with the ability of complex scene understanding. We propose and motivate the Vision-ActionLanguage loop as a form of cognitive dialogue that enables us to integrate current tools in linguistics, vision and AI. We present several experimental results of preliminary implementation and discuss future research directions that we view as crucial for developing the cognitive robots of the future.

KW - Cognitive robotics

KW - Computational linguistics

KW - Computer vision

UR - http://www.scopus.com/inward/record.url?scp=84870614946&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84870614946&partnerID=8YFLogxK

U2 - 10.1145/2393091.2393109

DO - 10.1145/2393091.2393109

M3 - Conference contribution

AN - SCOPUS:84870614946

SN - 9781450311267

T3 - Performance Metrics for Intelligent Systems (PerMIS) Workshop

SP - 82

EP - 88

BT - Proceedings of the Workshop on Performance Metrics for Intelligent Systems, PerMIS 2012

T2 - 11th Workshop on Performance Metrics for Intelligent Systems, PerMIS 2012

Y2 - 20 March 2012 through 22 March 2012

ER -

Synergistic methods for using language in robotics

Abstract

Publication series

Other

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this