Posture affects how robots and infants map words to objects

Anthony F. Morse, Viridiana Benitez, Tony Belpaeme, Angelo Cangelosi, Linda B. Smith

Research output: Contribution to journalArticle

24 Citations (Scopus)

Abstract

For infants, the first problem in learning a word is to map the word to its referent; a second problem is to remember that mapping when the word and/or referent are again encountered. Recent infant studies suggest that spatial location plays a key role in how infants solve both problems. Here we provide a new theoretical model and new empirical evidence on how the body - and its momentary posture - may be central to these processes. The present study uses a name-object mapping task in which names are either encountered in the absence of their target (experiments 1-3, 6 & 7), or when their target is present but in a location previously associated with a foil (experiments 4, 5, 8 & 9). A humanoid robot model (experiments 1-5) is used to instantiate and test the hypothesis that body-centric spatial location, and thus the bodies ' momentary posture, is used to centrally bind the multimodal features of heard names and visual objects. The robot model is shown to replicate existing infant data and then to generate novel predictions, which are tested in new infant studies (experiments 6-9). Despite spatial location being task-irrelevant in this second set of experiments, infants use body-centric spatial contingency over temporal contingency to map the name to object. Both infants and the robot remember the name-object mapping even in new spatial locations. However, the robot model shows how this memory can emerge -not from separating bodily information from the word-object mapping as proposed in previous models of the role of space in word-object mapping - but through the body's momentary disposition in space.

Original languageEnglish (US)
Article numbere0116012
JournalPLoS One
Volume10
Issue number3
DOIs
StatePublished - Mar 18 2015
Externally publishedYes

Fingerprint

robots
posture
Posture
Robots
Names
Experiments
foil
Space Simulation
Metal foil
learning
Data storage equipment
prediction
Theoretical Models
Learning
testing

ASJC Scopus subject areas

  • Biochemistry, Genetics and Molecular Biology(all)
  • Agricultural and Biological Sciences(all)

Cite this

Morse, A. F., Benitez, V., Belpaeme, T., Cangelosi, A., & Smith, L. B. (2015). Posture affects how robots and infants map words to objects. PLoS One, 10(3), [e0116012]. https://doi.org/10.1371/journal.pone.0116012

Posture affects how robots and infants map words to objects. / Morse, Anthony F.; Benitez, Viridiana; Belpaeme, Tony; Cangelosi, Angelo; Smith, Linda B.

In: PLoS One, Vol. 10, No. 3, e0116012, 18.03.2015.

Research output: Contribution to journalArticle

Morse, AF, Benitez, V, Belpaeme, T, Cangelosi, A & Smith, LB 2015, 'Posture affects how robots and infants map words to objects', PLoS One, vol. 10, no. 3, e0116012. https://doi.org/10.1371/journal.pone.0116012
Morse, Anthony F. ; Benitez, Viridiana ; Belpaeme, Tony ; Cangelosi, Angelo ; Smith, Linda B. / Posture affects how robots and infants map words to objects. In: PLoS One. 2015 ; Vol. 10, No. 3.
@article{b28c8ba961cc41eeaa30e9c3c4cf8846,
title = "Posture affects how robots and infants map words to objects",
abstract = "For infants, the first problem in learning a word is to map the word to its referent; a second problem is to remember that mapping when the word and/or referent are again encountered. Recent infant studies suggest that spatial location plays a key role in how infants solve both problems. Here we provide a new theoretical model and new empirical evidence on how the body - and its momentary posture - may be central to these processes. The present study uses a name-object mapping task in which names are either encountered in the absence of their target (experiments 1-3, 6 & 7), or when their target is present but in a location previously associated with a foil (experiments 4, 5, 8 & 9). A humanoid robot model (experiments 1-5) is used to instantiate and test the hypothesis that body-centric spatial location, and thus the bodies ' momentary posture, is used to centrally bind the multimodal features of heard names and visual objects. The robot model is shown to replicate existing infant data and then to generate novel predictions, which are tested in new infant studies (experiments 6-9). Despite spatial location being task-irrelevant in this second set of experiments, infants use body-centric spatial contingency over temporal contingency to map the name to object. Both infants and the robot remember the name-object mapping even in new spatial locations. However, the robot model shows how this memory can emerge -not from separating bodily information from the word-object mapping as proposed in previous models of the role of space in word-object mapping - but through the body's momentary disposition in space.",
author = "Morse, {Anthony F.} and Viridiana Benitez and Tony Belpaeme and Angelo Cangelosi and Smith, {Linda B.}",
year = "2015",
month = "3",
day = "18",
doi = "10.1371/journal.pone.0116012",
language = "English (US)",
volume = "10",
journal = "PLoS One",
issn = "1932-6203",
publisher = "Public Library of Science",
number = "3",

}

TY - JOUR

T1 - Posture affects how robots and infants map words to objects

AU - Morse, Anthony F.

AU - Benitez, Viridiana

AU - Belpaeme, Tony

AU - Cangelosi, Angelo

AU - Smith, Linda B.

PY - 2015/3/18

Y1 - 2015/3/18

N2 - For infants, the first problem in learning a word is to map the word to its referent; a second problem is to remember that mapping when the word and/or referent are again encountered. Recent infant studies suggest that spatial location plays a key role in how infants solve both problems. Here we provide a new theoretical model and new empirical evidence on how the body - and its momentary posture - may be central to these processes. The present study uses a name-object mapping task in which names are either encountered in the absence of their target (experiments 1-3, 6 & 7), or when their target is present but in a location previously associated with a foil (experiments 4, 5, 8 & 9). A humanoid robot model (experiments 1-5) is used to instantiate and test the hypothesis that body-centric spatial location, and thus the bodies ' momentary posture, is used to centrally bind the multimodal features of heard names and visual objects. The robot model is shown to replicate existing infant data and then to generate novel predictions, which are tested in new infant studies (experiments 6-9). Despite spatial location being task-irrelevant in this second set of experiments, infants use body-centric spatial contingency over temporal contingency to map the name to object. Both infants and the robot remember the name-object mapping even in new spatial locations. However, the robot model shows how this memory can emerge -not from separating bodily information from the word-object mapping as proposed in previous models of the role of space in word-object mapping - but through the body's momentary disposition in space.

AB - For infants, the first problem in learning a word is to map the word to its referent; a second problem is to remember that mapping when the word and/or referent are again encountered. Recent infant studies suggest that spatial location plays a key role in how infants solve both problems. Here we provide a new theoretical model and new empirical evidence on how the body - and its momentary posture - may be central to these processes. The present study uses a name-object mapping task in which names are either encountered in the absence of their target (experiments 1-3, 6 & 7), or when their target is present but in a location previously associated with a foil (experiments 4, 5, 8 & 9). A humanoid robot model (experiments 1-5) is used to instantiate and test the hypothesis that body-centric spatial location, and thus the bodies ' momentary posture, is used to centrally bind the multimodal features of heard names and visual objects. The robot model is shown to replicate existing infant data and then to generate novel predictions, which are tested in new infant studies (experiments 6-9). Despite spatial location being task-irrelevant in this second set of experiments, infants use body-centric spatial contingency over temporal contingency to map the name to object. Both infants and the robot remember the name-object mapping even in new spatial locations. However, the robot model shows how this memory can emerge -not from separating bodily information from the word-object mapping as proposed in previous models of the role of space in word-object mapping - but through the body's momentary disposition in space.

UR - http://www.scopus.com/inward/record.url?scp=84925436587&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84925436587&partnerID=8YFLogxK

U2 - 10.1371/journal.pone.0116012

DO - 10.1371/journal.pone.0116012

M3 - Article

C2 - 25785834

AN - SCOPUS:84925436587

VL - 10

JO - PLoS One

JF - PLoS One

SN - 1932-6203

IS - 3

M1 - e0116012

ER -