Effects of voice-adaptation and social dialogue on perceptions of a robotic learning companion

Nichola Lubold, Erin Walker, Heather Pon-Barry

Research output: Chapter in Book/Report/Conference proceedingConference contribution

17 Scopus citations

Abstract

With a growing number of applications involving social human-robot interactions, there is an increasingly important role for socially responsive speech interfaces that can effectively engage the user. For example, learning companions provide both task-related feedback and motivational support for students with the goal of improving learning. As a learning companion's ability to be socially responsive increases, so do learning outcomes. This paper presents a socially responsive speech interface for an embodied, robotic learning companion. We explore two methods of social responsiveness. The first method introduces social responses into the dialogue, while the second method augments these responses with voice-adaptation based on acoustic-prosodic entrainment. We evaluate the effect of a social, voice-adaptive robotic learning companion on social variables such as social presence and rapport, and we compare this to a companion with only social dialogue and one with neither social dialogue nor voice-adaptions. We contrast the effects against those of individual factors, such as gender. We find (1) that social presence is significantly higher with a social voice-adaptive speech interface than with purely social dialogue, and (2) that females feel significantly more rapport and are significantly more persistent in interactions with a robotic learning companion than males.

Original languageEnglish (US)
Title of host publicationACM/IEEE International Conference on Human-Robot Interaction
PublisherIEEE Computer Society
Pages255-262
Number of pages8
Volume2016-April
ISBN (Print)9781467383707
DOIs
StatePublished - Apr 12 2016
Event11th Annual ACM/IEEE International Conference on Human-Robot Interaction, HRI 2016 - Christchurch, New Zealand
Duration: Mar 7 2016Mar 10 2016

Other

Other11th Annual ACM/IEEE International Conference on Human-Robot Interaction, HRI 2016
CountryNew Zealand
CityChristchurch
Period3/7/163/10/16

Keywords

  • Acoustic-prosodic entrainment
  • Adaptive learning companion
  • Rapport
  • Social presence
  • Spoken dialogue

ASJC Scopus subject areas

  • Artificial Intelligence
  • Human-Computer Interaction
  • Electrical and Electronic Engineering

Fingerprint Dive into the research topics of 'Effects of voice-adaptation and social dialogue on perceptions of a robotic learning companion'. Together they form a unique fingerprint.

  • Cite this

    Lubold, N., Walker, E., & Pon-Barry, H. (2016). Effects of voice-adaptation and social dialogue on perceptions of a robotic learning companion. In ACM/IEEE International Conference on Human-Robot Interaction (Vol. 2016-April, pp. 255-262). [7451760] IEEE Computer Society. https://doi.org/10.1109/HRI.2016.7451760