From motion capture to action capture: A review of imitation learning techniques and their application to VR-based character animation

Bernhard Jung, Heni Ben Amor, Guido Heumer, Matthias Weber

Research output: Chapter in Book/Report/Conference proceedingConference contribution

9 Scopus citations

Abstract

We present a novel method for virtual character animation that we call action capture. In this approach, virtual characters learn to imitate the actions of Virtual Reality (VR) users by tracking not only the users' movements but also their interactions with scene objects.Action capture builds on conventional motion capture but differs from it in that higher-level action representations are transferred rather than low-level motion data. As an advantage, the learned actions can often be naturally applied to varying situations, thus avoiding retargetting problems of motion capture. The idea of action capture is inspired by human imitation learning; related methods have been investigated for a longer time in robotics. The paper reviews the relevant literature in these areas before framing the concept of action capture in the context of VR-based character animation. We also present an example in which the actions of a VR user are transferred to a virtual worked.

Original languageEnglish (US)
Title of host publicationVRST'06
Subtitle of host publicationACM Symposium Virtual Reality Software and Technology
Pages145-154
Number of pages10
DOIs
StatePublished - Dec 1 2006
Event13th ACM Symposium Virtual Reality Software and Technology, VRST'06 - Limassol, Cyprus
Duration: Nov 1 2006Nov 3 2006

Publication series

NameProceedings of the ACM Symposium on Virtual Reality Software and Technology, VRST

Other

Other13th ACM Symposium Virtual Reality Software and Technology, VRST'06
CountryCyprus
CityLimassol
Period11/1/0611/3/06

    Fingerprint

Keywords

  • Action capture
  • Character animation
  • Imitation learning
  • Motion capture
  • Virtual reality

ASJC Scopus subject areas

  • Engineering(all)

Cite this

Jung, B., Amor, H. B., Heumer, G., & Weber, M. (2006). From motion capture to action capture: A review of imitation learning techniques and their application to VR-based character animation. In VRST'06: ACM Symposium Virtual Reality Software and Technology (pp. 145-154). (Proceedings of the ACM Symposium on Virtual Reality Software and Technology, VRST). https://doi.org/10.1145/1180495.1180526