Abstract
We present a novel method for virtual character animation that we call action capture. In this approach, virtual characters learn to imitate the actions of Virtual Reality (VR) users by tracking not only the users' movements but also their interactions with scene objects.Action capture builds on conventional motion capture but differs from it in that higher-level action representations are transferred rather than low-level motion data. As an advantage, the learned actions can often be naturally applied to varying situations, thus avoiding retargetting problems of motion capture. The idea of action capture is inspired by human imitation learning; related methods have been investigated for a longer time in robotics. The paper reviews the relevant literature in these areas before framing the concept of action capture in the context of VR-based character animation. We also present an example in which the actions of a VR user are transferred to a virtual worked.
| Original language | English (US) |
|---|---|
| Title of host publication | Proceedings of the ACM Symposium on Virtual Reality Software and Technology, VRST |
| Pages | 145-154 |
| Number of pages | 10 |
| DOIs | |
| State | Published - 2006 |
| Externally published | Yes |
| Event | 13th ACM Symposium Virtual Reality Software and Technology, VRST'06 - Limassol, Cyprus Duration: Nov 1 2006 → Nov 3 2006 |
Other
| Other | 13th ACM Symposium Virtual Reality Software and Technology, VRST'06 |
|---|---|
| Country | Cyprus |
| City | Limassol |
| Period | 11/1/06 → 11/3/06 |
Fingerprint
Keywords
- Action capture
- Character animation
- Imitation learning
- Motion capture
- Virtual reality
ASJC Scopus subject areas
- Engineering(all)
Cite this
From motion capture to action capture : A review of imitation learning techniques and their application to VR-based character animation. / Jung, Bernhard; Ben Amor, Hani; Heumer, Guido; Weber, Matthias.
Proceedings of the ACM Symposium on Virtual Reality Software and Technology, VRST. 2006. p. 145-154.Research output: Chapter in Book/Report/Conference proceeding › Conference contribution
}
TY - GEN
T1 - From motion capture to action capture
T2 - A review of imitation learning techniques and their application to VR-based character animation
AU - Jung, Bernhard
AU - Ben Amor, Hani
AU - Heumer, Guido
AU - Weber, Matthias
PY - 2006
Y1 - 2006
N2 - We present a novel method for virtual character animation that we call action capture. In this approach, virtual characters learn to imitate the actions of Virtual Reality (VR) users by tracking not only the users' movements but also their interactions with scene objects.Action capture builds on conventional motion capture but differs from it in that higher-level action representations are transferred rather than low-level motion data. As an advantage, the learned actions can often be naturally applied to varying situations, thus avoiding retargetting problems of motion capture. The idea of action capture is inspired by human imitation learning; related methods have been investigated for a longer time in robotics. The paper reviews the relevant literature in these areas before framing the concept of action capture in the context of VR-based character animation. We also present an example in which the actions of a VR user are transferred to a virtual worked.
AB - We present a novel method for virtual character animation that we call action capture. In this approach, virtual characters learn to imitate the actions of Virtual Reality (VR) users by tracking not only the users' movements but also their interactions with scene objects.Action capture builds on conventional motion capture but differs from it in that higher-level action representations are transferred rather than low-level motion data. As an advantage, the learned actions can often be naturally applied to varying situations, thus avoiding retargetting problems of motion capture. The idea of action capture is inspired by human imitation learning; related methods have been investigated for a longer time in robotics. The paper reviews the relevant literature in these areas before framing the concept of action capture in the context of VR-based character animation. We also present an example in which the actions of a VR user are transferred to a virtual worked.
KW - Action capture
KW - Character animation
KW - Imitation learning
KW - Motion capture
KW - Virtual reality
UR - http://www.scopus.com/inward/record.url?scp=34547467245&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=34547467245&partnerID=8YFLogxK
U2 - 10.1145/1180495.1180526
DO - 10.1145/1180495.1180526
M3 - Conference contribution
AN - SCOPUS:34547467245
SN - 1595933212
SN - 9781595933218
SP - 145
EP - 154
BT - Proceedings of the ACM Symposium on Virtual Reality Software and Technology, VRST
ER -