A gesture-driven multimodal interactive dance system

Gang Qian, Feng Guo, Todd Ingalls, Loren Olson, Jody James, Thanassis Rikakis

Research output: Chapter in Book/Report/Conference proceedingConference contribution

44 Scopus citations

Abstract

In this paper, we report a real-time gesture driven interactive system with multimodal feedback for performing arts, especially dance. The system consists of two major parts: a gesture recognition engine and a multimodal feedback engine. The gesture recognition engine provides real-time recognition of the performer's gesture based on the 3D marker coordinates from a marker-based motion capture system. According to the recognition results, the multimodal feedback engine produces associated visual and audio feedback to the performer. This interactive system is simple to implement and robust to errors in 3D marker data. Satisfactory interactive dance performances have been successfully created and presented using the reported system.

Original languageEnglish (US)
Title of host publication2004 IEEE International Conference on Multimedia and Expo (ICME)
Pages1579-1582
Number of pages4
StatePublished - Dec 1 2004
Event2004 IEEE International Conference on Multimedia and Expo (ICME) - Taipei, Taiwan, Province of China
Duration: Jun 27 2004Jun 30 2004

Publication series

Name2004 IEEE International Conference on Multimedia and Expo (ICME)
Volume3

Other

Other2004 IEEE International Conference on Multimedia and Expo (ICME)
CountryTaiwan, Province of China
CityTaipei
Period6/27/046/30/04

    Fingerprint

ASJC Scopus subject areas

  • Engineering(all)

Cite this

Qian, G., Guo, F., Ingalls, T., Olson, L., James, J., & Rikakis, T. (2004). A gesture-driven multimodal interactive dance system. In 2004 IEEE International Conference on Multimedia and Expo (ICME) (pp. 1579-1582). (2004 IEEE International Conference on Multimedia and Expo (ICME); Vol. 3).