A gesture-driven multimodal interactive dance system

Gang Qian, Feng Guo, Todd Ingalls, Loren Olson, Jody James, Thanassis Rikakis

Research output: Chapter in Book/Report/Conference proceedingConference contribution

50 Scopus citations


In this paper, we report a real-time gesture driven interactive system with multimodal feedback for performing arts, especially dance. The system consists of two major parts: a gesture recognition engine and a multimodal feedback engine. The gesture recognition engine provides real-time recognition of the performer's gesture based on the 3D marker coordinates from a marker-based motion capture system. According to the recognition results, the multimodal feedback engine produces associated visual and audio feedback to the performer. This interactive system is simple to implement and robust to errors in 3D marker data. Satisfactory interactive dance performances have been successfully created and presented using the reported system.

Original languageEnglish (US)
Title of host publication2004 IEEE International Conference on Multimedia and Expo (ICME)
Number of pages4
StatePublished - Dec 1 2004
Event2004 IEEE International Conference on Multimedia and Expo (ICME) - Taipei, Taiwan, Province of China
Duration: Jun 27 2004Jun 30 2004

Publication series

Name2004 IEEE International Conference on Multimedia and Expo (ICME)


Other2004 IEEE International Conference on Multimedia and Expo (ICME)
Country/TerritoryTaiwan, Province of China

ASJC Scopus subject areas

  • Engineering(all)


Dive into the research topics of 'A gesture-driven multimodal interactive dance system'. Together they form a unique fingerprint.

Cite this