A gesture-driven multimodal interactive dance system

Gang Qian, Feng Guo, Todd Ingalls, Loren Olson, Jody James, Thanassis Rikakis

Research output: Chapter in Book/Report/Conference proceedingConference contribution

44 Citations (Scopus)

Abstract

In this paper, we report a real-time gesture driven interactive system with multimodal feedback for performing arts, especially dance. The system consists of two major parts: a gesture recognition engine and a multimodal feedback engine. The gesture recognition engine provides real-time recognition of the performer's gesture based on the 3D marker coordinates from a marker-based motion capture system. According to the recognition results, the multimodal feedback engine produces associated visual and audio feedback to the performer. This interactive system is simple to implement and robust to errors in 3D marker data. Satisfactory interactive dance performances have been successfully created and presented using the reported system.

Original languageEnglish (US)
Title of host publication2004 IEEE International Conference on Multimedia and Expo (ICME)
Pages1579-1582
Number of pages4
StatePublished - Dec 1 2004
Event2004 IEEE International Conference on Multimedia and Expo (ICME) - Taipei, Taiwan, Province of China
Duration: Jun 27 2004Jun 30 2004

Publication series

Name2004 IEEE International Conference on Multimedia and Expo (ICME)
Volume3

Other

Other2004 IEEE International Conference on Multimedia and Expo (ICME)
CountryTaiwan, Province of China
CityTaipei
Period6/27/046/30/04

Fingerprint

Engines
Feedback
Gesture recognition

ASJC Scopus subject areas

  • Engineering(all)

Cite this

Qian, G., Guo, F., Ingalls, T., Olson, L., James, J., & Rikakis, T. (2004). A gesture-driven multimodal interactive dance system. In 2004 IEEE International Conference on Multimedia and Expo (ICME) (pp. 1579-1582). (2004 IEEE International Conference on Multimedia and Expo (ICME); Vol. 3).

A gesture-driven multimodal interactive dance system. / Qian, Gang; Guo, Feng; Ingalls, Todd; Olson, Loren; James, Jody; Rikakis, Thanassis.

2004 IEEE International Conference on Multimedia and Expo (ICME). 2004. p. 1579-1582 (2004 IEEE International Conference on Multimedia and Expo (ICME); Vol. 3).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Qian, G, Guo, F, Ingalls, T, Olson, L, James, J & Rikakis, T 2004, A gesture-driven multimodal interactive dance system. in 2004 IEEE International Conference on Multimedia and Expo (ICME). 2004 IEEE International Conference on Multimedia and Expo (ICME), vol. 3, pp. 1579-1582, 2004 IEEE International Conference on Multimedia and Expo (ICME), Taipei, Taiwan, Province of China, 6/27/04.
Qian G, Guo F, Ingalls T, Olson L, James J, Rikakis T. A gesture-driven multimodal interactive dance system. In 2004 IEEE International Conference on Multimedia and Expo (ICME). 2004. p. 1579-1582. (2004 IEEE International Conference on Multimedia and Expo (ICME)).
Qian, Gang ; Guo, Feng ; Ingalls, Todd ; Olson, Loren ; James, Jody ; Rikakis, Thanassis. / A gesture-driven multimodal interactive dance system. 2004 IEEE International Conference on Multimedia and Expo (ICME). 2004. pp. 1579-1582 (2004 IEEE International Conference on Multimedia and Expo (ICME)).
@inproceedings{e432bcca4988477f9edad1bd2c4f34ed,
title = "A gesture-driven multimodal interactive dance system",
abstract = "In this paper, we report a real-time gesture driven interactive system with multimodal feedback for performing arts, especially dance. The system consists of two major parts: a gesture recognition engine and a multimodal feedback engine. The gesture recognition engine provides real-time recognition of the performer's gesture based on the 3D marker coordinates from a marker-based motion capture system. According to the recognition results, the multimodal feedback engine produces associated visual and audio feedback to the performer. This interactive system is simple to implement and robust to errors in 3D marker data. Satisfactory interactive dance performances have been successfully created and presented using the reported system.",
author = "Gang Qian and Feng Guo and Todd Ingalls and Loren Olson and Jody James and Thanassis Rikakis",
year = "2004",
month = "12",
day = "1",
language = "English (US)",
isbn = "0780386035",
series = "2004 IEEE International Conference on Multimedia and Expo (ICME)",
pages = "1579--1582",
booktitle = "2004 IEEE International Conference on Multimedia and Expo (ICME)",

}

TY - GEN

T1 - A gesture-driven multimodal interactive dance system

AU - Qian, Gang

AU - Guo, Feng

AU - Ingalls, Todd

AU - Olson, Loren

AU - James, Jody

AU - Rikakis, Thanassis

PY - 2004/12/1

Y1 - 2004/12/1

N2 - In this paper, we report a real-time gesture driven interactive system with multimodal feedback for performing arts, especially dance. The system consists of two major parts: a gesture recognition engine and a multimodal feedback engine. The gesture recognition engine provides real-time recognition of the performer's gesture based on the 3D marker coordinates from a marker-based motion capture system. According to the recognition results, the multimodal feedback engine produces associated visual and audio feedback to the performer. This interactive system is simple to implement and robust to errors in 3D marker data. Satisfactory interactive dance performances have been successfully created and presented using the reported system.

AB - In this paper, we report a real-time gesture driven interactive system with multimodal feedback for performing arts, especially dance. The system consists of two major parts: a gesture recognition engine and a multimodal feedback engine. The gesture recognition engine provides real-time recognition of the performer's gesture based on the 3D marker coordinates from a marker-based motion capture system. According to the recognition results, the multimodal feedback engine produces associated visual and audio feedback to the performer. This interactive system is simple to implement and robust to errors in 3D marker data. Satisfactory interactive dance performances have been successfully created and presented using the reported system.

UR - http://www.scopus.com/inward/record.url?scp=11244328259&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=11244328259&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:11244328259

SN - 0780386035

SN - 9780780386037

T3 - 2004 IEEE International Conference on Multimedia and Expo (ICME)

SP - 1579

EP - 1582

BT - 2004 IEEE International Conference on Multimedia and Expo (ICME)

ER -