ARIA: An adaptive and programmable media-flow architecture for interactive arts

Lina Peng, Kasim Candan, Kyung D. Ryu, Karamvir S. Chatha, Hari Sundaram

Research output: Chapter in Book/Report/Conference proceedingConference contribution

5 Scopus citations

Abstract

We are developing an adaptive and programmable media-flow ARchitecture for Interactive Arts (ARIA) to enable real-time control of audio, video, and lighting on an intelligent stage. The intelligent stage is being equipped with a matrix of floor sensors for object localization, microphone arrays for sound localization, beam forming and motion capture system. ARIA system provides an interface for specifying intended mappings of the sensory inputs to audio-visual responses. Based on the specifications, the sensory inputs are streamed, filtered and fused, actuate a controllable projection system, sound surround and lighting system. The actuated responses take place in real-time and satisfy QoS requirements in live performance. In this paper, we present the ARIA quality-adaptive architecture. We model the basic information unit as a data object with a meta-data header and object payload streamed between nodes in the system and use a directed acyclic network to model media stream processing. We define performance metrics for the output precision, resource consumption, and end-to-end delay. The filters and fusion operators are being implemented by quality aware signal processing algorithms. The proper node behavior is chosen at runtime to achieve the QoS requirements and adapt to input object properties. For this purpose, ARIA utilizes a two-phase approach: static pre-optimization and dynamic run-time adaptation.

Original languageEnglish (US)
Title of host publicationACM Multimedia 2004 - proceedings of the 12th ACM International Conference on Multimedia
Pages532-535
Number of pages4
StatePublished - Dec 1 2004
EventACM Multimedia 2004 - proceedings of the 12th ACM International Conference on Multimedia - New York, NY, United States
Duration: Oct 10 2004Oct 16 2004

Publication series

NameACM Multimedia 2004 - proceedings of the 12th ACM International Conference on Multimedia

Other

OtherACM Multimedia 2004 - proceedings of the 12th ACM International Conference on Multimedia
CountryUnited States
CityNew York, NY
Period10/10/0410/16/04

Keywords

  • Interactive
  • Multi-model art
  • Tools for creating multimedia art

ASJC Scopus subject areas

  • Engineering(all)

Fingerprint Dive into the research topics of 'ARIA: An adaptive and programmable media-flow architecture for interactive arts'. Together they form a unique fingerprint.

  • Cite this

    Peng, L., Candan, K., Ryu, K. D., Chatha, K. S., & Sundaram, H. (2004). ARIA: An adaptive and programmable media-flow architecture for interactive arts. In ACM Multimedia 2004 - proceedings of the 12th ACM International Conference on Multimedia (pp. 532-535). (ACM Multimedia 2004 - proceedings of the 12th ACM International Conference on Multimedia).