ARIA: An adaptive and programmable media-flow architecture for interactive arts

Lina Peng, Kasim Candan, Kyung D. Ryu, Karamvir S. Chatha, Hari Sundaram

Research output: Chapter in Book/Report/Conference proceedingConference contribution

5 Citations (Scopus)

Abstract

We are developing an adaptive and programmable media-flow ARchitecture for Interactive Arts (ARIA) to enable real-time control of audio, video, and lighting on an intelligent stage. The intelligent stage is being equipped with a matrix of floor sensors for object localization, microphone arrays for sound localization, beam forming and motion capture system. ARIA system provides an interface for specifying intended mappings of the sensory inputs to audio-visual responses. Based on the specifications, the sensory inputs are streamed, filtered and fused, actuate a controllable projection system, sound surround and lighting system. The actuated responses take place in real-time and satisfy QoS requirements in live performance. In this paper, we present the ARIA quality-adaptive architecture. We model the basic information unit as a data object with a meta-data header and object payload streamed between nodes in the system and use a directed acyclic network to model media stream processing. We define performance metrics for the output precision, resource consumption, and end-to-end delay. The filters and fusion operators are being implemented by quality aware signal processing algorithms. The proper node behavior is chosen at runtime to achieve the QoS requirements and adapt to input object properties. For this purpose, ARIA utilizes a two-phase approach: static pre-optimization and dynamic run-time adaptation.

Original languageEnglish (US)
Title of host publicationACM Multimedia 2004 - proceedings of the 12th ACM International Conference on Multimedia
Pages532-535
Number of pages4
StatePublished - 2004
EventACM Multimedia 2004 - proceedings of the 12th ACM International Conference on Multimedia - New York, NY, United States
Duration: Oct 10 2004Oct 16 2004

Other

OtherACM Multimedia 2004 - proceedings of the 12th ACM International Conference on Multimedia
CountryUnited States
CityNew York, NY
Period10/10/0410/16/04

Fingerprint

Quality of service
Lighting
Acoustic waves
Projection systems
Real time control
Microphones
Metadata
Signal processing
Fusion reactions
Specifications
Sensors
Processing

Keywords

  • Interactive
  • Multi-model art
  • Tools for creating multimedia art

ASJC Scopus subject areas

  • Engineering(all)

Cite this

Peng, L., Candan, K., Ryu, K. D., Chatha, K. S., & Sundaram, H. (2004). ARIA: An adaptive and programmable media-flow architecture for interactive arts. In ACM Multimedia 2004 - proceedings of the 12th ACM International Conference on Multimedia (pp. 532-535)

ARIA : An adaptive and programmable media-flow architecture for interactive arts. / Peng, Lina; Candan, Kasim; Ryu, Kyung D.; Chatha, Karamvir S.; Sundaram, Hari.

ACM Multimedia 2004 - proceedings of the 12th ACM International Conference on Multimedia. 2004. p. 532-535.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Peng, L, Candan, K, Ryu, KD, Chatha, KS & Sundaram, H 2004, ARIA: An adaptive and programmable media-flow architecture for interactive arts. in ACM Multimedia 2004 - proceedings of the 12th ACM International Conference on Multimedia. pp. 532-535, ACM Multimedia 2004 - proceedings of the 12th ACM International Conference on Multimedia, New York, NY, United States, 10/10/04.
Peng L, Candan K, Ryu KD, Chatha KS, Sundaram H. ARIA: An adaptive and programmable media-flow architecture for interactive arts. In ACM Multimedia 2004 - proceedings of the 12th ACM International Conference on Multimedia. 2004. p. 532-535
Peng, Lina ; Candan, Kasim ; Ryu, Kyung D. ; Chatha, Karamvir S. ; Sundaram, Hari. / ARIA : An adaptive and programmable media-flow architecture for interactive arts. ACM Multimedia 2004 - proceedings of the 12th ACM International Conference on Multimedia. 2004. pp. 532-535
@inproceedings{2bc31fa132744c4e9b46a73d5ff687ee,
title = "ARIA: An adaptive and programmable media-flow architecture for interactive arts",
abstract = "We are developing an adaptive and programmable media-flow ARchitecture for Interactive Arts (ARIA) to enable real-time control of audio, video, and lighting on an intelligent stage. The intelligent stage is being equipped with a matrix of floor sensors for object localization, microphone arrays for sound localization, beam forming and motion capture system. ARIA system provides an interface for specifying intended mappings of the sensory inputs to audio-visual responses. Based on the specifications, the sensory inputs are streamed, filtered and fused, actuate a controllable projection system, sound surround and lighting system. The actuated responses take place in real-time and satisfy QoS requirements in live performance. In this paper, we present the ARIA quality-adaptive architecture. We model the basic information unit as a data object with a meta-data header and object payload streamed between nodes in the system and use a directed acyclic network to model media stream processing. We define performance metrics for the output precision, resource consumption, and end-to-end delay. The filters and fusion operators are being implemented by quality aware signal processing algorithms. The proper node behavior is chosen at runtime to achieve the QoS requirements and adapt to input object properties. For this purpose, ARIA utilizes a two-phase approach: static pre-optimization and dynamic run-time adaptation.",
keywords = "Interactive, Multi-model art, Tools for creating multimedia art",
author = "Lina Peng and Kasim Candan and Ryu, {Kyung D.} and Chatha, {Karamvir S.} and Hari Sundaram",
year = "2004",
language = "English (US)",
isbn = "1581138938",
pages = "532--535",
booktitle = "ACM Multimedia 2004 - proceedings of the 12th ACM International Conference on Multimedia",

}

TY - GEN

T1 - ARIA

T2 - An adaptive and programmable media-flow architecture for interactive arts

AU - Peng, Lina

AU - Candan, Kasim

AU - Ryu, Kyung D.

AU - Chatha, Karamvir S.

AU - Sundaram, Hari

PY - 2004

Y1 - 2004

N2 - We are developing an adaptive and programmable media-flow ARchitecture for Interactive Arts (ARIA) to enable real-time control of audio, video, and lighting on an intelligent stage. The intelligent stage is being equipped with a matrix of floor sensors for object localization, microphone arrays for sound localization, beam forming and motion capture system. ARIA system provides an interface for specifying intended mappings of the sensory inputs to audio-visual responses. Based on the specifications, the sensory inputs are streamed, filtered and fused, actuate a controllable projection system, sound surround and lighting system. The actuated responses take place in real-time and satisfy QoS requirements in live performance. In this paper, we present the ARIA quality-adaptive architecture. We model the basic information unit as a data object with a meta-data header and object payload streamed between nodes in the system and use a directed acyclic network to model media stream processing. We define performance metrics for the output precision, resource consumption, and end-to-end delay. The filters and fusion operators are being implemented by quality aware signal processing algorithms. The proper node behavior is chosen at runtime to achieve the QoS requirements and adapt to input object properties. For this purpose, ARIA utilizes a two-phase approach: static pre-optimization and dynamic run-time adaptation.

AB - We are developing an adaptive and programmable media-flow ARchitecture for Interactive Arts (ARIA) to enable real-time control of audio, video, and lighting on an intelligent stage. The intelligent stage is being equipped with a matrix of floor sensors for object localization, microphone arrays for sound localization, beam forming and motion capture system. ARIA system provides an interface for specifying intended mappings of the sensory inputs to audio-visual responses. Based on the specifications, the sensory inputs are streamed, filtered and fused, actuate a controllable projection system, sound surround and lighting system. The actuated responses take place in real-time and satisfy QoS requirements in live performance. In this paper, we present the ARIA quality-adaptive architecture. We model the basic information unit as a data object with a meta-data header and object payload streamed between nodes in the system and use a directed acyclic network to model media stream processing. We define performance metrics for the output precision, resource consumption, and end-to-end delay. The filters and fusion operators are being implemented by quality aware signal processing algorithms. The proper node behavior is chosen at runtime to achieve the QoS requirements and adapt to input object properties. For this purpose, ARIA utilizes a two-phase approach: static pre-optimization and dynamic run-time adaptation.

KW - Interactive

KW - Multi-model art

KW - Tools for creating multimedia art

UR - http://www.scopus.com/inward/record.url?scp=13444306254&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=13444306254&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:13444306254

SN - 1581138938

SN - 9781581138931

SP - 532

EP - 535

BT - ACM Multimedia 2004 - proceedings of the 12th ACM International Conference on Multimedia

ER -