Media processing workflow design and execution with ARIA

Lina Peng, Gisik Kwon, Kasim Candan, Kyung Ryu, Karam Chatha, Hari Sundaram, Yinpeng Chen

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Scopus citations

Abstract

Recently, we introduced a novel ARchitecture for Interactive Arts (ARIA) middleware that processes, filters, and fuses sensory inputs and actuates responses in real-time while providing various Quality of Service (QoS) guarantees. The objective of ARIA is to incorporate realtime, sensed, and archived media and audience responses into live performances, on demand. An ARIA media workflow graph describes how the data sensed through media capture devices will be processed and what audio-visual responses will be actuated. Thus, each data object streamed between ARIA processing components is subject to transformations, as described by a media workflow graph. The media capture and processing components, such as media filters and fusion operators, are programmable and adaptable; i.e, the delay, size, frequency, and quality/precision characteristics of individual operators can be controlled via a number of parameters. In [1, 4, 5], we developed static and dynamic optimization algorithms which maximize the quality of the actuated responses, minimize the corresponding delay and the resource usage. In this demonstration, we present the ARIA GUI and the underlying kernel. More specifically, we describe how to design a media processing workflow, with adaptive operators, using the ARIA GUI and how to use the various optimization and adaptation alternatives provided by the ARIA kernel to execute media processing workflows.

Original languageEnglish (US)
Title of host publicationProceedings of the 13th ACM International Conference on Multimedia, MM 2005
Pages800-801
Number of pages2
DOIs
StatePublished - Dec 1 2005
Event13th ACM International Conference on Multimedia, MM 2005 - Singapore, Singapore
Duration: Nov 6 2005Nov 11 2005

Publication series

NameProceedings of the 13th ACM International Conference on Multimedia, MM 2005

Conference

Conference13th ACM International Conference on Multimedia, MM 2005
CountrySingapore
CitySingapore
Period11/6/0511/11/05

    Fingerprint

Keywords

  • Filtering
  • Fusion
  • Mul-timodal art
  • Multimedia
  • Realtime sensory/reactive environments
  • Tools for creating interactive

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Computer Vision and Pattern Recognition
  • Human-Computer Interaction
  • Software

Cite this

Peng, L., Kwon, G., Candan, K., Ryu, K., Chatha, K., Sundaram, H., & Chen, Y. (2005). Media processing workflow design and execution with ARIA. In Proceedings of the 13th ACM International Conference on Multimedia, MM 2005 (pp. 800-801). (Proceedings of the 13th ACM International Conference on Multimedia, MM 2005). https://doi.org/10.1145/1101149.1101322