Media processing workflow design and execution with ARIA

Lina Peng, Gisik Kwon, Kasim Candan, Kyung Ryu, Karam Chatha, Hari Sundaram, Yinpeng Chen

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)

Abstract

Recently, we introduced a novel ARchitecture for Interactive Arts (ARIA) middleware that processes, filters, and fuses sensory inputs and actuates responses in real-time while providing various Quality of Service (QoS) guarantees. The objective of ARIA is to incorporate realtime, sensed, and archived media and audience responses into live performances, on demand. An ARIA media workflow graph describes how the data sensed through media capture devices will be processed and what audio-visual responses will be actuated. Thus, each data object streamed between ARIA processing components is subject to transformations, as described by a media workflow graph. The media capture and processing components, such as media filters and fusion operators, are programmable and adaptable; i.e, the delay, size, frequency, and quality/precision characteristics of individual operators can be controlled via a number of parameters. In [1, 4, 5], we developed static and dynamic optimization algorithms which maximize the quality of the actuated responses, minimize the corresponding delay and the resource usage. In this demonstration, we present the ARIA GUI and the underlying kernel. More specifically, we describe how to design a media processing workflow, with adaptive operators, using the ARIA GUI and how to use the various optimization and adaptation alternatives provided by the ARIA kernel to execute media processing workflows.

Original languageEnglish (US)
Title of host publicationProceedings of the 13th ACM International Conference on Multimedia, MM 2005
Pages800-801
Number of pages2
DOIs
StatePublished - 2005
Event13th ACM International Conference on Multimedia, MM 2005 - Singapore, Singapore
Duration: Nov 6 2005Nov 11 2005

Other

Other13th ACM International Conference on Multimedia, MM 2005
CountrySingapore
CitySingapore
Period11/6/0511/11/05

Fingerprint

Graphical user interfaces
Processing
Electric fuses
Middleware
Quality of service
Demonstrations
Fusion reactions

Keywords

  • Filtering
  • Fusion
  • Mul-timodal art
  • Multimedia
  • Realtime sensory/reactive environments
  • Tools for creating interactive

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Computer Vision and Pattern Recognition
  • Human-Computer Interaction
  • Software

Cite this

Peng, L., Kwon, G., Candan, K., Ryu, K., Chatha, K., Sundaram, H., & Chen, Y. (2005). Media processing workflow design and execution with ARIA. In Proceedings of the 13th ACM International Conference on Multimedia, MM 2005 (pp. 800-801) https://doi.org/10.1145/1101149.1101322

Media processing workflow design and execution with ARIA. / Peng, Lina; Kwon, Gisik; Candan, Kasim; Ryu, Kyung; Chatha, Karam; Sundaram, Hari; Chen, Yinpeng.

Proceedings of the 13th ACM International Conference on Multimedia, MM 2005. 2005. p. 800-801.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Peng, L, Kwon, G, Candan, K, Ryu, K, Chatha, K, Sundaram, H & Chen, Y 2005, Media processing workflow design and execution with ARIA. in Proceedings of the 13th ACM International Conference on Multimedia, MM 2005. pp. 800-801, 13th ACM International Conference on Multimedia, MM 2005, Singapore, Singapore, 11/6/05. https://doi.org/10.1145/1101149.1101322
Peng L, Kwon G, Candan K, Ryu K, Chatha K, Sundaram H et al. Media processing workflow design and execution with ARIA. In Proceedings of the 13th ACM International Conference on Multimedia, MM 2005. 2005. p. 800-801 https://doi.org/10.1145/1101149.1101322
Peng, Lina ; Kwon, Gisik ; Candan, Kasim ; Ryu, Kyung ; Chatha, Karam ; Sundaram, Hari ; Chen, Yinpeng. / Media processing workflow design and execution with ARIA. Proceedings of the 13th ACM International Conference on Multimedia, MM 2005. 2005. pp. 800-801
@inproceedings{40bf15080ad44e8180404e4af12a0ced,
title = "Media processing workflow design and execution with ARIA",
abstract = "Recently, we introduced a novel ARchitecture for Interactive Arts (ARIA) middleware that processes, filters, and fuses sensory inputs and actuates responses in real-time while providing various Quality of Service (QoS) guarantees. The objective of ARIA is to incorporate realtime, sensed, and archived media and audience responses into live performances, on demand. An ARIA media workflow graph describes how the data sensed through media capture devices will be processed and what audio-visual responses will be actuated. Thus, each data object streamed between ARIA processing components is subject to transformations, as described by a media workflow graph. The media capture and processing components, such as media filters and fusion operators, are programmable and adaptable; i.e, the delay, size, frequency, and quality/precision characteristics of individual operators can be controlled via a number of parameters. In [1, 4, 5], we developed static and dynamic optimization algorithms which maximize the quality of the actuated responses, minimize the corresponding delay and the resource usage. In this demonstration, we present the ARIA GUI and the underlying kernel. More specifically, we describe how to design a media processing workflow, with adaptive operators, using the ARIA GUI and how to use the various optimization and adaptation alternatives provided by the ARIA kernel to execute media processing workflows.",
keywords = "Filtering, Fusion, Mul-timodal art, Multimedia, Realtime sensory/reactive environments, Tools for creating interactive",
author = "Lina Peng and Gisik Kwon and Kasim Candan and Kyung Ryu and Karam Chatha and Hari Sundaram and Yinpeng Chen",
year = "2005",
doi = "10.1145/1101149.1101322",
language = "English (US)",
isbn = "1595930442",
pages = "800--801",
booktitle = "Proceedings of the 13th ACM International Conference on Multimedia, MM 2005",

}

TY - GEN

T1 - Media processing workflow design and execution with ARIA

AU - Peng, Lina

AU - Kwon, Gisik

AU - Candan, Kasim

AU - Ryu, Kyung

AU - Chatha, Karam

AU - Sundaram, Hari

AU - Chen, Yinpeng

PY - 2005

Y1 - 2005

N2 - Recently, we introduced a novel ARchitecture for Interactive Arts (ARIA) middleware that processes, filters, and fuses sensory inputs and actuates responses in real-time while providing various Quality of Service (QoS) guarantees. The objective of ARIA is to incorporate realtime, sensed, and archived media and audience responses into live performances, on demand. An ARIA media workflow graph describes how the data sensed through media capture devices will be processed and what audio-visual responses will be actuated. Thus, each data object streamed between ARIA processing components is subject to transformations, as described by a media workflow graph. The media capture and processing components, such as media filters and fusion operators, are programmable and adaptable; i.e, the delay, size, frequency, and quality/precision characteristics of individual operators can be controlled via a number of parameters. In [1, 4, 5], we developed static and dynamic optimization algorithms which maximize the quality of the actuated responses, minimize the corresponding delay and the resource usage. In this demonstration, we present the ARIA GUI and the underlying kernel. More specifically, we describe how to design a media processing workflow, with adaptive operators, using the ARIA GUI and how to use the various optimization and adaptation alternatives provided by the ARIA kernel to execute media processing workflows.

AB - Recently, we introduced a novel ARchitecture for Interactive Arts (ARIA) middleware that processes, filters, and fuses sensory inputs and actuates responses in real-time while providing various Quality of Service (QoS) guarantees. The objective of ARIA is to incorporate realtime, sensed, and archived media and audience responses into live performances, on demand. An ARIA media workflow graph describes how the data sensed through media capture devices will be processed and what audio-visual responses will be actuated. Thus, each data object streamed between ARIA processing components is subject to transformations, as described by a media workflow graph. The media capture and processing components, such as media filters and fusion operators, are programmable and adaptable; i.e, the delay, size, frequency, and quality/precision characteristics of individual operators can be controlled via a number of parameters. In [1, 4, 5], we developed static and dynamic optimization algorithms which maximize the quality of the actuated responses, minimize the corresponding delay and the resource usage. In this demonstration, we present the ARIA GUI and the underlying kernel. More specifically, we describe how to design a media processing workflow, with adaptive operators, using the ARIA GUI and how to use the various optimization and adaptation alternatives provided by the ARIA kernel to execute media processing workflows.

KW - Filtering

KW - Fusion

KW - Mul-timodal art

KW - Multimedia

KW - Realtime sensory/reactive environments

KW - Tools for creating interactive

UR - http://www.scopus.com/inward/record.url?scp=78650978101&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=78650978101&partnerID=8YFLogxK

U2 - 10.1145/1101149.1101322

DO - 10.1145/1101149.1101322

M3 - Conference contribution

AN - SCOPUS:78650978101

SN - 1595930442

SN - 9781595930446

SP - 800

EP - 801

BT - Proceedings of the 13th ACM International Conference on Multimedia, MM 2005

ER -