Optimization of media processing workflows with adaptive operator behaviors

Lina Peng, Kasim Candan, Christopher Mayer, Karamvir S. Chatha, Kyung Dong Ryu

Research output: Contribution to journalArticle

5 Citations (Scopus)

Abstract

In this paper, we present the ARIA media processing workflow architecture that processes, filters, and fuses sensory inputs and actuates responses in real-time. The components of the architecture are programmable and adaptable; i.e. the delay, size, and quality/precision characteristics of the individual operators can be controlled via a number of parameters. Each data object processed by qStream components is subject to transformations based on the parameter values. For instance, the quality of an output data object and the corresponding processing delay and resource usage depend on the values assigned to parameters of the operators in the object flow path. In Candan, Peng, Ryu, Chatha, Mayer (Efficient stream routing in quality- and resource-adaptive flow architectures. In: Workshop on multimedia information systems, 2004), we introduced a class of flow optimization problems that promote creation and delivery of small delay or small resource-usage objects to the actuators in single-sensor, single-actuator workflows. In this paper, we extend our attention to multi-sensor media processing workflow scenarios. The algorithms we present take into account the implicit dependencies between various system parameters, such as resource consumption and object sizes. We experimentally show the effectiveness and efficiency of the algorithms.

Original languageEnglish (US)
Pages (from-to)245-272
Number of pages28
JournalMultimedia Tools and Applications
Volume33
Issue number3
DOIs
StatePublished - Jun 2007

Fingerprint

Work Flow
Mathematical operators
Optimization
Actuators
Processing
Operator
Resources
Sensors
Electric fuses
Actuator
Information systems
Multimedia Systems
Information Systems
Routing
Object
Filter
Optimization Problem
Real-time
Sensor
Scenarios

Keywords

  • Interactive arts
  • Media-processing workflows
  • Quality-cost tradeoff
  • Quality-delay tradeoff
  • Sensory/reactive environments

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Information Systems
  • Computer Graphics and Computer-Aided Design
  • Software
  • Theoretical Computer Science
  • Computational Theory and Mathematics

Cite this

Optimization of media processing workflows with adaptive operator behaviors. / Peng, Lina; Candan, Kasim; Mayer, Christopher; Chatha, Karamvir S.; Ryu, Kyung Dong.

In: Multimedia Tools and Applications, Vol. 33, No. 3, 06.2007, p. 245-272.

Research output: Contribution to journalArticle

Peng, Lina ; Candan, Kasim ; Mayer, Christopher ; Chatha, Karamvir S. ; Ryu, Kyung Dong. / Optimization of media processing workflows with adaptive operator behaviors. In: Multimedia Tools and Applications. 2007 ; Vol. 33, No. 3. pp. 245-272.
@article{f423f28020f24835be272cd0d5f74071,
title = "Optimization of media processing workflows with adaptive operator behaviors",
abstract = "In this paper, we present the ARIA media processing workflow architecture that processes, filters, and fuses sensory inputs and actuates responses in real-time. The components of the architecture are programmable and adaptable; i.e. the delay, size, and quality/precision characteristics of the individual operators can be controlled via a number of parameters. Each data object processed by qStream components is subject to transformations based on the parameter values. For instance, the quality of an output data object and the corresponding processing delay and resource usage depend on the values assigned to parameters of the operators in the object flow path. In Candan, Peng, Ryu, Chatha, Mayer (Efficient stream routing in quality- and resource-adaptive flow architectures. In: Workshop on multimedia information systems, 2004), we introduced a class of flow optimization problems that promote creation and delivery of small delay or small resource-usage objects to the actuators in single-sensor, single-actuator workflows. In this paper, we extend our attention to multi-sensor media processing workflow scenarios. The algorithms we present take into account the implicit dependencies between various system parameters, such as resource consumption and object sizes. We experimentally show the effectiveness and efficiency of the algorithms.",
keywords = "Interactive arts, Media-processing workflows, Quality-cost tradeoff, Quality-delay tradeoff, Sensory/reactive environments",
author = "Lina Peng and Kasim Candan and Christopher Mayer and Chatha, {Karamvir S.} and Ryu, {Kyung Dong}",
year = "2007",
month = "6",
doi = "10.1007/s11042-007-0105-z",
language = "English (US)",
volume = "33",
pages = "245--272",
journal = "Multimedia Tools and Applications",
issn = "1380-7501",
publisher = "Springer Netherlands",
number = "3",

}

TY - JOUR

T1 - Optimization of media processing workflows with adaptive operator behaviors

AU - Peng, Lina

AU - Candan, Kasim

AU - Mayer, Christopher

AU - Chatha, Karamvir S.

AU - Ryu, Kyung Dong

PY - 2007/6

Y1 - 2007/6

N2 - In this paper, we present the ARIA media processing workflow architecture that processes, filters, and fuses sensory inputs and actuates responses in real-time. The components of the architecture are programmable and adaptable; i.e. the delay, size, and quality/precision characteristics of the individual operators can be controlled via a number of parameters. Each data object processed by qStream components is subject to transformations based on the parameter values. For instance, the quality of an output data object and the corresponding processing delay and resource usage depend on the values assigned to parameters of the operators in the object flow path. In Candan, Peng, Ryu, Chatha, Mayer (Efficient stream routing in quality- and resource-adaptive flow architectures. In: Workshop on multimedia information systems, 2004), we introduced a class of flow optimization problems that promote creation and delivery of small delay or small resource-usage objects to the actuators in single-sensor, single-actuator workflows. In this paper, we extend our attention to multi-sensor media processing workflow scenarios. The algorithms we present take into account the implicit dependencies between various system parameters, such as resource consumption and object sizes. We experimentally show the effectiveness and efficiency of the algorithms.

AB - In this paper, we present the ARIA media processing workflow architecture that processes, filters, and fuses sensory inputs and actuates responses in real-time. The components of the architecture are programmable and adaptable; i.e. the delay, size, and quality/precision characteristics of the individual operators can be controlled via a number of parameters. Each data object processed by qStream components is subject to transformations based on the parameter values. For instance, the quality of an output data object and the corresponding processing delay and resource usage depend on the values assigned to parameters of the operators in the object flow path. In Candan, Peng, Ryu, Chatha, Mayer (Efficient stream routing in quality- and resource-adaptive flow architectures. In: Workshop on multimedia information systems, 2004), we introduced a class of flow optimization problems that promote creation and delivery of small delay or small resource-usage objects to the actuators in single-sensor, single-actuator workflows. In this paper, we extend our attention to multi-sensor media processing workflow scenarios. The algorithms we present take into account the implicit dependencies between various system parameters, such as resource consumption and object sizes. We experimentally show the effectiveness and efficiency of the algorithms.

KW - Interactive arts

KW - Media-processing workflows

KW - Quality-cost tradeoff

KW - Quality-delay tradeoff

KW - Sensory/reactive environments

UR - http://www.scopus.com/inward/record.url?scp=34247163040&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=34247163040&partnerID=8YFLogxK

U2 - 10.1007/s11042-007-0105-z

DO - 10.1007/s11042-007-0105-z

M3 - Article

AN - SCOPUS:34247163040

VL - 33

SP - 245

EP - 272

JO - Multimedia Tools and Applications

JF - Multimedia Tools and Applications

SN - 1380-7501

IS - 3

ER -