Image-based process monitoring using low-rank tensor decomposition

Hao Yan, Kamran Paynabar, Jianjun Shi

Research output: Contribution to journalArticle

Abstract

Image and video sensors are increasingly being deployed in complex systems due to the rich process information that these sensors can capture. As a result, image data play an important role in process monitoring and control in different application domains such as manufacturing processes, food industries, medical decision-making, and structural health monitoring. Existing process monitoring techniques fail to fully utilize the information of color images due to their complex data characteristics including the high-dimensionality and correlation structure (i.e., temporal, spatial and spectral correlation). This paper proposes a new image-based process monitoring approach that is capable of handling both grayscale and color images. The proposed approach models the high-dimensional structure of the image data with tensors and employs low-rank tensor decomposition techniques to extract important monitoring features monitored using multivariate control charts. In addition, this paper shows the analytical relationships between different low-rank tensor decomposition methods. The performance of the proposed method in quick detection of process changes is evaluated and compared with existing methods through extensive simulations and a case study in a steel tube manufacturing process. Note to Practitioners - This paper, motivated by the problem of combustion monitoring in steel tube manufacturing, focuses on the development of effective methods for process monitoring based on image data. Existing process monitoring techniques cannot fully utilize the information of color images due to the high-dimensionality and complex correlation structure of such data. This paper addresses this problem by extracting essential monitoring features, while considering the spatial and spectral correlation of color images. This is accomplished by using various low-rank tensor decomposition methods along with multivariate control charts. The proposed approach can lead to a computer-aided online monitoring system for automatic detection of out-of-control situations in a process. Using simulation, the performance of the developed methods is compared under various scenarios. This can provide practitioners with useful guidelines for selecting an appropriate method for image-based process monitoring. In future research, we will study the development of image-based fault diagnosis techniques that can be integrated with the process monitoring approaches proposed in this paper.

Original languageEnglish (US)
Article number6855374
Pages (from-to)216-227
Number of pages12
JournalIEEE Transactions on Automation Science and Engineering
Volume12
Issue number1
DOIs
StatePublished - Jan 1 2015
Externally publishedYes

Fingerprint

Process monitoring
Tensors
Decomposition
Color
Monitoring
Steel
Structural health monitoring
Sensors
Failure analysis
Process control
Large scale systems
Decision making
Industry

Keywords

  • Average run length
  • control charts
  • image-based quality control
  • online monitoring
  • tucker and CP decompositions

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Electrical and Electronic Engineering

Cite this

Image-based process monitoring using low-rank tensor decomposition. / Yan, Hao; Paynabar, Kamran; Shi, Jianjun.

In: IEEE Transactions on Automation Science and Engineering, Vol. 12, No. 1, 6855374, 01.01.2015, p. 216-227.

Research output: Contribution to journalArticle

@article{166f57e3107d4ebb842b9c5b7eacc5c8,
title = "Image-based process monitoring using low-rank tensor decomposition",
abstract = "Image and video sensors are increasingly being deployed in complex systems due to the rich process information that these sensors can capture. As a result, image data play an important role in process monitoring and control in different application domains such as manufacturing processes, food industries, medical decision-making, and structural health monitoring. Existing process monitoring techniques fail to fully utilize the information of color images due to their complex data characteristics including the high-dimensionality and correlation structure (i.e., temporal, spatial and spectral correlation). This paper proposes a new image-based process monitoring approach that is capable of handling both grayscale and color images. The proposed approach models the high-dimensional structure of the image data with tensors and employs low-rank tensor decomposition techniques to extract important monitoring features monitored using multivariate control charts. In addition, this paper shows the analytical relationships between different low-rank tensor decomposition methods. The performance of the proposed method in quick detection of process changes is evaluated and compared with existing methods through extensive simulations and a case study in a steel tube manufacturing process. Note to Practitioners - This paper, motivated by the problem of combustion monitoring in steel tube manufacturing, focuses on the development of effective methods for process monitoring based on image data. Existing process monitoring techniques cannot fully utilize the information of color images due to the high-dimensionality and complex correlation structure of such data. This paper addresses this problem by extracting essential monitoring features, while considering the spatial and spectral correlation of color images. This is accomplished by using various low-rank tensor decomposition methods along with multivariate control charts. The proposed approach can lead to a computer-aided online monitoring system for automatic detection of out-of-control situations in a process. Using simulation, the performance of the developed methods is compared under various scenarios. This can provide practitioners with useful guidelines for selecting an appropriate method for image-based process monitoring. In future research, we will study the development of image-based fault diagnosis techniques that can be integrated with the process monitoring approaches proposed in this paper.",
keywords = "Average run length, control charts, image-based quality control, online monitoring, tucker and CP decompositions",
author = "Hao Yan and Kamran Paynabar and Jianjun Shi",
year = "2015",
month = "1",
day = "1",
doi = "10.1109/TASE.2014.2327029",
language = "English (US)",
volume = "12",
pages = "216--227",
journal = "IEEE Transactions on Automation Science and Engineering",
issn = "1545-5955",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
number = "1",

}

TY - JOUR

T1 - Image-based process monitoring using low-rank tensor decomposition

AU - Yan, Hao

AU - Paynabar, Kamran

AU - Shi, Jianjun

PY - 2015/1/1

Y1 - 2015/1/1

N2 - Image and video sensors are increasingly being deployed in complex systems due to the rich process information that these sensors can capture. As a result, image data play an important role in process monitoring and control in different application domains such as manufacturing processes, food industries, medical decision-making, and structural health monitoring. Existing process monitoring techniques fail to fully utilize the information of color images due to their complex data characteristics including the high-dimensionality and correlation structure (i.e., temporal, spatial and spectral correlation). This paper proposes a new image-based process monitoring approach that is capable of handling both grayscale and color images. The proposed approach models the high-dimensional structure of the image data with tensors and employs low-rank tensor decomposition techniques to extract important monitoring features monitored using multivariate control charts. In addition, this paper shows the analytical relationships between different low-rank tensor decomposition methods. The performance of the proposed method in quick detection of process changes is evaluated and compared with existing methods through extensive simulations and a case study in a steel tube manufacturing process. Note to Practitioners - This paper, motivated by the problem of combustion monitoring in steel tube manufacturing, focuses on the development of effective methods for process monitoring based on image data. Existing process monitoring techniques cannot fully utilize the information of color images due to the high-dimensionality and complex correlation structure of such data. This paper addresses this problem by extracting essential monitoring features, while considering the spatial and spectral correlation of color images. This is accomplished by using various low-rank tensor decomposition methods along with multivariate control charts. The proposed approach can lead to a computer-aided online monitoring system for automatic detection of out-of-control situations in a process. Using simulation, the performance of the developed methods is compared under various scenarios. This can provide practitioners with useful guidelines for selecting an appropriate method for image-based process monitoring. In future research, we will study the development of image-based fault diagnosis techniques that can be integrated with the process monitoring approaches proposed in this paper.

AB - Image and video sensors are increasingly being deployed in complex systems due to the rich process information that these sensors can capture. As a result, image data play an important role in process monitoring and control in different application domains such as manufacturing processes, food industries, medical decision-making, and structural health monitoring. Existing process monitoring techniques fail to fully utilize the information of color images due to their complex data characteristics including the high-dimensionality and correlation structure (i.e., temporal, spatial and spectral correlation). This paper proposes a new image-based process monitoring approach that is capable of handling both grayscale and color images. The proposed approach models the high-dimensional structure of the image data with tensors and employs low-rank tensor decomposition techniques to extract important monitoring features monitored using multivariate control charts. In addition, this paper shows the analytical relationships between different low-rank tensor decomposition methods. The performance of the proposed method in quick detection of process changes is evaluated and compared with existing methods through extensive simulations and a case study in a steel tube manufacturing process. Note to Practitioners - This paper, motivated by the problem of combustion monitoring in steel tube manufacturing, focuses on the development of effective methods for process monitoring based on image data. Existing process monitoring techniques cannot fully utilize the information of color images due to the high-dimensionality and complex correlation structure of such data. This paper addresses this problem by extracting essential monitoring features, while considering the spatial and spectral correlation of color images. This is accomplished by using various low-rank tensor decomposition methods along with multivariate control charts. The proposed approach can lead to a computer-aided online monitoring system for automatic detection of out-of-control situations in a process. Using simulation, the performance of the developed methods is compared under various scenarios. This can provide practitioners with useful guidelines for selecting an appropriate method for image-based process monitoring. In future research, we will study the development of image-based fault diagnosis techniques that can be integrated with the process monitoring approaches proposed in this paper.

KW - Average run length

KW - control charts

KW - image-based quality control

KW - online monitoring

KW - tucker and CP decompositions

UR - http://www.scopus.com/inward/record.url?scp=84920717484&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84920717484&partnerID=8YFLogxK

U2 - 10.1109/TASE.2014.2327029

DO - 10.1109/TASE.2014.2327029

M3 - Article

AN - SCOPUS:84920717484

VL - 12

SP - 216

EP - 227

JO - IEEE Transactions on Automation Science and Engineering

JF - IEEE Transactions on Automation Science and Engineering

SN - 1545-5955

IS - 1

M1 - 6855374

ER -