Learning the temporal effect in infrared thermal videos with long short-Term memory for quality prediction in resistance spot welding

Shenghan Guo, Dali Wang, Jian Chen, Zhili Feng, Weihong Grace Guo

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

With the advances of sensing technology, in-situ infrared thermal videos can be collected from Resistance Spot Welding (RSW) processes. Each video records the formulation process of a weld nugget. The nugget evolution creates a "temporal effect" across the frames, which can be leveraged for real-Time, nondestructive evaluation (NDE) of the weld quality. Currently, quality prediction with imaging data mainly focuses on optical feature extraction with Convolutional Neural Network (CNN) but does not make the most of such temporal effect. In this study, pixels corresponding to critical locations on the weld nugget surface are extracted from a video to form multivariate time series (MTS). Multivariate Adaptive Regression Splines (MARS) is used in MTS processing to remove noisy signals related to uninformative frames. A Stacked Long Short-Term Memory (LSTM) model is developed to learn from the processed MTS and then predicts weld nugget size and thickness in real-Time NDE. Results from a case study on RSW of Boron steel demonstrates the improvement in prediction accuracy and computational time with the proposed method, as compared to CNN-based weld quality prediction.

Original languageEnglish (US)
Title of host publicationManufacturing Processes; Manufacturing Systems
PublisherAmerican Society of Mechanical Engineers
ISBN (Electronic)9780791885819
DOIs
StatePublished - 2022
Externally publishedYes
EventASME 2022 17th International Manufacturing Science and Engineering Conference, MSEC 2022 - West Lafayette, United States
Duration: Jun 27 2022Jul 1 2022

Publication series

NameProceedings of ASME 2022 17th International Manufacturing Science and Engineering Conference, MSEC 2022
Volume2

Conference

ConferenceASME 2022 17th International Manufacturing Science and Engineering Conference, MSEC 2022
Country/TerritoryUnited States
CityWest Lafayette
Period6/27/227/1/22

Keywords

  • Infrared thermal video
  • long short-Term memory
  • Quality prediction
  • Resistance spot welding
  • Temporal effect

ASJC Scopus subject areas

  • Industrial and Manufacturing Engineering

Fingerprint

Dive into the research topics of 'Learning the temporal effect in infrared thermal videos with long short-Term memory for quality prediction in resistance spot welding'. Together they form a unique fingerprint.

Cite this