GAN Training Acceleration Using Fréchet Descriptor-Based Coreset

Yanzhe Xu, Teresa Wu, Jennifer R. Charlton, Kevin M. Bennett

Research output: Contribution to journalArticlepeer-review

Abstract

Generative Adversarial Networks (GANs) are a class of deep learning models being applied to image processing. GANs have demonstrated state-of-the-art performance in applications such as image generation and image-to-image translation, just to name a few. However, with this success comes the realization that the training of GANs takes a long time and is often limited by available computing resources. In this research, we propose to construct a Coreset using Fréchet Descriptor Distances (FDD-Coreset) to accelerate the training of GAN for blob identification. We first propose a Fréchet Descriptor Distance (FDD) to measure the difference between each pair of blob images based on the statistics derived from blob distribution. The Coreset is then employed using our proposed FDD metric to select samples from the entire dataset for GAN training. A 3D-simulated dataset of blobs and a 3D MRI dataset of human kidneys are studied. Using computation time and eight performance metrics, the GAN trained on the FDD-Coreset is compared against the model trained on the entire dataset and an Inception and Euclidean Distance-based Coreset (IED-Coreset). We conclude that the FDD-Coreset not only significantly reduces the training time, but also achieves higher denoising performance and maintains approximate performance of blob identification compared with training on the entire dataset.

Original languageEnglish (US)
Article number7599
JournalApplied Sciences (Switzerland)
Volume12
Issue number15
DOIs
StatePublished - Aug 2022

Keywords

  • Fréchet Distance
  • GAN
  • blob identification
  • coreset
  • deep learning
  • training acceleration

ASJC Scopus subject areas

  • Materials Science(all)
  • Instrumentation
  • Engineering(all)
  • Process Chemistry and Technology
  • Computer Science Applications
  • Fluid Flow and Transfer Processes

Fingerprint

Dive into the research topics of 'GAN Training Acceleration Using Fréchet Descriptor-Based Coreset'. Together they form a unique fingerprint.

Cite this