Improving DNN Hardware Accuracy by In-Memory Computing Noise Injection

Sai Kiran Cherupally, Jian Meng, Adnan Siraj Rakin, Shihui Yin, Mingoo Seok, Deliang Fan, Jae sun Seo

Research output: Contribution to journalArticlepeer-review

Abstract

We propose hardware noise-aware deep neural network (DNN) training to largely improve the DNN inference accuracy of in-memory computing (IMC) hardware. During DNN training, we perform noise injection at the partial sum level, which matches with the crossbar structure of IMC hardware, and the injected noise data is directly based on measurements of actual IMC prototype chips. We evaluated DNNs using measurements from two different SRAM-based IMC prototype designs and five different chips, across different noise characteristics. For various DNNs and IMC chip measurements, our proposed technique consistently improves DNN accuracy for actual IMC hardware.

Original languageEnglish (US)
JournalIEEE Design and Test
DOIs
StateAccepted/In press - 2021

Keywords

  • deep neural network
  • Hardware
  • hardware-aware training
  • In-memory computing
  • noise injection
  • Noise measurement
  • Quantization (signal)
  • Random access memory
  • Semiconductor device measurement
  • System-on-chip
  • Training

ASJC Scopus subject areas

  • Software
  • Hardware and Architecture
  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'Improving DNN Hardware Accuracy by In-Memory Computing Noise Injection'. Together they form a unique fingerprint.

Cite this