Redundant neurons and shared redundant synapses for robust memristor-based DNNs with reduced overhead

Baogang Zhang, Necati Uysal, Deliang Fan, Rickard Ewetz

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The dominating computational workload in the inference phase of deep neural networks (DNNs) is matrix-vector multiplication. An arising solution to accelerate the inference phase is to perform analog matrix-vector multiplication using memristor crossbar arrays (MCAs). A key challenge is that stuck-at-fault defects may degrade the classification accuracy of the memristor-based DNNs. A common technique to reduce the negative impact of stuck-at-faults is to utilize redundant synapses, i.e, each row in a weight matrix is realized using two (or r) parallel rows in an MCA. In this paper, we propose to handle stuck-at-faults by inserting redundant neurons and by sharing redundant synapses. The first technique is based on inserting redundant neurons to surgically repair neurons connected to rows and columns in the MCAs with many stuck-at-faults. The second technique is focused on sharing redundant synapses between different neurons to reduce the hardware overhead, which generalizes (1:r) synapse redundancy in previous studies to (q:r) synapse redundancy. The experimental results demonstrate new trade-offs between robustness and hardware overhead without requiring the neural networks to be retrained. Compared with state-of-the-art, the power and area overhead for a neural network can be reduced with up to 16% and 25%, respectively.

Original languageEnglish (US)
Title of host publicationGLSVLSI 2020 - Proceedings of the 2020 Great Lakes Symposium on VLSI
PublisherAssociation for Computing Machinery
Pages339-344
Number of pages6
ISBN (Electronic)9781450379441
DOIs
StatePublished - Sep 7 2020
Event30th Great Lakes Symposium on VLSI, GLSVLSI 2020 - Virtual, Online, China
Duration: Sep 7 2020Sep 9 2020

Publication series

NameProceedings of the ACM Great Lakes Symposium on VLSI, GLSVLSI

Conference

Conference30th Great Lakes Symposium on VLSI, GLSVLSI 2020
CountryChina
CityVirtual, Online
Period9/7/209/9/20

ASJC Scopus subject areas

  • Engineering(all)

Fingerprint Dive into the research topics of 'Redundant neurons and shared redundant synapses for robust memristor-based DNNs with reduced overhead'. Together they form a unique fingerprint.

Cite this