Stochastic-based synapse and soft-limiting neuron with spintronic devices for low power and robust artificial neural networks

Yu Bai, Deliang Fan, Mingjie Lin

Research output: Contribution to journalArticlepeer-review

5 Scopus citations

Abstract

We propose an innovative stochastic-based computing architecture to implement low-power and robust artificial neural network (S-ANN) with both magnetic tunneling junction (MTJ) and Domain Wall (DW) devices. Our mixed-model HSPICE simulation results have shown that, for a well-known pattern recognition task, a 34-neuron S-ANN implementation achieves more than 1.5 orders of magnitude lower energy consumption and 2.5 orders of magnitude less hidden layer chip area, when compared with its deterministic-based ANN counterparts which are implemented with digital and analog CMOS circuits. We believe that our S-ANN architecture achieves such a remarkable performance gain by leveraging two key ideas. First, because all neural signals are encoded as random bit streams, the standard weighted-sum synapses can be accomplished by stochastic bit writing and reading procedure. Second, we designed and implemented a novel multiple-phase pumping circuit structure to effectively realize the soft-limiting neural transfer function that is essential to improve the overall ANN capability and reduce its network complexity.

Original languageEnglish (US)
Article number8240945
Pages (from-to)463-476
Number of pages14
JournalIEEE Transactions on Multi-Scale Computing Systems
Volume4
Issue number3
DOIs
StatePublished - Jul 1 2018
Externally publishedYes

Keywords

  • Magnetic tunneling junction
  • artificial neural network
  • domain wall motion
  • soft-limiting neuron
  • stochastic computing

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Information Systems
  • Hardware and Architecture

Fingerprint

Dive into the research topics of 'Stochastic-based synapse and soft-limiting neuron with spintronic devices for low power and robust artificial neural networks'. Together they form a unique fingerprint.

Cite this