NeuroSim: A circuit-level macro model for benchmarking neuro-inspired architectures in online learning

Pai Yu Chen, Xiaochen Peng, Shimeng Yu

Research output: Contribution to journalArticlepeer-review

91 Scopus citations

Abstract

Neuro-inspired architectures based on synaptic memory arrays have been proposed for on-chip acceleration of weighted sum and weight update in machine/deep learning algorithms. In this paper, we developed NeuroSim, a circuit-level macro model that estimates the area, latency, dynamic energy, and leakage power to facilitate the design space exploration of neuro-inspired architectures with mainstream and emerging device technologies. NeuroSim provides flexible interface and a wide variety of design options at the circuit and device level. Therefore, NeuroSim can be used by neural networks (NNs) as a supporting tool to provide circuit-level performance evaluation. With NeuroSim, an integrated framework can be built with hierarchical organization from the device level (synaptic device properties) to the circuit level (array architectures) and then to the algorithm level (NN topology), enabling instruction-accurate evaluation on the learning accuracy as well as the circuit-level performance metrics at the run-time of online learning. Using multilayer perceptron as a case-study algorithm, we investigated the impact of the 'analog' emerging nonvolatile memory (eNVM)'s 'nonideal' device properties and benchmarked the tradeoffs between SRAM, digital, and analog eNVM-based architectures for online learning and offline classification.

Original languageEnglish (US)
Article number8246561
Pages (from-to)3067-3080
Number of pages14
JournalIEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems
Volume37
Issue number12
DOIs
StatePublished - Dec 2018

Keywords

  • Emerging nonvolatile memory (eNVM)
  • machine learning
  • neural network (NN)
  • neuromorphic computing
  • offline classification
  • online learning
  • synaptic devices

ASJC Scopus subject areas

  • Software
  • Computer Graphics and Computer-Aided Design
  • Electrical and Electronic Engineering

Fingerprint Dive into the research topics of 'NeuroSim: A circuit-level macro model for benchmarking neuro-inspired architectures in online learning'. Together they form a unique fingerprint.

Cite this