Analog Weights in ReRAM DNN Accelerators

Jason K. Eshraghian, Sung Mo Kang, Seungbum Baek, Garrick Orchard, Herbert Ho Ching Iu, Wen Lei

Research output: Chapter in Book/Conference paperConference paper

9 Citations (Scopus)

Abstract

Artificial neural networks have become ubiquitous in modern life, which has triggered the emergence of a new class of application specific integrated circuits for their acceleration. ReRAM-based accelerators have gained significant traction due to their ability to leverage in-memory computations. In a crossbar structure, they can perform multiply-and-accumulate operations more efficiently than standard CMOS logic. By virtue of being resistive switches, ReRAM switches can only reliably store one of two states. This is a severe limitation on the range of values in a computational kernel. This paper presents a novel scheme in alleviating the single-bit-per-device restriction by exploiting frequency dependence of v-i plane hysteresis, and assigning kernel information not only to the device conductance but also partially distributing it to the frequency of a time-varying input.We show this approach reduces average power consumption for a single crossbar convolution by up to a factor of ×16 for an unsigned 8-bit input image, where each convolutional process consumes a worst-case of 1.1mW, and reduces area by a factor of ×8, without reducing accuracy to the level of binarized neural networks. This presents a massive saving in computing cost when there are many simultaneous in-situ multiply-and-accumulate processes occurring across different crossbars.

Original languageEnglish
Title of host publicationProceedings 2019 IEEE International Conference on Artificial Intelligence Circuits and Systems, AICAS 2019
PublisherIEEE, Institute of Electrical and Electronics Engineers
Pages267-271
Number of pages5
ISBN (Electronic)9781538678848
DOIs
Publication statusPublished - 1 Mar 2019
Event1st IEEE International Conference on Artificial Intelligence Circuits and Systems, AICAS 2019 - Hsinchu, Taiwan, Province of China
Duration: 18 Mar 201920 Mar 2019

Publication series

NameProceedings 2019 IEEE International Conference on Artificial Intelligence Circuits and Systems, AICAS 2019

Conference

Conference1st IEEE International Conference on Artificial Intelligence Circuits and Systems, AICAS 2019
CountryTaiwan, Province of China
CityHsinchu
Period18/03/1920/03/19

Fingerprint Dive into the research topics of 'Analog Weights in ReRAM DNN Accelerators'. Together they form a unique fingerprint.

Cite this