An Energy-Efficient and High Throughput in-Memory Computing Bit-Cell With Excellent Robustness Under Process Variations for Binary Neural Network

In-memory computing (IMC) is a promising approach for energy cost reduction due to data movement between memory and processor for running data-intensive deep learning applications on the computing systems. Together with Binary Neural Network (BNN), IMC provides a viable solution for running deep neu...

Full description

Bibliographic Details
Main Authors: Gobinda Saha, Zhewei Jiang, Sanjay Parihar, Cao Xi, Jack Higman, Muhammed Ahosan Ul Karim
Format: Article
Language:English
Published: IEEE 2020-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/9091590/
id doaj-ef9e07726523424ca1b32684a963c970
record_format Article
spelling doaj-ef9e07726523424ca1b32684a963c9702021-03-30T02:43:54ZengIEEEIEEE Access2169-35362020-01-018914059141410.1109/ACCESS.2020.29939899091590An Energy-Efficient and High Throughput in-Memory Computing Bit-Cell With Excellent Robustness Under Process Variations for Binary Neural NetworkGobinda Saha0Zhewei Jiang1Sanjay Parihar2Cao Xi3Jack Higman4Muhammed Ahosan Ul Karim5https://orcid.org/0000-0003-2036-3960GLOBALFOUNDRIES, Santa Clara, CA, USAGLOBALFOUNDRIES, Santa Clara, CA, USAGLOBALFOUNDRIES, Austin, TX, USAGLOBALFOUNDRIES, Santa Clara, CA, USAGLOBALFOUNDRIES, Austin, TX, USAGLOBALFOUNDRIES, Santa Clara, CA, USAIn-memory computing (IMC) is a promising approach for energy cost reduction due to data movement between memory and processor for running data-intensive deep learning applications on the computing systems. Together with Binary Neural Network (BNN), IMC provides a viable solution for running deep neural networks at the edge devices with stringent memory and energy constraints. In this paper, we propose a novel 10T bit-cell with a back-end-of-line (BEOL) metal-oxide-metal (MOM) capacitor laid on pitch for in-memory computing. Our IMC bit-cell, when arranged in a memory array, performs binary convolution (XNOR followed by Bit-count operations) and binary activation generation operations. We show, when binary layers of BNN are mapped into our IMC arrays for MNIST digit classification, 98.75% accuracy with energy efficiency of 2193 TOPS/W and throughput of 22857 GOPS can be obtained. We determine the memory array size considering the word-line and bit-line nonidealities and show how these impact classification accuracy. We analyze the impact of process variations on classification accuracy and show how word-line pulse tunability provided by our design can be used to improve the robustness of classification under process variations.https://ieeexplore.ieee.org/document/9091590/In-memory computingSRAMbinary neural networknonidealityprocess variation
collection DOAJ
language English
format Article
sources DOAJ
author Gobinda Saha
Zhewei Jiang
Sanjay Parihar
Cao Xi
Jack Higman
Muhammed Ahosan Ul Karim
spellingShingle Gobinda Saha
Zhewei Jiang
Sanjay Parihar
Cao Xi
Jack Higman
Muhammed Ahosan Ul Karim
An Energy-Efficient and High Throughput in-Memory Computing Bit-Cell With Excellent Robustness Under Process Variations for Binary Neural Network
IEEE Access
In-memory computing
SRAM
binary neural network
nonideality
process variation
author_facet Gobinda Saha
Zhewei Jiang
Sanjay Parihar
Cao Xi
Jack Higman
Muhammed Ahosan Ul Karim
author_sort Gobinda Saha
title An Energy-Efficient and High Throughput in-Memory Computing Bit-Cell With Excellent Robustness Under Process Variations for Binary Neural Network
title_short An Energy-Efficient and High Throughput in-Memory Computing Bit-Cell With Excellent Robustness Under Process Variations for Binary Neural Network
title_full An Energy-Efficient and High Throughput in-Memory Computing Bit-Cell With Excellent Robustness Under Process Variations for Binary Neural Network
title_fullStr An Energy-Efficient and High Throughput in-Memory Computing Bit-Cell With Excellent Robustness Under Process Variations for Binary Neural Network
title_full_unstemmed An Energy-Efficient and High Throughput in-Memory Computing Bit-Cell With Excellent Robustness Under Process Variations for Binary Neural Network
title_sort energy-efficient and high throughput in-memory computing bit-cell with excellent robustness under process variations for binary neural network
publisher IEEE
series IEEE Access
issn 2169-3536
publishDate 2020-01-01
description In-memory computing (IMC) is a promising approach for energy cost reduction due to data movement between memory and processor for running data-intensive deep learning applications on the computing systems. Together with Binary Neural Network (BNN), IMC provides a viable solution for running deep neural networks at the edge devices with stringent memory and energy constraints. In this paper, we propose a novel 10T bit-cell with a back-end-of-line (BEOL) metal-oxide-metal (MOM) capacitor laid on pitch for in-memory computing. Our IMC bit-cell, when arranged in a memory array, performs binary convolution (XNOR followed by Bit-count operations) and binary activation generation operations. We show, when binary layers of BNN are mapped into our IMC arrays for MNIST digit classification, 98.75% accuracy with energy efficiency of 2193 TOPS/W and throughput of 22857 GOPS can be obtained. We determine the memory array size considering the word-line and bit-line nonidealities and show how these impact classification accuracy. We analyze the impact of process variations on classification accuracy and show how word-line pulse tunability provided by our design can be used to improve the robustness of classification under process variations.
topic In-memory computing
SRAM
binary neural network
nonideality
process variation
url https://ieeexplore.ieee.org/document/9091590/
work_keys_str_mv AT gobindasaha anenergyefficientandhighthroughputinmemorycomputingbitcellwithexcellentrobustnessunderprocessvariationsforbinaryneuralnetwork
AT zheweijiang anenergyefficientandhighthroughputinmemorycomputingbitcellwithexcellentrobustnessunderprocessvariationsforbinaryneuralnetwork
AT sanjayparihar anenergyefficientandhighthroughputinmemorycomputingbitcellwithexcellentrobustnessunderprocessvariationsforbinaryneuralnetwork
AT caoxi anenergyefficientandhighthroughputinmemorycomputingbitcellwithexcellentrobustnessunderprocessvariationsforbinaryneuralnetwork
AT jackhigman anenergyefficientandhighthroughputinmemorycomputingbitcellwithexcellentrobustnessunderprocessvariationsforbinaryneuralnetwork
AT muhammedahosanulkarim anenergyefficientandhighthroughputinmemorycomputingbitcellwithexcellentrobustnessunderprocessvariationsforbinaryneuralnetwork
AT gobindasaha energyefficientandhighthroughputinmemorycomputingbitcellwithexcellentrobustnessunderprocessvariationsforbinaryneuralnetwork
AT zheweijiang energyefficientandhighthroughputinmemorycomputingbitcellwithexcellentrobustnessunderprocessvariationsforbinaryneuralnetwork
AT sanjayparihar energyefficientandhighthroughputinmemorycomputingbitcellwithexcellentrobustnessunderprocessvariationsforbinaryneuralnetwork
AT caoxi energyefficientandhighthroughputinmemorycomputingbitcellwithexcellentrobustnessunderprocessvariationsforbinaryneuralnetwork
AT jackhigman energyefficientandhighthroughputinmemorycomputingbitcellwithexcellentrobustnessunderprocessvariationsforbinaryneuralnetwork
AT muhammedahosanulkarim energyefficientandhighthroughputinmemorycomputingbitcellwithexcellentrobustnessunderprocessvariationsforbinaryneuralnetwork
_version_ 1724184688542613504