An Energy-Efficient and High Throughput in-Memory Computing Bit-Cell With Excellent Robustness Under Process Variations for Binary Neural Network
In-memory computing (IMC) is a promising approach for energy cost reduction due to data movement between memory and processor for running data-intensive deep learning applications on the computing systems. Together with Binary Neural Network (BNN), IMC provides a viable solution for running deep neu...
Main Authors: | , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
IEEE
2020-01-01
|
Series: | IEEE Access |
Subjects: | |
Online Access: | https://ieeexplore.ieee.org/document/9091590/ |
id |
doaj-ef9e07726523424ca1b32684a963c970 |
---|---|
record_format |
Article |
spelling |
doaj-ef9e07726523424ca1b32684a963c9702021-03-30T02:43:54ZengIEEEIEEE Access2169-35362020-01-018914059141410.1109/ACCESS.2020.29939899091590An Energy-Efficient and High Throughput in-Memory Computing Bit-Cell With Excellent Robustness Under Process Variations for Binary Neural NetworkGobinda Saha0Zhewei Jiang1Sanjay Parihar2Cao Xi3Jack Higman4Muhammed Ahosan Ul Karim5https://orcid.org/0000-0003-2036-3960GLOBALFOUNDRIES, Santa Clara, CA, USAGLOBALFOUNDRIES, Santa Clara, CA, USAGLOBALFOUNDRIES, Austin, TX, USAGLOBALFOUNDRIES, Santa Clara, CA, USAGLOBALFOUNDRIES, Austin, TX, USAGLOBALFOUNDRIES, Santa Clara, CA, USAIn-memory computing (IMC) is a promising approach for energy cost reduction due to data movement between memory and processor for running data-intensive deep learning applications on the computing systems. Together with Binary Neural Network (BNN), IMC provides a viable solution for running deep neural networks at the edge devices with stringent memory and energy constraints. In this paper, we propose a novel 10T bit-cell with a back-end-of-line (BEOL) metal-oxide-metal (MOM) capacitor laid on pitch for in-memory computing. Our IMC bit-cell, when arranged in a memory array, performs binary convolution (XNOR followed by Bit-count operations) and binary activation generation operations. We show, when binary layers of BNN are mapped into our IMC arrays for MNIST digit classification, 98.75% accuracy with energy efficiency of 2193 TOPS/W and throughput of 22857 GOPS can be obtained. We determine the memory array size considering the word-line and bit-line nonidealities and show how these impact classification accuracy. We analyze the impact of process variations on classification accuracy and show how word-line pulse tunability provided by our design can be used to improve the robustness of classification under process variations.https://ieeexplore.ieee.org/document/9091590/In-memory computingSRAMbinary neural networknonidealityprocess variation |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Gobinda Saha Zhewei Jiang Sanjay Parihar Cao Xi Jack Higman Muhammed Ahosan Ul Karim |
spellingShingle |
Gobinda Saha Zhewei Jiang Sanjay Parihar Cao Xi Jack Higman Muhammed Ahosan Ul Karim An Energy-Efficient and High Throughput in-Memory Computing Bit-Cell With Excellent Robustness Under Process Variations for Binary Neural Network IEEE Access In-memory computing SRAM binary neural network nonideality process variation |
author_facet |
Gobinda Saha Zhewei Jiang Sanjay Parihar Cao Xi Jack Higman Muhammed Ahosan Ul Karim |
author_sort |
Gobinda Saha |
title |
An Energy-Efficient and High Throughput in-Memory Computing Bit-Cell With Excellent Robustness Under Process Variations for Binary Neural Network |
title_short |
An Energy-Efficient and High Throughput in-Memory Computing Bit-Cell With Excellent Robustness Under Process Variations for Binary Neural Network |
title_full |
An Energy-Efficient and High Throughput in-Memory Computing Bit-Cell With Excellent Robustness Under Process Variations for Binary Neural Network |
title_fullStr |
An Energy-Efficient and High Throughput in-Memory Computing Bit-Cell With Excellent Robustness Under Process Variations for Binary Neural Network |
title_full_unstemmed |
An Energy-Efficient and High Throughput in-Memory Computing Bit-Cell With Excellent Robustness Under Process Variations for Binary Neural Network |
title_sort |
energy-efficient and high throughput in-memory computing bit-cell with excellent robustness under process variations for binary neural network |
publisher |
IEEE |
series |
IEEE Access |
issn |
2169-3536 |
publishDate |
2020-01-01 |
description |
In-memory computing (IMC) is a promising approach for energy cost reduction due to data movement between memory and processor for running data-intensive deep learning applications on the computing systems. Together with Binary Neural Network (BNN), IMC provides a viable solution for running deep neural networks at the edge devices with stringent memory and energy constraints. In this paper, we propose a novel 10T bit-cell with a back-end-of-line (BEOL) metal-oxide-metal (MOM) capacitor laid on pitch for in-memory computing. Our IMC bit-cell, when arranged in a memory array, performs binary convolution (XNOR followed by Bit-count operations) and binary activation generation operations. We show, when binary layers of BNN are mapped into our IMC arrays for MNIST digit classification, 98.75% accuracy with energy efficiency of 2193 TOPS/W and throughput of 22857 GOPS can be obtained. We determine the memory array size considering the word-line and bit-line nonidealities and show how these impact classification accuracy. We analyze the impact of process variations on classification accuracy and show how word-line pulse tunability provided by our design can be used to improve the robustness of classification under process variations. |
topic |
In-memory computing SRAM binary neural network nonideality process variation |
url |
https://ieeexplore.ieee.org/document/9091590/ |
work_keys_str_mv |
AT gobindasaha anenergyefficientandhighthroughputinmemorycomputingbitcellwithexcellentrobustnessunderprocessvariationsforbinaryneuralnetwork AT zheweijiang anenergyefficientandhighthroughputinmemorycomputingbitcellwithexcellentrobustnessunderprocessvariationsforbinaryneuralnetwork AT sanjayparihar anenergyefficientandhighthroughputinmemorycomputingbitcellwithexcellentrobustnessunderprocessvariationsforbinaryneuralnetwork AT caoxi anenergyefficientandhighthroughputinmemorycomputingbitcellwithexcellentrobustnessunderprocessvariationsforbinaryneuralnetwork AT jackhigman anenergyefficientandhighthroughputinmemorycomputingbitcellwithexcellentrobustnessunderprocessvariationsforbinaryneuralnetwork AT muhammedahosanulkarim anenergyefficientandhighthroughputinmemorycomputingbitcellwithexcellentrobustnessunderprocessvariationsforbinaryneuralnetwork AT gobindasaha energyefficientandhighthroughputinmemorycomputingbitcellwithexcellentrobustnessunderprocessvariationsforbinaryneuralnetwork AT zheweijiang energyefficientandhighthroughputinmemorycomputingbitcellwithexcellentrobustnessunderprocessvariationsforbinaryneuralnetwork AT sanjayparihar energyefficientandhighthroughputinmemorycomputingbitcellwithexcellentrobustnessunderprocessvariationsforbinaryneuralnetwork AT caoxi energyefficientandhighthroughputinmemorycomputingbitcellwithexcellentrobustnessunderprocessvariationsforbinaryneuralnetwork AT jackhigman energyefficientandhighthroughputinmemorycomputingbitcellwithexcellentrobustnessunderprocessvariationsforbinaryneuralnetwork AT muhammedahosanulkarim energyefficientandhighthroughputinmemorycomputingbitcellwithexcellentrobustnessunderprocessvariationsforbinaryneuralnetwork |
_version_ |
1724184688542613504 |