A Hardware/Software Co-Design Methodology for Adaptive Approximate Computing in clustering and ANN Learning
As one of the most promising energy-efficient emerging paradigms for designing digital systems, approximate computing has attracted a significant attention in recent years. Applications utilizing approximate computing (AxC) can tolerate some loss of quality in the computed results for attaining high...
Main Authors: | , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
IEEE
2021-01-01
|
Series: | IEEE Open Journal of the Computer Society |
Subjects: | |
Online Access: | https://ieeexplore.ieee.org/document/9324944/ |
id |
doaj-36144ffcb0fd42bcba0d6d23ee54b48a |
---|---|
record_format |
Article |
spelling |
doaj-36144ffcb0fd42bcba0d6d23ee54b48a2021-03-29T16:59:30ZengIEEEIEEE Open Journal of the Computer Society2644-12682021-01-012385210.1109/OJCS.2021.30516439324944A Hardware/Software Co-Design Methodology for Adaptive Approximate Computing in clustering and ANN LearningPengfei Huang0Chenghua Wang1Weiqiang Liu2https://orcid.org/0000-0001-8398-8648Fei Qiao3https://orcid.org/0000-0002-5054-9590Fabrizio Lombardi4https://orcid.org/0000-0003-3152-3245College of Electronic and Information Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing, ChinaCollege of Electronic and Information Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing, ChinaCollege of Electronic and Information Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing, ChinaDepartment of Electronic Engineering, Tsinghua University, Beijing, ChinaDepartment of Electrical Engineering, Northeastern University, Boston, USAAs one of the most promising energy-efficient emerging paradigms for designing digital systems, approximate computing has attracted a significant attention in recent years. Applications utilizing approximate computing (AxC) can tolerate some loss of quality in the computed results for attaining high performance. Approximate arithmetic circuits have been extensively studied; however, their application at system level has not been extensively pursued. Furthermore, when approximate arithmetic circuits are applied at system level, error-accumulation effects and a convergence problem may occur in computation. Multiple approximate components can interact in a typical datapath, hence benefiting from each other. Many applications require more complex datapaths than a single multiplication. In this paper, a hardware/software co-design methodology for adaptive approximate computing is proposed. It makes use of feature constraints to guide the approximate computation at various accuracy levels in each iteration of the learning process in Artificial Neural Networks (ANNs). The proposed adaptive methodology also considers the input operand distribution and the hybrid approximation. Compared with a baseline design, the proposed method significantly reduces the power-delay product while incurring in only a small loss of accuracy. Simulation and a case study of image segmentation validate the effectiveness of the proposed methodology.https://ieeexplore.ieee.org/document/9324944/Approximate computingapproximate multiplierk-means clusteringsemi-supervised learning |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Pengfei Huang Chenghua Wang Weiqiang Liu Fei Qiao Fabrizio Lombardi |
spellingShingle |
Pengfei Huang Chenghua Wang Weiqiang Liu Fei Qiao Fabrizio Lombardi A Hardware/Software Co-Design Methodology for Adaptive Approximate Computing in clustering and ANN Learning IEEE Open Journal of the Computer Society Approximate computing approximate multiplier k-means clustering semi-supervised learning |
author_facet |
Pengfei Huang Chenghua Wang Weiqiang Liu Fei Qiao Fabrizio Lombardi |
author_sort |
Pengfei Huang |
title |
A Hardware/Software Co-Design Methodology for Adaptive Approximate Computing in clustering and ANN Learning |
title_short |
A Hardware/Software Co-Design Methodology for Adaptive Approximate Computing in clustering and ANN Learning |
title_full |
A Hardware/Software Co-Design Methodology for Adaptive Approximate Computing in clustering and ANN Learning |
title_fullStr |
A Hardware/Software Co-Design Methodology for Adaptive Approximate Computing in clustering and ANN Learning |
title_full_unstemmed |
A Hardware/Software Co-Design Methodology for Adaptive Approximate Computing in clustering and ANN Learning |
title_sort |
hardware/software co-design methodology for adaptive approximate computing in clustering and ann learning |
publisher |
IEEE |
series |
IEEE Open Journal of the Computer Society |
issn |
2644-1268 |
publishDate |
2021-01-01 |
description |
As one of the most promising energy-efficient emerging paradigms for designing digital systems, approximate computing has attracted a significant attention in recent years. Applications utilizing approximate computing (AxC) can tolerate some loss of quality in the computed results for attaining high performance. Approximate arithmetic circuits have been extensively studied; however, their application at system level has not been extensively pursued. Furthermore, when approximate arithmetic circuits are applied at system level, error-accumulation effects and a convergence problem may occur in computation. Multiple approximate components can interact in a typical datapath, hence benefiting from each other. Many applications require more complex datapaths than a single multiplication. In this paper, a hardware/software co-design methodology for adaptive approximate computing is proposed. It makes use of feature constraints to guide the approximate computation at various accuracy levels in each iteration of the learning process in Artificial Neural Networks (ANNs). The proposed adaptive methodology also considers the input operand distribution and the hybrid approximation. Compared with a baseline design, the proposed method significantly reduces the power-delay product while incurring in only a small loss of accuracy. Simulation and a case study of image segmentation validate the effectiveness of the proposed methodology. |
topic |
Approximate computing approximate multiplier k-means clustering semi-supervised learning |
url |
https://ieeexplore.ieee.org/document/9324944/ |
work_keys_str_mv |
AT pengfeihuang ahardwaresoftwarecodesignmethodologyforadaptiveapproximatecomputinginclusteringandannlearning AT chenghuawang ahardwaresoftwarecodesignmethodologyforadaptiveapproximatecomputinginclusteringandannlearning AT weiqiangliu ahardwaresoftwarecodesignmethodologyforadaptiveapproximatecomputinginclusteringandannlearning AT feiqiao ahardwaresoftwarecodesignmethodologyforadaptiveapproximatecomputinginclusteringandannlearning AT fabriziolombardi ahardwaresoftwarecodesignmethodologyforadaptiveapproximatecomputinginclusteringandannlearning AT pengfeihuang hardwaresoftwarecodesignmethodologyforadaptiveapproximatecomputinginclusteringandannlearning AT chenghuawang hardwaresoftwarecodesignmethodologyforadaptiveapproximatecomputinginclusteringandannlearning AT weiqiangliu hardwaresoftwarecodesignmethodologyforadaptiveapproximatecomputinginclusteringandannlearning AT feiqiao hardwaresoftwarecodesignmethodologyforadaptiveapproximatecomputinginclusteringandannlearning AT fabriziolombardi hardwaresoftwarecodesignmethodologyforadaptiveapproximatecomputinginclusteringandannlearning |
_version_ |
1724198397180641280 |