A Hardware/Software Co-Design Methodology for Adaptive Approximate Computing in clustering and ANN Learning

As one of the most promising energy-efficient emerging paradigms for designing digital systems, approximate computing has attracted a significant attention in recent years. Applications utilizing approximate computing (AxC) can tolerate some loss of quality in the computed results for attaining high...

Full description

Bibliographic Details
Main Authors: Pengfei Huang, Chenghua Wang, Weiqiang Liu, Fei Qiao, Fabrizio Lombardi
Format: Article
Language:English
Published: IEEE 2021-01-01
Series:IEEE Open Journal of the Computer Society
Subjects:
Online Access:https://ieeexplore.ieee.org/document/9324944/
id doaj-36144ffcb0fd42bcba0d6d23ee54b48a
record_format Article
spelling doaj-36144ffcb0fd42bcba0d6d23ee54b48a2021-03-29T16:59:30ZengIEEEIEEE Open Journal of the Computer Society2644-12682021-01-012385210.1109/OJCS.2021.30516439324944A Hardware/Software Co-Design Methodology for Adaptive Approximate Computing in clustering and ANN LearningPengfei Huang0Chenghua Wang1Weiqiang Liu2https://orcid.org/0000-0001-8398-8648Fei Qiao3https://orcid.org/0000-0002-5054-9590Fabrizio Lombardi4https://orcid.org/0000-0003-3152-3245College of Electronic and Information Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing, ChinaCollege of Electronic and Information Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing, ChinaCollege of Electronic and Information Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing, ChinaDepartment of Electronic Engineering, Tsinghua University, Beijing, ChinaDepartment of Electrical Engineering, Northeastern University, Boston, USAAs one of the most promising energy-efficient emerging paradigms for designing digital systems, approximate computing has attracted a significant attention in recent years. Applications utilizing approximate computing (AxC) can tolerate some loss of quality in the computed results for attaining high performance. Approximate arithmetic circuits have been extensively studied; however, their application at system level has not been extensively pursued. Furthermore, when approximate arithmetic circuits are applied at system level, error-accumulation effects and a convergence problem may occur in computation. Multiple approximate components can interact in a typical datapath, hence benefiting from each other. Many applications require more complex datapaths than a single multiplication. In this paper, a hardware/software co-design methodology for adaptive approximate computing is proposed. It makes use of feature constraints to guide the approximate computation at various accuracy levels in each iteration of the learning process in Artificial Neural Networks (ANNs). The proposed adaptive methodology also considers the input operand distribution and the hybrid approximation. Compared with a baseline design, the proposed method significantly reduces the power-delay product while incurring in only a small loss of accuracy. Simulation and a case study of image segmentation validate the effectiveness of the proposed methodology.https://ieeexplore.ieee.org/document/9324944/Approximate computingapproximate multiplierk-means clusteringsemi-supervised learning
collection DOAJ
language English
format Article
sources DOAJ
author Pengfei Huang
Chenghua Wang
Weiqiang Liu
Fei Qiao
Fabrizio Lombardi
spellingShingle Pengfei Huang
Chenghua Wang
Weiqiang Liu
Fei Qiao
Fabrizio Lombardi
A Hardware/Software Co-Design Methodology for Adaptive Approximate Computing in clustering and ANN Learning
IEEE Open Journal of the Computer Society
Approximate computing
approximate multiplier
k-means clustering
semi-supervised learning
author_facet Pengfei Huang
Chenghua Wang
Weiqiang Liu
Fei Qiao
Fabrizio Lombardi
author_sort Pengfei Huang
title A Hardware/Software Co-Design Methodology for Adaptive Approximate Computing in clustering and ANN Learning
title_short A Hardware/Software Co-Design Methodology for Adaptive Approximate Computing in clustering and ANN Learning
title_full A Hardware/Software Co-Design Methodology for Adaptive Approximate Computing in clustering and ANN Learning
title_fullStr A Hardware/Software Co-Design Methodology for Adaptive Approximate Computing in clustering and ANN Learning
title_full_unstemmed A Hardware/Software Co-Design Methodology for Adaptive Approximate Computing in clustering and ANN Learning
title_sort hardware/software co-design methodology for adaptive approximate computing in clustering and ann learning
publisher IEEE
series IEEE Open Journal of the Computer Society
issn 2644-1268
publishDate 2021-01-01
description As one of the most promising energy-efficient emerging paradigms for designing digital systems, approximate computing has attracted a significant attention in recent years. Applications utilizing approximate computing (AxC) can tolerate some loss of quality in the computed results for attaining high performance. Approximate arithmetic circuits have been extensively studied; however, their application at system level has not been extensively pursued. Furthermore, when approximate arithmetic circuits are applied at system level, error-accumulation effects and a convergence problem may occur in computation. Multiple approximate components can interact in a typical datapath, hence benefiting from each other. Many applications require more complex datapaths than a single multiplication. In this paper, a hardware/software co-design methodology for adaptive approximate computing is proposed. It makes use of feature constraints to guide the approximate computation at various accuracy levels in each iteration of the learning process in Artificial Neural Networks (ANNs). The proposed adaptive methodology also considers the input operand distribution and the hybrid approximation. Compared with a baseline design, the proposed method significantly reduces the power-delay product while incurring in only a small loss of accuracy. Simulation and a case study of image segmentation validate the effectiveness of the proposed methodology.
topic Approximate computing
approximate multiplier
k-means clustering
semi-supervised learning
url https://ieeexplore.ieee.org/document/9324944/
work_keys_str_mv AT pengfeihuang ahardwaresoftwarecodesignmethodologyforadaptiveapproximatecomputinginclusteringandannlearning
AT chenghuawang ahardwaresoftwarecodesignmethodologyforadaptiveapproximatecomputinginclusteringandannlearning
AT weiqiangliu ahardwaresoftwarecodesignmethodologyforadaptiveapproximatecomputinginclusteringandannlearning
AT feiqiao ahardwaresoftwarecodesignmethodologyforadaptiveapproximatecomputinginclusteringandannlearning
AT fabriziolombardi ahardwaresoftwarecodesignmethodologyforadaptiveapproximatecomputinginclusteringandannlearning
AT pengfeihuang hardwaresoftwarecodesignmethodologyforadaptiveapproximatecomputinginclusteringandannlearning
AT chenghuawang hardwaresoftwarecodesignmethodologyforadaptiveapproximatecomputinginclusteringandannlearning
AT weiqiangliu hardwaresoftwarecodesignmethodologyforadaptiveapproximatecomputinginclusteringandannlearning
AT feiqiao hardwaresoftwarecodesignmethodologyforadaptiveapproximatecomputinginclusteringandannlearning
AT fabriziolombardi hardwaresoftwarecodesignmethodologyforadaptiveapproximatecomputinginclusteringandannlearning
_version_ 1724198397180641280