H-PS: A Heterogeneous-Aware Parameter Server With Distributed Neural Network Training

H-PS: A Heterogeneous-Aware Parameter Server With Distributed Neural Network Training

Deep neural networks have become one of the popular techniques used in many research and application areas including computer vision, natural language processing, etc. As the complexity of neural networks continuously increasing, the training process takes a much longer time and requires more comput...

Full description

Bibliographic Details
Main Authors: Lintao Xian, Bingzhe Li, Jing Liu, Zhongwen Guo, David H. C. Du
Format: Article
Language:English
Published: IEEE 2021-01-01
Series:IEEE Access
Subjects:
Distributed machine learning (DML)
heterogeneous environments
dynamically scheduling tasks
pipeline communication and computation
dynamic quantization parameter
Online Access:https://ieeexplore.ieee.org/document/9356607/

Internet

https://ieeexplore.ieee.org/document/9356607/

Similar Items