Coded Parallel Transmission for Half-Duplex Distributed Computing

This work studies a general distributed coded computing system based on the MapReduce-type framework, where distributed computing nodes within a half-duplex network wish to compute multiple output functions. We first introduce a definition of communication delay to characterize the time cost during...

Full description

Bibliographic Details
Main Authors: Zai, Qixuan (Author), Yuan, Kai (Author), Wu, Youlong (Author)
Format: Article
Language:English
Published: Multidisciplinary Digital Publishing Institute, 2022-07-25T18:47:40Z.
Subjects:
Online Access:Get fulltext
LEADER 01483 am a22001453u 4500
001 144037
042 |a dc 
100 1 0 |a Zai, Qixuan  |e author 
700 1 0 |a Yuan, Kai  |e author 
700 1 0 |a Wu, Youlong  |e author 
245 0 0 |a Coded Parallel Transmission for Half-Duplex Distributed Computing 
260 |b Multidisciplinary Digital Publishing Institute,   |c 2022-07-25T18:47:40Z. 
856 |z Get fulltext  |u https://hdl.handle.net/1721.1/144037 
520 |a This work studies a general distributed coded computing system based on the MapReduce-type framework, where distributed computing nodes within a half-duplex network wish to compute multiple output functions. We first introduce a definition of communication delay to characterize the time cost during the date shuffle phase, and then propose a novel coding strategy that enables parallel transmission among the computation nodes by delicately designing the data placement, message symbols encoding, data shuffling, and decoding. Compared to the coded distributed computing (CDC) scheme proposed by Li et al., the proposed scheme significantly reduces the communication delay, in particular when the computation load is relatively smaller than the number of computing nodes <i>K</i>. Moreover, the communication delay of CDC is a monotonically increasing function of <i>K</i>, while the communication delay of our scheme decreases as <i>K</i> increases, indicating that the proposed scheme can make better use of the computing resources. 
655 7 |a Article