Coded Parallel Transmission for Half-Duplex Distributed Computing
نویسندگان
چکیده
This work studies a general distributed coded computing system based on the MapReduce-type framework, where nodes within half-duplex network wish to compute multiple output functions. We first introduce definition of communication delay characterize time cost during date shuffle phase, and then propose novel coding strategy that enables parallel transmission among computation by delicately designing data placement, message symbols encoding, shuffling, decoding. Compared (CDC) scheme proposed Li et al., significantly reduces delay, in particular when load is relatively smaller than number K. Moreover, CDC monotonically increasing function K, while our decreases as K increases, indicating can make better use resources.
منابع مشابه
Coded Computing for Distributed Graph Analytics
Many distributed graph computing systems have been developed recently for efficient processing of massive graphs. These systems require many messages to be exchanged among computing machines at each step of the computation, making communication bandwidth a major performance bottleneck. We present a coded computing framework that systematically injects redundancy in the computation phase to enab...
متن کاملFull-Duplex Relaying with Half-Duplex Relays
We consider “virtual” full-duplex relaying by means of half-duplex relays. In this configuration, each relay stage in a multi-hop relaying network is formed by at least two relays, used alternatively in transmit and receive modes, such that while one relay transmits its signal to the next stage, the other relay receives a signal from the previous stage. With such a pipelined scheme, the source ...
متن کاملLocality Abstractions for Parallel and Distributed Computing
Virtual Processor Fig. 1. The Sting software architecture. VPs, and (c) performs initial thread placement on the VPs de ned within a given virtual machine . Just as VPs context switch threads, a physical processor will context switch virtual processors because of preemption, or because a VP speci cally requests a context switch (e.g., because of an I/O call initiated by its current thread). We ...
متن کاملPVM: A Framework for Parallel Distributed Computing
The PVM system is a programming environment for the development and execution of large concurrent or parallel applications that consist of many interacting, but relatively independent, components. It is intended to operate on a collection of heterogeneous computing elements interconnected by one or more networks. The participating processors may be scalar machines, multiprocessors, or special-p...
متن کاملParallel and distributed computing for data mining
Similar scenarios will occur in other areas: we will see large numbers of radiological images generated in hospitals and immense product and customer databases as the Internet and e-commerce continue to expand.1 Exploring useful information from such data will require efficient parallel algorithms running on high-performance computing systems with powerful parallel I/O capabilities. Without suc...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Information
سال: 2022
ISSN: ['2078-2489']
DOI: https://doi.org/10.3390/info13070342