In this paper, we investigate the problem of scheduling transmissions for spatially scattered nodes that contribute to a collaborative federated learning (FL) algorithm via wireless links provided by drone. considered system, drone acts as an orchestrator, coordinating and schedule within predefined deadline. The actual is reflected in planned path: traverses it, it controls distance thereby da...

Graph neural networks (GNNs) have emerged due to their success at modeling graph data. Yet, it is challenging for GNNs efficiently scale large graphs. Thus, distributed come into play. To avoid communication caused by expensive data movement between workers, we propose Sancus, a staleness-aware communication-avoiding decentralized GNN system. By introducing set of novel bounded embedding stalen...

Actifio American Power Corporation EMC Corporation Emulex Facebook Fusion-io Google Hewlett-Packard Labs Hitachi, Ltd. Huawei Technologies Co. Intel Corporation Microsoft Research NEC Laboratories NetApp, Inc. Oracle Corporation Panasas Samsung Information Systems America Seagate Technology STEC, Inc. Symantec Corporation VMware, Inc. Western Digital LazyTables ....................................

Many important applications fall into the broad class of iterative convergent algorithms. Parallel implementations of these algorithms are naturally expressed using the Bulk Synchronous Parallel (BSP) model of computation. However, implementations using BSP are plagued by the straggler problem, where every transient slowdown of any given thread can delay all other threads. This paper presents t...

Distributed Stochastic Gradient Descent (SGD) when run in a synchronous manner, suffers from delays runtime as it waits for the slowest workers (stragglers). Asynchronous methods can alleviate stragglers, but cause gradient staleness that adversely affect convergence xmlns:xlink="http://www.w3....

We present a piggyback server invalidation (PSI) mechanism for maintaining stronger cache coherency in Web proxy caches while reducing overall costs. The basic idea is for servers to piggyback on a reply to a proxy client, the list of resources that have changed since the last access by the client. The proxy client invalidates cached entries on the list and can extend the lifetime of entries no...

Today, web performance is primarily governed by round-trip latencies between end devices and cloud services. To improve performance, services need to minimize the delay of accessing data. In this paper, we propose a novel approach to low latency that relies on existing content delivery and web caching infrastructure. The main idea is to enable application-independent caching of query results an...