Patterns for Overlapping Communication and Computation
نویسندگان
چکیده
Parallel applications commonly face the problem of sitting idle while waiting for remote data to become available. Even for problems where plenty of parallelism is available and good load balance is achievable, performance may be disappointing if local work cannot be overlapped with communication. We describe three patterns for achieving the overlap of communication with computation: overdecomposition, non-blocking communication, and speculation.
منابع مشابه
Sparse Non-blocking Collectives in Quantum Mechanical Calculations
For generality, MPI collective operations support arbitrary dense communication patterns. However, in many applications where collective operations would be beneficial, only sparse communication patterns are required. This paper presents one such application: Octopus, a production-quality quantum mechanical simulation. We introduce new sparse collective operations defined on graph communicators...
متن کاملStudying the Performance of Overlapping Communication and Computation by Active Message: INUKTITUT Case
Overlapping of communication and computation has been intuitively used for a long time to improve the performance of parallel computing. One of approaches which allow increasing the ability of this overlapping is to use active message. This paper presents the study of the overlapping communication/computation performance of INUKTITUT, an interface based on active message. This interface allows ...
متن کاملOverlapping Communication with Computation in Distributed Object Systems
In the framework of distributed object systems, this paper presents the concepts and an implementation of an overlapping mechanism between communication and computation. This mechanism allows to decrease the execution time of a remote method invocation.
متن کاملCommunication and Computation Overlap through Task Synchronization in Multi-Locale Chapel Environment
Parallel processing systems use data parallelism to achieve high performance data processing. Data parallelism is normally based on data arrays, which are distributed to separate nodes. Therefore, efficient communication between nodes is required to initialize the distribution. In this paper, we propose a computation and communication overlapping technique to reduce the overhead of communicatio...
متن کاملPerformance Improvement by Overlapping Computation and Communication on SMP Clusters
Clusters of SMPs (Symmetric Mul-tiprocessor Systems) have emerged as important platforms for high performance computing. As a programming scheme on SMP clusters, we proposed hybrid shared memory/distributed memory programming. In order to tolerate inter-node communication , we overlapped the inter-node communication and computation using remote memory based user-level communication primitives N...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2009