Improving Performance of Multi-Dimensional Array Redistribution on Distributed Memory Machines
نویسندگان
چکیده
Array redistribution is required very often in programs on distributed memory parallel computers. It is essential to use e cient algorithms for redistribution, otherwise the performance of the programs may degrade considerably. In this paper, we focus on automatic generation of communication routines for multidimensional redistribution. The principal advantage of this work is to gain the ability to handle redistribution between arbitrary source and destination processor sets and between arbitrary source and destination distribution schemes. We have implemented these algorithms using Parallelware communication library. Some optimization techniques for our algorithms are also proposed in this paper. Experimental results show the e ciency and exibility of our techniques compared to the other redistribution works. keyword Parallelizing compiler, HPF, Array redistribution, Automatic data distribution, Automatic parallelization and optimization.
منابع مشابه
Multi-Phase Redistribution: A Communication-Efficient Approach to Array Redistributionz
Distributed-memory implementations of several scientific applications require array redistribution. Array redistribution is used in languages such as High Performance Fortran to dynamically change the distribution of arrays across processors. Performing array redistribution incurs two overheads an indexing overhead for determining the set of processors to communicate with and the array elements...
متن کاملCoarse - Grained Parallel Algorithms forMulti - Dimensional Wavelet
This paper presents parallel algorithms for computing multi-dimensional wavelet transforms on both shared memory and distributed memory machines. Traditional data partitioning methods for n-dimensional Discrete Wavelet Transforms (DWTs) call for data redistribution once a one dimensional wavelet transform is computed along each dimension. To avoid the data communication inherent in this redistr...
متن کاملParallel Wavelet Transforms for Image Proccessing
Wavelet Transforms have proved to be very successful in image processing tasks such as image compression , feature detection, and ltering. This paper presents parallel algorithms for computing multi-dimensional wavelet transforms on both shared memory and distributed memory machines. Traditional data partitioning methods for n-dimensional DWTs call for data redistribution once a one dimensional...
متن کاملContention-Free Communication Scheduling for Array Redistribution
Array redistribution is required often in programs on distributed memory parallel computers. It is essential to use ecient algorithms for redistribution, otherwise the performance of the programs may degrade considerably. The redistribution overheads consist of two parts: index computation and interprocessor communication. If there is no communication scheduling in a redistribution algorithm, ...
متن کاملArray Operation Synthesis to Optimize HPF Programs
An increasing number of programming languages, such as Fortran 90, HPF, and APL, are providing a rich set of intrinsic array functions and array expressions. These constructs which constitute an important part of data parallel languages provide excellent opportunities for compiler optimizations. The synthesis of consecutive array operations or array expressions into a composite access function ...
متن کامل