FLEX-MPI: An MPI Extension for Supporting Dynamic Load Balancing on Heterogeneous Non-dedicated Systems
نویسندگان
چکیده
This paper introduces FLEX-MPI, a novel runtime approach for the dynamic load balancing of MPI-based SPMD applications running on heterogeneous platforms in the presence of dynamic external loads. To effectively balance the workload, FLEX-MPI monitors the actual performance of applications via hardware counters and the MPI profiling interface—with a negligible overhead and minimal code modifications. Our results show that by using this approach the execution time of an application may be significantly reduced.
منابع مشابه
Parleda: a Library for Parallel Processing in Computational Geometry Applications
ParLeda is a software library that provides the basic primitives needed for parallel implementation of computational geometry applications. It can also be used in implementing a parallel application that uses geometric data structures. The parallel model that we use is based on a new heterogeneous parallel model named HBSP, which is based on BSP and is introduced here. ParLeda uses two main lib...
متن کاملDynamic Load-Balancing for the STEM-II Air Quality Model
The aim of this work is to improve load balance of the MPI parallel version of the STEM-II air quality model. Several dynamic data distributions are proposed and evaluated on different systems: homogeneous and dedicated, and heterogeneous and/or non-dedicated. Results prove that dynamic distribution strategies perform better than traditional static distributions. Although all the data distribut...
متن کاملSupporting Adaptivity in MPI for Dynamic Parallel Applications
The new generation of parallel applications are complex, involve simulation of dynamically varying systems, and use adaptive techniques such as multiple timestepping and adaptive refinements. Typical implementations of the MPI do not support the dynamic nature of these applications well. As a result, programming productivity and parallel efficiency suffer. In this paper, we present Adaptive MPI...
متن کاملAdaptive Load Balancing for MPI Programs
Parallel Computational Science and Engineering (CSE) applications often exhibit irregular structure and dynamic load patterns. Many such applications have been developed using MPI. Incorporating dynamic load balancing techniques at the application-level involves significant changes to the design and structure of applications. On the other hand, traditional run-time systems for MPI do not suppor...
متن کاملParallel strategies for the three-dimensional reconstruction of biological specimens
In general, image processing programs are roughly based on three stages: data input, computer data processing and data output. The key point in this kind of programs is the workflow management in order to obtain the best performance on heterogeneous computer clusters or grids. Computer technology trends lead us to consider a 2-level hierarchical architecture on the new computer systems, i. e., ...
متن کامل