Dynamic versus Static Load Balancing in a Pipeline Computation
نویسندگان
چکیده
We examine load balancing in a simple pipeline computation, in which a large number of data sets is pipelined through a series of tasks and load balancing is performed by distributing several available processors among the tasks. We compare the performance of the optimal static processor assignment to the performances of three dynamic processor assignment algorithms. Models are derived which allow us to approximate the performance of the dynamic algorithms theoretically. The relative performances of the algorithms are investigated for various amounts of overhead, using a combination of modeling and simulation. We indicate that an appropriate dynamic algorithm can improve performance even when the overhead induced by the algorithm is relatively high.
منابع مشابه
Performance Evaluation of Static and Dynamic Load Balancing Schemes for a Parallel Computational Fluid Dynamics Software (CFD) Application (FLUENT) Distributed across Clusters of Heterogeneous Symmetric Multiprocessor Systems
Computational Fluid Dynamics (CFD) applications are “highly parallelizable” and can be distributed across a cluster of computers. However, because computation time can vary with the distributed part (mesh), the system loads are unpredictable and processors can have widely different computation speeds. Load balancing (and thus computational efficiency) across a heterogeneous cluster of processor...
متن کاملStatic versus dynamic heterogeneous parallel schemes to solve the symmetric tridiagonal eigenvalue problem
Computation of the eigenvalues of a symmetric tridiagonal matrix is a problem of great relevance. Many linear algebra libraries provide subroutines for solving it. But none of them is oriented to be executed in heterogeneous distributed memory multicomputers. In this work we focus on this kind of platforms. Two different load balancing schemes are presented and implemented. The experimental res...
متن کاملSynchronization-Free Parallel Collision Detection Pipeline
We present a first parallel and adaptive collision detection pipeline running on a multi-core architecture. This pipeline integrates a first global synchronization-free parallelization of its major steps and enables to dynamically adapt the parallelism repartition during the simulation. We propose to break the sequentiality of the pipeline by simultaneously executing the two main phases (broad ...
متن کاملAn Empirical Study and Analysis of the Dynamic Load Balancing Techniques Used in Parallel Computing Systems
A parallel computer system is a collection of processing elements that communicate and cooperate to solve large computational problems efficiently. To achieve this, at first the large computational problem is partitioned into several tasks with different work-loads and then are assigned to the different processing elements for computation. Distribution of the work load is known as Load Balancin...
متن کاملStatic Load Balancing Algorithms In Cloud Computing: Challenges & Solutions
Cloud computing provides on-demand hosted computing resources and services over the Internet on a pay-per-use basis. It is currently becoming the favored method of communication and computation over scalable networks due to numerous attractive attributes such as high availability, scalability, fault tolerance, simplicity of management and low cost of ownership. Due to the huge demand of cloud c...
متن کامل