SHIELD: A Fault-Tolerant MPI for an Infiniband Cluster
نویسندگان
چکیده
Today’s high performance cluster computing technologies demand extreme robustness against unexpected failures to finish aggressively parallelized work in a given time constraint. Although there has been a steady effort in developing hardware and software tools to increase fault-resilience of cluster environments, a successful solution has yet to be delivered to commercial vendors. This paper presents SHIELD, a practical and easily-deployable fault-tolerant MPI and management system of MPI for an Infiniband cluster. SHIELD provides a novel framework that can be easily used in real cluster systems, and it has different design perspectives than those proposed by other fault-tolerant MPI. We show that SHIELD provides robust fault-resilience to fault-vulnerable cluster systems and that the design features of SHIELD are useful wherever fault-resilience is regarded as the matter of utmost importance.
منابع مشابه
Automatic Fault - Tolerant MPI
High performance computing platforms such as Clusters, Grid and Desktop Grids are becoming larger and subject to more frequent failures. MPI is one of the most used message passing libraries in HPC applications. These two trends raise the need for fault-tolerant MPI. The MPICH-V project focuses on designing, implementing and comparing several automatic fault-tolerant protocols for MPI applicati...
متن کاملFEMPI: A Lightweight Fault-tolerant MPI for Embedded Cluster Systems
Ever-increasing demands of space missions for data returns from their limited processing and communications resources have made the traditional approach of data gathering, data compression, and data transmission no longer viable. Increasing on-board processing power by providing high-performance computing (HPC) capabilities using commercial-off-the-shelf (COTS) components is a promising approac...
متن کاملBuilding Multirail InfiniBand Clusters: MPI-Level Designs and Performance Evaluation
In the area of cluster computing, InfiniBand is becoming increasingly popular due to its open standard and high performance. However, even with InfiniBand, network bandwidth can still become the performance bottleneck for some of today’s most demanding applications. In this paper, we study the problem of how to overcome the bandwidth bottleneck by using multirail networks. We present different ...
متن کاملCooperative VM Migration: A Symbiotic Virtualization Mechanism by Leveraging the Guest OS Knowledge
A virtual machine (VM) migration is useful for improving flexibility and maintainability in cloud computing environments. However, VM monitor (VMM)-bypass I/O technologies, including PCI passthrough and SR-IOV, in which the overhead of I/O virtualization can be significantly reduced, make VM migration impossible. This paper proposes a novel and practical mechanism, called Symbiotic Virtualizati...
متن کاملStar sh Fault Tolerant Dynamic MPI Programs on Clusters of Workstations
This paper reports on the architecture and design of Star sh an environment for executing dynamic and static MPI programs on a cluster of work stations Star sh is unique in being e cient fault tolerant highly available and dynamic as a system internally and in supporting fault tolerance and dy namicity for its application programs as well Star sh achieves these goals by combining group communic...
متن کامل