Runtime Support for Parallel I/O in PASSION
نویسندگان
چکیده
We are developing a compiler and runtime support system called PASSION: Parallel And Scalable Software for Input-Output, to translate out-of-core data-parallel programs to message passing node programs with explicit parallel I/O. This paper describes the design and implementation of the runtime system used in PASSION. We explain the basic model used by the compiler and runtime system. We describe the runtime routines for regular problems and provide an initial framework for runtime support for out-of-core irregular problems. Preliminary performance results are presented for 2D FFT and Laplace equation solver, and a kernel from a molecular dynamics code. This work was supported in part by NSF Young Investigator Award CCR-9357840, a grant from Intel SSD, and IBM, and in part by USRA CESDIS Contract # 5555-26. This work was performed in part using the Intel Touchstone Delta System operated by Caltech on behalf of the Concurrent Supercomputing Consortium. Access to this facility was provided by CRPC.
منابع مشابه
PASSION Runtime Library for Parallel I/O
We are developing a compiler and runtime support system called PASSION: Parallel And Scalable Software for Input-Output. PASSION provides software support for I/O intensive out-of-core loosely synchronous problems. This paper gives an overview of the PASSION Runtime Library and describes two of the optimizations incorporated in it, namely Data Prefetching and Data Sieving. Performance improveme...
متن کاملPassion: Parallel and Scalable Software for Input-output
We are developing a software system called PASSION: Parallel And Scalable Software for InputOutput which provides software support for high performance parallel I/O. PASSION provides support at the language, compiler, runtime as well as le system level. PASSION provides runtime procedures for parallel access to les (read/write), as well as for out-of-core computations. These routines can either...
متن کاملA Software Architecture for Massively Parallel Input-Output
| For an increasing number of data intensive scientiic applications, parallel I/O concepts are a major performance issue. Tackling this issue , we provide an outline of an input/output system designed for highly eecient, scalable and conveniently usable parallel I/O on distributed memory systems. The main focus of this paper is the parallel I/O runtime system support provided for software-gener...
متن کاملMTIO - A Multi-Threaded Parallel I/O System
This paper presents the design and evaluation of a multithreaded runtime library for parallel I/O. We extend the multi-threading concept to separate the compute and I/O tasks in two separate threads of control. Multi-threading in our design permits a) asynchronous I/O even if the underlying file system does not support asynchronous I/O; b) copy avoidance from the I/O thread to the compute threa...
متن کاملFast Serial - Append File I / O Mode Support for Cilk
Apart from resources, such as memory and processors, parallel computations also require file I/O. There exist a number of interesting file I/O modes, depending on the specific application. One particularly interesting file I/O mode is serial-append, described in [5]. In this mode the file output of a parallel computation, executed on any number of processors, is “the same” as the output of the ...
متن کامل