High-performance IO
ثبت نشده
چکیده
Storage is becoming key in HPC systems, and especially when Exascale systems enter the game. The amount of data needed to solve the coming HPC challenges will not fit in memory, thus storage systems need to keep the pace of computing improvements; otherwise Exascale machines will waste energy waiting for the storage system to deliver the needed data. This research line investigates several paths to improve the performance of storage systems at both data and metadata levels.
منابع مشابه
High Performance I/O and Data Management
A library for parallel IO and data management has been developed for large-scale multi-physics simulations. The goal of the library is to provide sustainable, interoperable, efficient, scalable, and convenient tools for parallel IO and data management for high-level data structures in applications, and to provide tools for the connection between applications. The high-level data structures incl...
متن کاملMPI-IO: A Standard, Portable API for High-Performance Parallel I/O
MPI-IO, the I/O part of the MPI-2 standard, is a portable API for high-performance parallel I/O. It is speci cally designed to overcome the performance and portability limitations of the Unix-like APIs currently supported by most parallel le systems. We discuss the main features of MPI-IO and describe our MPI-IO implementation, ROMIO, which runs on most machines and le systems, including Linux ...
متن کاملMonolithic multiscale bilayer inverse opal electrodes for dye-sensitized solar cell applications.
Multilayer structures in which the layers are both electrically and physically connected are critical to be used as high-performance electrodes for photovoltaic devices. We present the first multiscale bilayer inverse opal (IO) structures for application as electrodes in dye-sensitized solar cells (DSCs). A bilayer of a mesoscopic IO layer (70 nm pore diameter) and a top macroporous IO layer (2...
متن کاملResiliency in IO Tools for Scientific Computing
IO tools in numerical simulations often serve two functions, one for writing and reading files to restart calculations and the other for writing and processing diagnostic files including files for graphics post-processing. For diagnostic files, tools directly working for high-level data structures are desired, such meshes with adaptive mesh refinement, unstructured meshes, and association betwe...
متن کاملAchieving High Performance with MPI-IO
The I/O access patterns of many parallel applications consist of accesses to a large number of small, noncontiguous pieces of data. If an application's I/O needs are met by making many small, distinct I/O requests, however, the I/O performance degrades drastically. To avoid this problem, MPI-IO allows users to access noncontiguous data with a single I/O function call, unlike in Unix I/O. In thi...
متن کاملFalcon: Scaling IO Performance in Multi-SSD Volumes
With the high throughput offered by solid-state drives (SSDs), multi-SSD volumes have become an attractive storage solution for big data applications. Unfortunately, the IO stack in current operating systems imposes a number of volume-level limitations, such as pervolume based IO processing in the block layer, single flush thread per volume for buffer cache management, locks for parallel IOs on...
متن کامل