Runtime Analysis of Distributed Data Processing Programs
نویسندگان
چکیده
Debugging massively parallel data analysis programs is currently a difficult process. Traditional debug cycles involve manual code instrumentations, re-execution and analysis of the resulting data. This is expensive in terms of development time, execution time, amount of data produced, and cognitive overhead. This work proposes a course of research that is meant to alleviate this situation by automating the code instrumentation and by lowering the re-execution time of instrumented code. By using these techniques, we hope to achieve a higher efficiency compared to manual debugging approaches.
منابع مشابه
Analysis of Tall Buildings with Bundled Tube System Subjected to Wind and Earthquake loads
At present, the tubular structural systems are mainly used in tall buildings to withstand earthquake loads. Although it is possible to analyse the structure by finite element methods using standard three dimensional programs, the system is generally time-consuming and expensive in the primary design work. In this paper, for the analysis of Framed-Tube systems, a simple method was studied and de...
متن کاملAnalysis of Tall Buildings with Bundled Tube System Subjected to Wind and Earthquake loads
At present, the tubular structural systems are mainly used in tall buildings to withstand earthquake loads. Although it is possible to analyse the structure by finite element methods using standard three dimensional programs, the system is generally time-consuming and expensive in the primary design work. In this paper, for the analysis of Framed-Tube systems, a simple method was studied and de...
متن کاملCompiling Sequential Programs for Speculative Parallelism
We present a runtime system and a parallelizing compiler for exploiting speculative parallelism in sequential programs. In speculative executions, the computation consists of tasks which may start before their data or control dependencies are resolved; dependency violation is detected and corrected at runtime. Our runtime system provides a shared memory abstraction and ensures that shared acces...
متن کاملLanguage Runtime and Optimizations in IBM Streams
Stream processing is important for continuously transforming and analyzing the deluge of data that has revolutionized our world. Given the diversity of application domains, streaming applications must be both easy to write and performant. Both goals can be accomplished by high-level programming languages. Dedicated language syntax helps express stream programs clearly and concisely, whereas the...
متن کاملGo-faster Haskell Or: Data-intensive Programming in Parallel Haskell Draft
We have recently constructed an integrated programming environment to support programming in Glasgow Parallel Haskell GpH. This paper descibes the construction of several data-intensive parallel programs using the environment. It focuses on a road-traac accident application because it is a real problem with real data, and is the rst non-trivial GpH program to achieve wall-clock speedups | a fac...
متن کامل