Shortest Path Evaluation for Hierarchial Grain Aggregation

This paper presents techniques for analyzing the data dependence structure of a program to determine an efficient task “grain” structure for parallel execution. A graph parsing technique is used to detect potential parallelism in a directed acyclic graph (DAG). The parse identifies graph components which are linear, independent, and primitive. Linear components must be executed serially, while independent components may be executed in parallel. Primitive components have no specific directives for parallelization or linearization. The primary contribution of this paper is a new technique for further decomposition of primitive structures. The new technique allows the parse to discover linear and independent components contained inside primitive components. The second contribution is an efficient scheduling algorithm which is systematic and flexible. The algorithm exploits the parallelism in a DAG based on its parse tree by modeling the parallelization/aggregation decisions with a multistage decision graph and then finding the shortest path of the decision graph. The enhanced technique is illustrated by its application to the DAG for the Cooley-Tukey Fast Fourier Transform [5]. Index Terms -automatic parallelization, fast fouier transform, grain size, graph decomposition, partitioning, scheduling, shortest path, .