54 Published By: Blue Eyes Intelligence Engineering & Sciences Publication Pvt. Ltd. Abstract—This paper presents Heterogeneous Parallel Computing (HPC), which is a well-orchestrated and co-ordinated effective use of a suite of diverse high performance machines to provide super-speed processing for computationally demanding tasks with diverse computational needs. GPUs are accoutered with a much...

The properties of a parallel programming model are largely determined by the model of communication/interaction upon which it is based. Parallel programming models, languages and implementations have historically been formulated in terms of shared memory and/or message passing communication models. This paper motivates parallel programming models based on broadcast communication and defines and...

Parallel programming involves nding the potential parallelism in an application and mapping it to the architecture at hand. Since a typical application has more potential parallelism than any single architecture can exploit eeectively, programmers usually limit their focus to the parallelism that the available control constructs express easily and that the given architecture exploits ee-ciently...

In this position paper, we point out the importance of teaching a basic understanding of parallel computations and parallel programming early in computer science education, in order to give students the necessary expertise to cope with future computer architectures that will exhibit an explicitly parallel programming model. We elaborate on a programming model, namely sharedmemory bulk-synchrono...

Programming parallel machines is notoriously diicult. Factors contributing to this diiculty include the complexity of concurrency, the eeect of resource allocation on performance and the current diversity of parallel machine models. The net result is that eeective portability, which depends crucially on the predictability of performance, has been lost. Functional programming languages have been...

This article proposes a novel architectural model which augments the latest developments in automatic program parallelization and distributed systems to achieve a level of practicality as yet unknown to either eld. Today's premier automatic parallelization model is well suited to implementation on a network of commodity workstations (NOW) using only a very thin layer of software support. We des...

For demonstrating the powerfulness of skeletal programming we have developed a parallelization technique toward one class of optimization problems called maximum marking problems, which can be recognized as one class of dynamic programming. This paper, as in the course of an ongoing research, focuses on problems of dynamic programming in general, and examines how the skeletal approach successfu...

This paper discusses future directions in tools and techniques for programming parallel supercomputers We base the discussion on two important observations Automatic parallelization of sequential programs will not achieve supercomputer performance in re al applications Instead applications will have to be written with explicit parallelism Machine independence of parallel programs is a precondit...