Cheap and Easy Parallelism for Matlab on Linux Clusters

نویسندگان

  • Simon D. Levy
  • Peter L. Djalaliev
  • Jitendra M. Shrestha
  • Alexandr Khasymski
  • Christopher D. Connors
چکیده

Matlab is the most popular platform for rapid prototyping and development of scientific and engineering applications. A typical university computing lab will have Matlab installed on a set of networked Linux workstations. With the growing availability of distributed computing networks, many third-party software libraries have been developed to support parallel execution of Matlab programs in such a setting. These libraries typically run on top of a message-passing library, which can lead to a variety of complications and difficulties. One alternative, a distributed-computing toolkit from the makers of Matlab, is prohibitively expensive for many users. As a third alternative, we present PECON, a very small, easy-to-use Matlab class library that simplifies the task of parallelizing existing Matlab programs. PECON exploits Matlab’s built-in Java Virtual Machine to pass data structures between a central client and several “compute servers” using sockets, thereby avoiding reliance on lower-level messagepassing software or disk i/o. PECON is free, open-source software than runs ”out of the box” without any additional installation or modification of system parameters. This arrangement makes it trivial to parallelize and run existing applications in which time is mainly spent on computing results from small amounts of data. We show how using PECON for one such application – a genetic algorithm for evolving cellular automata – leads to linear reduction in execution time. Finally, we show an application – computing the Mandelbrot set – in which element-wise matrix computations can be performed in parallel, resulting in dramatic speedup.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

The Utility Coprocessor: Massively Parallel Computation from the Coffee Shop

UCop, the “utility coprocessor,” is middleware that makes it cheap and easy to achieve dramatic speedups of parallelizable, CPU-bound desktop applications using utility computing clusters in the cloud. To make UCop performant, we introduced techniques to overcome the low available bandwidth and high latency typical of the networks that separate users’ desktops from a utility computing service. ...

متن کامل

Linux FAST Summit ' 14 / NCSR Demokritos project proposal

High-performance data centers have been aggressively moving toward parallel technologies like clustered computing and multi-core processors. While this increased use of parallelism overcomes the vast majority of computational bottlenecks, it shifts the performance bottlenecks to the storage I/O system. To ensure that compute clusters deliver the maximum performance, storage systems must be opti...

متن کامل

Cheap cycles from the desktop to the dedicated cluster: combining opportunistic and dedicated scheduling with Condor

Clusters of commodity PC hardware running Linux are becoming widely used as computational resources. Most software for controlling clusters relies on dedicated scheduling algorithms. These algorithms assume the constant availability of resources to compute fixed schedules. Unfortunately, due to hardware and software failures, dedicated resources are not always available over the long-term. More...

متن کامل

Multi-View 3D Geometry Reconstruction: Exploiting Massive Parallelism

3D geometric reconstruction from digital images captured from consumer cameras is an inexpensive, but computationally demanding application. In this experimental study, we have explored parallelism in the best known public domain software (Bundler and PMVS2) and found that massive parallelism exists at various levels that can be exploited on various computer architectures (such as multi-cores, ...

متن کامل

Parallel MPI implementation of training algorithms for medium-size feedforward neural networks

Artificial neural networks provide a feasible approach to model complex engineering systems. Computational parallelism is assumed as a basis of the neural architectures. In the Russian Federal Nuclear Center VNIITF there exists a neural simulator Nimfa. In the framework of this project parallel versions of training algorithms for feed-forward neural networks based on the MPI standard are develo...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2005