We introduce SparkCL, an open source unified programming framework based on Java, OpenCL and the Apache Spark framework. The motivation behind this work is to bring unconventional compute cores such as FPGAs/GPUs/APUs/DSPs and future core types into mainstream programming use. The framework allows equal treatment of different computing devices under the Spark framework and introduces the abilit...

Apache Spark is a popular framework for data analytics with attractive features such as fault tolerance and interoperability with the Hadoop ecosystem. Unfortunately, many analytics operations in Spark are an order of magnitude or more slower compared to native implementations written with high performance computing tools such as MPI. There is a need to bridge the performance gap while retainin...

Spark is gaining wide industry adoption due to its superior performance, simple interfaces, and a rich library for analysis and calculation. Like many projects in the big data ecosystem, Spark runs on the Java Virtual Machine (JVM). Because Spark can store large amounts of data in memory, it has a major reliance on Java’s memory management and garbage collection (GC). New initiatives like Proje...

Due to the difficulty directly study ammonia, present work investigated engine performance of lean iso-octane/air mixture approximate ammonia combustion behaviour. The was conducted using a single cylinder modified diesel that features spark plug and glow in sub-chamber. investigations varied speeds (1000 1500 RPM), voltages (6 10 volts), excess air ratios (1.4 1.8), ignition timings (-2 -5 °BT...

MapReduce and Spark are two very popular open source cluster computing frameworks for large scale data analytics. These frameworks hide the complexity of task parallelism and fault-tolerance, by exposing a simple programming API to users. In this paper, we evaluate the major architectural components in MapReduce and Spark frameworks including: shuffle, execution model, and caching, by using a s...

.........................................................................................................................3 INTRODUCTION ................................................................................................................5 DIESEL ENGINE TECHNOLOGY AND EMISSION REGULATIONS .............................7 PHYSICAL AND CHEMICAL NATURE OF DIESEL AEROSOL ......................

During the 2015-2016 academic year, I conducted research about Spark, BlinkDB and various sampling techniques. This research helped the team have a better understanding of the capabilities and properties of Spark, BlinkDB system and different sampling technologies. Additionally, I benchmarked and implemented various Machine learning and sampling methods on the top of both Spark and BlinkDB. The...

Apache Spark has become a key platform for Big Data Analytics, yet it lacks complete support for debugging analytics programs. As a result, the development of a new analytical toolkit can be a painstakingly long process [7, 2, 4]. To fill this gap, we are developing Spark-BDD (Big Data Debugger), which brings a traditional interactive debugger experience to the Spark platform. Analytic programm...

In the mid 1980s the monolithic nature of building energy simulation programs led to proposals for development of so-called "kernel systems," i.e., software environments that would make available to developers basic software modules and a supporting framework that could be used to construct new building simulation software. One of the outcomes of the ensuing work was the Simulation Problem Anal...