Only Aggressive Elephants are Fast Elephants

نویسندگان

  • Jens Dittrich
  • Jorge-Arnulfo Quiané-Ruiz
  • Stefan Richter
  • Stefan Schuh
  • Alekh Jindal
  • Jörg Schad
چکیده

Yellow elephants are slow. A major reason is that they consume their inputs entirely before responding to an elephant rider’s orders. Some clever riders have trained their yellow elephants to only consume parts of the inputs before responding. However, the teaching time to make an elephant do that is high. So high that the teaching lessons often do not pay off. We take a different approach. We make elephants aggressive; only this will make them very fast. We propose HAIL (Hadoop Aggressive Indexing Library), an enhancement of HDFS and Hadoop MapReduce that dramatically improves runtimes of several classes of MapReduce jobs. HAIL changes the upload pipeline of HDFS in order to create different clustered indexes on each data block replica. An interesting feature of HAIL is that we typically create a win-win situation: we improve both data upload to HDFS and the runtime of the actual Hadoop MapReduce job. In terms of data upload, HAIL improves over HDFS by up to 60% with the default replication factor of three. In terms of query execution, we demonstrate that HAIL runs up to 68x faster than Hadoop. In our experiments, we use six clusters including physical and EC2 clusters of up to 100 nodes. A series of scalability experiments also demonstrates the superiority of HAIL.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Wild Asian elephants distinguish aggressive tiger and leopard growls according to perceived danger.

Prey species exhibit antipredator behaviours such as alertness, aggression and flight, among others, in response to predators. The nature of this response is variable, with animals reacting more strongly in situations of increased vulnerability. Our research described here is the first formal study to investigate night-time antipredator behaviour in any species of elephants, Asian or African. W...

متن کامل

Elephants avoid costly mountaineering

Understanding the behavioural decisions underlying animal movements is a major challenge. Here we report evidence for the importance of the abiotic terrain feature 'gradient' in guiding the movements of African savannah elephants (Loxodonta africana). Global Positioning System (GPS) tracking data overlaid onto digital elevation and surface gradient models show that elephants tend to avoid steep...

متن کامل

Longitudinal study of Asian elephants, Elephas maximus, indicates intermittent shedding of elephant endotheliotropic herpesvirus 1 during pregnancy

INTRODUCTION EEHV-1 is a viral infection of elephants that has been associated with a fatal haemorrhagic syndrome in Asian elephants. Previous studies have suggested that pregnant animals may shed more virus than non-pregnant animals. METHODS This study examined whether pregnancy affected the frequency or magnitude of shedding of elephant endotheliotropic herpesvirus 1 (EEHV1) using Taq man r...

متن کامل

Why Elephants Gallop: Assessing and Predicting Organizational Performance in Federal Agencies

'In a recent article published in this journal, the authors argued that elephants and public organizations have something in common. Both are saddled with inaccurate stereotypes. Elephants are believed to be slow and insensitive creatures, when in fact they can run very fast and are very sensitive. Similarly, public organizations are believed to be low-performing and unresponsive, when in fact ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • PVLDB

دوره 5  شماره 

صفحات  -

تاریخ انتشار 2012