10 Observations on Google Cluster Trace + 2 Measures for Cluster Utilization Enhancement
نویسندگان
چکیده
Utilization enhancement is a key concern to cluster owners. Google’s cluster manager named Borg manages its clusters at an overall utilization higher than many others’ clusters. Recently, Google has disclosed the details of its powerful cluster manager Borg. Quite a few lessons are summarized from the Borg experiences. Nevertheless, we find that more can be learned if the Borg design is correlated with the trace analysis of a Google cluster managed by Borg. There is one such trace released four years ago. In this paper, we analyze the Google cluster trace and make 10 observations not found in previous analyses. We also correlates the results of our analysis and previous analyses to the Borg design, such that we find two measures that can possibly further improve cluster utilization over Borg.
منابع مشابه
Towards understanding heterogeneous clouds at scale: Google trace analysis
With the emergence of large, heterogeneous, shared computing clusters, their efficient use by mixed distributed workloads and tenants remains an important challenge. Unfortunately, little data has been available about such workloads and clusters. This paper analyzes a recent Google release of scheduler request and utilization data across a large (12500+) general-purpose compute cluster over 29 ...
متن کاملGame Theory based Energy Efficient Hybrid MAC Protocol for Lifetime Enhancement of Wireless Sensor Network
Wireless Sensor Networks (WSNs) comprising of tiny, power-constrained nodes are getting very popular due to their potential uses in wide applications like monitoring of environmental conditions, various military and civilian applications. The critical issue in the node is energy consumption since it is operated using battery, therefore its lifetime should be maximized for effective utilization ...
متن کاملFirmament: Fast, Centralized Cluster Scheduling at Scale
Centralized datacenter schedulers can make high-quality placement decisions when scheduling tasks in a cluster. Today, however, high-quality placements come at the cost of high latency at scale, which degrades response time for interactive tasks and reduces cluster utilization. This paper describes Firmament, a centralized scheduler that scales to over ten thousand machines at subsecond placeme...
متن کاملConcentrations and solubility of trace elements in fine particles at a mountain site, southern China: regional sources and cloud processing
The concentrations and solubility of twelve trace elements in PM2.5 at Mt. Lushan, southern China, were investigated during the summer of 2011 and the spring of 2012. The average PM2.5 mass was 55.2± 20.1 μg m −3 during the observation period. Temporal variations of all trace elements including total and water-soluble fractions with several dust storm spikes in total fractions of Al and Fe were...
متن کاملTemporal Specification Mining for Anomaly Analysis
We investigate how to use specification mining techniques for program anomaly analysis. We assume the input of positive traces (without execution anomalies) and negative traces (with execution anomalies). We then partition the traces into the following clusters: a positive cluster that contains all positive traces and some negative clusters according to the characteristics of trace anomalies. W...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- CoRR
دوره abs/1508.02111 شماره
صفحات -
تاریخ انتشار 2015