Supporting Large-scale Continuous Stream Datacenters via Pub/Sub Middleware and Adaptive Transport Protocols
نویسندگان
چکیده
Large-scale datacenters that handle continuous data streams require scalable and flexible communication infrastructure. The scalability of publish/subscribe (pub/sub) middleware coupled with fine-grained quality-of-service (QoS) support and adaptive transport protocols constitutes a promising area of research to address the challenges of these types of large-scale datacenters. This paper describes how we are integrating pub/sub middleware with an adaptive transport protocol framework to support composable functionality for properties that—coupled with the finegrained QoS middlware support—can meet the required QoS of data conferencing applications that coordinate and manage multiple continuous data streams.
منابع مشابه
Evaluating Transport Protocols for Real-Time Event Stream Processing Middleware and Applications
Real-time event stream processing (RT-ESP) applications must synchronize continuous data streams despite fluctuations in resource availability. Satisfying these needs of RT-ESP applications requires predictable QoS from the underlying publish/subscribe (pub/sub) middleware. If a transport protocol is not capable of meeting the QoS requirements within a dynamic environment, the middleware must b...
متن کاملEvaluating Transport Protocols for Real-time Event Stream Processing Middleware and Applications
Real-time event stream processing (RT-ESP) applications must synchronize continuous data streams, e.g., infrared scans and video monitoring for survivor detection after a natural disaster, despite fluctuations in resource availability. Satisfying these needs of RT-ESP applications requires predictable QoS from the underlying publish/subscribe (pub/sub) middleware. If a transport protocol is not...
متن کاملUsing Machine Learning to Maintain QoS for Large-scale Publish/Subscribe Systems in Dynamic Environments
Quality-of-service (QoS)-enabled publish/subscribe (pub/sub) middleware provides powerful support for large-scale data dissemination. It is hard, however, to maintain specified QoS properties (such as reliability and latency) in dynamic environments (such as disaster relief operations or power grids). For example, managing QoS manually is not feasible in largescale dynamic systems due to (1) sl...
متن کاملMaintaining QoS for Publish/Subscribe Middleware via Autonomic Adaptation
Quality of Service (QoS)-enabled Publish/Subscribe (pub/sub) middleware provides powerful support for data dissemination. It is hard, however, to maintain specified QoS properties (such as reliability and latency) in dynamic environments (such as disaster relief operations or power grids). For example, managing QoS manually is not feasible in dynamic systems due to slow human response times and...
متن کاملIntegrating Machine Learning Techniques to Adapt Protocols for QoS-enabled Distributed Real-time and Embedded Publish/Subscribe Middleware
Quality-of-service (QoS)-enabled publish/subscribe (pub/sub) middleware provides the infrastructure needed to disseminate data predictably, reliably, and scalably in distributed real-time and embedded (DRE) systems. Maintaining QoS properties as the operating environment fluctuates is challenging, however, since the chosen mechanism (e.g., transport protocol or caching algorithm for data persis...
متن کامل