Towards Flexible Event Processing in Distributed Data Streams
نویسندگان
چکیده
The FERARI project aims to develop a highly scalable distributed streaming architecture supporting complex event processing in a communication-efficient manner. Two key requirements for our system are that its architecture is not tied to the underlying streaming platform used in its implementation and that it allows the easy definition of communication-efficient methods for monitoring a global condition over a distributed set of states. In this paper we present the architecture of our system and explain how these key requirements are met. Concerning the actual implementation of our system in a scalable distributed streaming platform, it is reasonable not to re-invent the wheel but to use one of the actual Big Data Streaming platforms as a starting point. For this reason, we evaluate some popular platforms and discuss whether they meet our requirements.
منابع مشابه
Towards a REST-ful Visualization of Complex Event Streams and Patterns
This paper presents a scalable architecture for visualization of complex events, event hierarchies and relations. The goal is to support flexible, multi-level, multidimentional visualization of primitive and composite events to aid faster decision making. Our approach is to apply the concept of Representational State Transfer (REST) that focusses on design of large scale distributed systems. Di...
متن کاملDynamic Low-Latency Distributed Event Processing of Sensor Data Streams
Event-based systems (EBS) are used to detect meaningful events with low latency in surveillance, sports, finances, etc. However, with rising data and event rates and with correlations among these events, processing can no longer be sequential but it needs to be distributed. However, naively distributing existing approaches not only cause failures as their order-less processing of events cannot ...
متن کاملComplex Event Processing over Distributed Uncertain Event Streams
In the 21st century, as technologies of perceptual recognition develops, devices of information generation begin to accurately sense, measure and monitor the physical world in real time.Complex Event Processing(CEP), which can be used to extract user level information from raw data, becomes the key part of the IoT middleware. Most of the current study of complex event processing has not focus o...
متن کاملDIONYSUS: Towards Query-aware Distributed Processing of RDF Graph Streams
Arguably, the most significant obstacle to handle the emerging application’s data deluge is to design a system that addresses the challenges for big data’s volume, velocity and variety. Work in RDF stream processing (RSP) systems partly addresses the challenge of variety by promoting the RDF model. However, challenges like volume, velocity are overlooked by existing approaches. These challenges...
متن کاملAn XML Framework for Integrating Continuous Queries, Composite Event Detection, and Database Condition Monitoring for Multiple Data Streams
Current, data-driven applications have become more dynamic in nature, with the need to respond to events generated from distributed sources or to react to information extracted from incoming data streams. Event processing and stream processing have traditionally developed as two separate areas of research. Event processing has its roots in research with active rule processing (Widom and Ceri, 1...
متن کامل