Download Managing Event Processing Networks
Transcript
computing). Often the context of events is relevant: The reason why a message got lost may be that a required pathway was no longer existent when the message was sent. • Dynamic causal models are one form of event processing. Events in event streams are automatically processed to include genetic information indicating which other events had to happen in order for them to happen. The genetic data in an event allows the events in its causal ancestry to be immediately uncovered by other EPAs, making their operation more efficient and accurate. Causal information must be recognized across multiple event streams. Extracting and developing accurate causal models for C2 environments is another research issue. • Flexibility: CEP queries are flexible and configurable at runtime so the user can rapidly adjust them if needed. This includes starting a new query against an ongoing event stream, that either considers only new events, only old events, or both. • Efficiency: Many applications produce relevant events at rates of millions/minute. CEP supports high event rates through query optimization, efficient pattern matching algorithms, as well as distribution of event processing. CEP supporting these two features is part of Stanford University's RAPIDE project. We developed an extensive set of tools that supports logging, mining, storing, and viewing of events in real-time. RAPIDE events are related by time and cause. Each relations builds a partial order on all the events. A formal pattern language [3] supports the construction of filters and maps, constructs that aggregate simple events to complex events on a higher level of abstraction [4]. The same process can be used to query complex events, thus building a more and more abstract view of the system. B. Event Processing Networks In order to accurately reflect the complex nature of real computing environments, effective event processing must be component based. A variety of different components need to be able to process a broad spectrum of events from different technologies. We have built Event Processing Networks (EPNs) consisting of any number of Event Processing Agents (EPAs), namely event producers, event processors, and event consumers. Figure 1 shows an overview over the three categories, with thin arrows indicating the (logical) flow of events from producers through processors to consumers. The EPN is supported by an event service. The event service provides repositories for events and event schemas, templates for processors, and a consumer registry. Event Schemas define the format of events forwarded by the event service. The event repository stores events. Processor templates are predefined templates that can be activated to filter, aggregate, or otherwise process events. The consumer registry keeps track of which consumer is interested in which events. 4