Questions tagged [flink-cep]

FlinkCEP - complex event processing for Apache Flink

368 questions
0
votes
1 answer

flinkCEP query to database within select() function or SimpleCondition/IterativeCondition

Using a JDB connector I make queries to a PostgreSQL database and process the results. This works fine! BUT, when I try to query within a PatternFlatSelectFunction, in order the query results to be the condition on which I collect the new events, I…
alex
  • 31
  • 8
0
votes
1 answer

Flink - behaviour of timesOrMore

I want to find pattern of events that follow Inner pattern is: Have the same value for key "sensorArea". Have different value for key "customerId". Are within 5 seconds from each other. And this pattern needs to Emit "alert" only if previous…
0
votes
1 answer

Flink CEP and events order

I am new to Flink and Flink CEP. When working with Event Time, does Flink CEP iterates the events to check patterns in ascending (event-)time order or not? Thanks in advance!
alex
  • 31
  • 8
0
votes
1 answer

Flink pattern getting issue with Arralist in alert code?

I followed this example and implemented with kafka json same sample data. consumer sample data {"temperature" : 28,"machineName":"xyz"} DataStream patternStream = CEP.pattern(inputEventStream, warningPattern) .flatSelect(new…
Nathon
  • 21
  • 7
0
votes
0 answers

How to apply conditions on Flink events?

I have implemented this Flink Kafka - Custom Class Data is always null. I gone thru the above link and implemented the same but how to apply condition on the events. Pattern eventspattern = Pattern. begin("first") …
Nathon
  • 21
  • 7
0
votes
1 answer

How can I manually replay a tuple from a function in Apache Flink in case of run time exception?

In storm we execute collector.fail(tuple) to replay the tuple. What is the similar approach in Flink?
Raghavendar
  • 159
  • 1
  • 11
0
votes
1 answer

Flink CEP PojoSerializer wrong polymorphism resolution

Currently I have a really weird behavior when I'm printing the results of the CEP pattern. The data model as follows: Event: (type:String, timestamp:Long) VehicleRelated extends Event: (vehicleId:Integer) Position extends VehicleRelated:…
Daniel Eisenreich
  • 1,353
  • 3
  • 16
  • 32
0
votes
1 answer

Add Savepoint to Datastream

I have a kafka source from which my flink application reads data and process it, i want to add flink's savepoint mechanism in order to resume the process from last where it was left, Instead of adding savepoint to the kafka source i want my…
Ahmad Qureshi
  • 186
  • 4
  • 16
0
votes
1 answer

Apache Flink CEP pattern of multiple event types

Currently I'm working on a semester project where I have to recognize the series of three Events. Like P -> R -> P We have two different event types which are consumed via a Kafka connector in the same topic. I created a parent class called Event…
0
votes
1 answer

How to write Junit test code for Flink CEP with Kafka consumer

We have a execute() method where we use FlinkKafkaConsumer08 as our Flink CEP source, then we have CEP pattern and alert is again going in another kafka topic. How can I write a junit test case for this execute() method? Can anyone please provide me…
0
votes
0 answers

Bypass Flink CEP Buffer in an EventTime Streaming Environment

I have an EventTime streaming application that uses the CEP library for a basic three-step pattern on a joined stream. The joined stream is a combination of live, watermarked, and windowed data and a stream of historical items outside of the…
austin_ce
  • 1,063
  • 15
  • 28
0
votes
1 answer

Flink - event-time sliding window with missing data in window due to time gaps

Suppose I have a stream of stock market trading events, like this: technical1, ALXN, 1/1/2016 technical1, CELG, 1/1/2016 technical2, ALXN, 1/2/2016 technical2, CELG, 1/2/2016 . . . technicalN, ALXN, 4/1/2018 technicalN, CELG, 4/1/2018 such that…
devinbost
  • 4,658
  • 2
  • 44
  • 57
0
votes
1 answer

How to create batch or slide windows using Flink CEP?

I'm just starting with Flink CEP and I come from Esper CEP engine. As you may (or not) know, in Esper using their syntax (EPL) you can create a batch or slide window easily, grouping the events in those windows and allowing you to use this events…
David Corral
  • 4,085
  • 3
  • 26
  • 34
0
votes
0 answers

AfterMatchSkipStrategy in FlinkCEP not getting applied

I'm trying to apply AfterMatchSkipStrategy skipPastLastEvent() into my pattern. But the problem is that i'm getting the same results as of the case when I don't apply the skipstrategy (NoSkip). Discards every partial match that started after the…
skrshn
  • 35
  • 1
  • 1
  • 5
0
votes
1 answer

Creating CEP with Apache Flink

I'm trying to implement a very simple Apache Flink CEP for a Kafka InputStream. The Kafka Producer generates a simple Double Value and send them via a Kafka Topic as String towards the Consumers. At the moment i'm coding a CEP Consumer with…
Leon
  • 371
  • 4
  • 11