Stack Overflow
Stack Overflow

Questions tagged [flink-cep]

FlinkCEP - complex event processing for Apache Flink

368 questions
0
votes
1 answer

If we pass a function, which returns Boolean, into where clause of Flink CEP will it work in distributed manner?

I was using Flink CEP module and wondering if I pass a function to where clause, which would be returning Boolean, whether it will work in distributed manner or not. Example-: val pattern=…
Anish Sarangi
  • 172
  • 1
  • 14
0
votes
0 answers

Flink Kafka Consumer Ignores New GroupId when restored from Checkpoint

Requirement - Consume only latest messages from the topic on Manual Restart or Unexpected Failure When a Flink job fails and restarted, the job starts with restored checkpoint and this is trying to process the records from Kafka stored in the state.…
Raghavendar
  • 159
  • 1
  • 11
0
votes
0 answers

Flink CEP - timeout and Dynamic Patterns

Is there a way to achieve the following with Flink CEP Continue matching pattern of all events have not arrived within time. For example A -> B -> C are supposed to match within 20 seconds, and only event A has arrived, right now I see timeout…
basu76
  • 441
  • 10
  • 19
0
votes
1 answer

flink count distinct issue

Now we use tumbling window to count distinct. The issue we have is if we extend our tumbling window from day to month, We can't have the number as of now distinct count. That means if we set the tumbling window as 1 month, the number we get is from…
Jeff
  • 117
  • 10
0
votes
1 answer

What is the difference between Flink Core and Flink CEP in respect of their capabilities?

While studying Flink CEP library over the last few days, I've been under the impression that It doesn't add any new fundamental functionality to Flink's standard capabilities. It seems like Flink CEP's only purpose is to make event processing…
João Luca
  • 19
  • 1
  • 8
0
votes
1 answer

Can't apply pattern by key in KeyedStream with Flink CEP

I'm trying to emmit an alert for each 2 occurences of events with same ID. To do this, I'm using keyBy() to apply my operations according to the ID. import java.util.Properties import…
João Luca
  • 19
  • 1
  • 8
0
votes
1 answer

Flink CEP not detecting last Record

My code helps in determining whether a record's amount goes above 25 or not in Flink CEP. Hence when I use process time it matches all the patterns but when I use Event time it doesn't match the last record.…
Anish Sarangi
  • 172
  • 1
  • 14
0
votes
2 answers

Flink CEP not Working in event time but working in Processing Time

When I am using Flink CEP code for processing time (which is by default config) I am able to get the required patter match but while configuring the env to Event Time I am unable to get any pattern match. def main(args: Array[String]): Unit = { …
Anish Sarangi
  • 172
  • 1
  • 14
0
votes
1 answer

how to detect trend e using flink CEP

I am new to Flink CEP. For one of our use cases, we need to implement stream analytics for temperature sensor output. if the temperature keeps on increasing for 30 minutes, need to generate an alert to the operator. I went through the Pattern API…
user997811
  • 63
  • 7
0
votes
1 answer

Flink CEP - raise alert if a sequence didnt arrive within a time irrespective of any other message arrived

I wrote a Flink CEP piece that checks for a pattern of status (keyed by an id) with Relaxed Contiguity (followedBy). The idea is to raise an alert if a particular status did not arrive after the first within a specified time. This works, however if…
vvra
  • 2,832
  • 5
  • 38
  • 82
0
votes
1 answer

Context#currentProcessingTime in Flink CEP

When using Flink CEP Contexts have currentProcessingTime property. Is there a difference between using System.currentTimeMillis() and this method? Here's a small experiment and it seems that these values are mostly equal (at least in this simplistic…
bottaio
  • 4,963
  • 3
  • 19
  • 43
0
votes
1 answer

Flink CEP iterative condition for single pattern in Scala

The problem i am facing is that I am unable to perform a sum on a single CEP pattern in scala. I want to detect when sum is greater than 6100 for a particular customerID. I am providing a keyed stream to the CEP.pattern(...). I have provided my code…
Anish Sarangi
  • 172
  • 1
  • 14
0
votes
1 answer

Applying window based rules in Apache Flink Broadcast stream

I have a set of rules in my BroadcastStream in Apache Flink. I am able to apply new rules as they come to my stream of events. But I am not able to figure out how can I implement if my rules are like rule 1> alert when count of event a is greater…
sky
  • 260
  • 3
  • 12
0
votes
1 answer

Error converting Flink CEP table in Dataset object

I've created an BatchTableEnviroment in Apache Flink and created a Table object where I loaded data in. Now I want to search for some patterns. I'm doing this with the Detecting patterns in Tables CEP library. The task of the query below is to find…
user7432713
  • 197
  • 3
  • 17
0
votes
1 answer

How to complete aggregation task with flink cep

I need to count the number of times in a day that A happens and in 15 minutes that B happens。 The stream maybe A1 ,A2,B1,B2,A3,B3,B4,B5,A4,A5,A6,A7,B6。 In my case the event results are A2,B1 A3,B3 A7,B6。 And I need receive realtime result…
B.king
  • 1
1 2 3
…
24 25