Stack Overflow
Stack Overflow

Questions tagged [flink-cep]

FlinkCEP - complex event processing for Apache Flink

368 questions
0
votes
2 answers

Is there a way to broadcast a message into all task managers

i wonder if there is a way in flink to broadcast an event (or something like that) if specific event read from the source into all the task managers. To be more specific I am aggregating state data with a map state and if some events are read from…
uri go
  • 105
  • 5
0
votes
1 answer

getting error while using table(Data stream) in flink

I'm using flink 1.9.0 and I'm unable to import or get table files I've tried importing different SBTs related to it def main(args: Array[String]): Unit = { val env = StreamExecutionEnvironment.getExecutionEnvironment val tEnv =…
ASK5
  • 55
  • 11
0
votes
1 answer

How can i share state between my flink jobs?

I run multiple job from my .jar file. i want share state between my jobs. but all inputs consumes(from kafka) in every job and generate duplicate output. i see my flink panel. all of jobs 'record sents' is 3. i think must split number to my jobs. I…
Mohammad Hossein Gerami
  • 1,360
  • 1
  • 10
  • 26
0
votes
1 answer

How can i detect pattern a+b+ with Flink CEP

Flink CEP not working for my pattern. I have a sequence for example aabbbbaaaabbabb(a+b+). I want the function process show output like this: {aabbbb} {aaaabb} {abb} AfterMatchSkipStrategy skipStrategy =…
Mohammad Hossein Gerami
  • 1,360
  • 1
  • 10
  • 26
0
votes
0 answers

Flink SQL Match_Recognize giving incomplete results

I have the following data given to Flink as a stream ID Val eventTime.rowtime 266 25 9000 266 22 10000 266 19 11000 266 18 12000 266 16 13000 266 15 14000 266 14 15000 266 13 16000 266 14 17000 266 15 18000 266 17 19000 266 18 20000 266…
Ahmed Awad
  • 95
  • 8
0
votes
0 answers

how can i flink configuration problems

I'm trying to create a cep program that is able to detect when a user's salary change.so i wrote this code Pattern .begin("First Event").subtype(comptedata.class).where( new SimpleCondition() { …
yousf
  • 191
  • 1
  • 1
  • 4
0
votes
1 answer

Flink Task Manager Status When Application Crashes

What happens when there is an Exception thrown from the jar application to the Task Manager while processing an event? a) Flink Job Manager will kill the existing task manager and create a new task manager? b) Task manager itself recovers from the…
tom
  • 3,720
  • 5
  • 26
  • 48
0
votes
1 answer

Generate CEP event if found same data 5 times within 5 second in Apache flink

I have a requirement to generate CEP event if we found string message starts with character 'a' continuously 5 times within 5 second. For that i have written a class CEPCharEventPublisher.java which will publish the string message (as below…
Prashant Sahoo
  • 979
  • 16
  • 19
0
votes
1 answer

FLINK CEP (Java 8) - persistent "identity" through matching pattern

I am trying to use FLINK-CEP for measuring the time a Bid in a market takes from having BidState.OPEN to BidState.Closed. I am recieving a DataStream of Bids with ID's and states, and as it stands I am matching all "OPENED" bids with all "CLOSED"…
Mats
  • 165
  • 1
  • 3
  • 14
0
votes
0 answers

flink how to combine two windows?

I have a stream - I want to compare number of events in the current window with the previous window. It can be done by keeping the number of events in the window in globalState and doing something link : class Foo [I,O] extends…
igx
  • 4,101
  • 11
  • 43
  • 88
0
votes
1 answer

Create SQL Table from a DataStream in a Java/Scala program and query it from SQL Client CLI - Apache Flink

Is it possible interact with a table using Flink SQL client CLI where which table was created within a Scala/Java program running in the cluster?
salc2
  • 577
  • 5
  • 14
0
votes
2 answers

Flink how to not save state for operator?

I have checkpointing setup in my Flink job, and it has 2 sliding windows (these arent joins) and 1 tumbling window join. The idea is that I don't really need to save the state for the join itself as saving the state for the 2 sliding windows itself…
flinktestingsf
  • 1
  • 1
0
votes
1 answer

FlinkCEP: Can I reference an earlier event to define a subsequent match?

Here is a simple example: val pattern = Pattern.begin[Event]("start").where(_.getId == 42). next("middle").subtype(classOf[SubEvent]).where(x => x.getVolume == **first event matched**.getVolume) ... Essentially the second event ("middle")…
marios
  • 8,874
  • 3
  • 38
  • 62
0
votes
2 answers

Context Timestamp in DataStream created by Window operation

Let us say I have a inputStream and I perform some window operation on it. What is the timestamp for the event created by performing some window operation on it. .... DataStream inputStream = // ... DataStream countStream =…
Prannay Khosla
  • 13
  • 1
  • 5
0
votes
1 answer

What is the paper that the FlinkCep implementation based on?

I need to know the if there is/are paper(s) behind the implementation of FlinkCEP. If there, then what are they?
ahmadi
  • 17
  • 7
1 2 3
…
24 25