FlinkCEP - complex event processing for Apache Flink
Questions tagged [flink-cep]
368 questions
0
votes
1 answer
Can I use Flink CEP to sort a stream?
I know I can use Flink SQL to sort a stream by timestamp, but as I'm already using CEP, I'd like to use it for sorting instead.
David Anderson
- 39,434
- 4
- 33
- 60
0
votes
1 answer
How do I find the event time difference between consecutive events in Flink?
I want to find the event time difference between every two consecutive input events. If the time difference is above a certain threshold then I want to output an event signalling the threshold has been breached. I also want the first event of the…
Dan
- 5,013
- 5
- 33
- 59
0
votes
1 answer
Flink SQL 1.14 : Match Recognize doesn't support consuming update and delete changes which is produced by node Join(joinType=[InnerJoin])
I have tried to resolve this issue :
Could not execute SQL statement. Reason:
org.apache.flink.table.api.TableException: Match Recognize doesn't support consuming update and delete changes which is produced by node Join(joinType=[InnerJoin],…
FLISS Sabrine
- 11
- 1
0
votes
1 answer
Iterating over list state with millions of records in Flink
I want to store all the CDC records in list state and streams those records to respective sinks once trigger message is received.
The list state can grow up-to a million records, will iteration over the list state in KeyedProcessFunction causes…
Amareswar
- 2,048
- 1
- 20
- 36
0
votes
1 answer
what is the max list state that i can have in flink using rocksdb state backend
Planning to buffer cdc events within flink list state till they are ready to be streamed. What is the max list size that can be supported for a given key?
Amareswar
- 2,048
- 1
- 20
- 36
0
votes
0 answers
how to stop a flink window job over a data stream?
I have a program in which a producer creates events and send them to a Kafka topic. Then, I create a data stream over this topic and a flink sliding window process this data stream. In case the number of events in each window goes below a threshold,…
0
votes
1 answer
Is the description of the "Contiguity within looping patterns " in the document correct?
as the description in flink CEP document:
Strict Contiguity: Expects all matching events to appear strictly one after the other, without any non-matching events in-between.
Relaxed Contiguity: Ignores non-matching events appearing in-between the…
0x822a5b87
- 477
- 1
- 5
- 10
0
votes
1 answer
How to trigger a line of code in window based CEP
I have a stream of events and want to count the number of events in a specific period time to find out event loss.
My code is something similar to the following:
DataStream dataStream =…
0
votes
1 answer
Flink 1.14 : Why can't resotore savepoint got error Caused by: org.apache.flink.runtime.messages.FlinkJobNotFoundException: Could not find Flink job
I'm trying to restore a savepoint which is save to my local tmp folder.However i got below error when i trying to restore it.Do you have any idea about this ?
/home/chinthakasajith/flink-1.14.0$ ./bin/flink run -m 127.0.0.1:28080 --detached…
0
votes
1 answer
Time characteristic in Stateful functions
I understand in general that event time uses Watermarks to make progress in time. In the case of Flink Statefun which is more based on iteration it may be a problem. So my question is if I use the delayed message…
0
votes
2 answers
Unable to update logback configuration in Flink Native Kubernetes
I have created a Flink Native Kubernetes (1.14.2) cluster which is successful. I am trying to update the logback configuration for which I am using the configmap exposed by Flink Native Kubernetes. Flink Native Kubernetes is creating this configmap…
Raghavendar
- 159
- 1
- 11
0
votes
1 answer
When will flink clean up idle state in flink cep sql?
I am using flink cep sql with blink planner.
Here is my sql
select * from test_table match_recognize (
partition by agent_id,room_id,call_type
order by row_time // process time
measures
last(BF.create_time) as create_time,
…
slo
- 23
- 5
0
votes
1 answer
Absence of event in Apache Flink CEP
I'm new at Apache Flink CEP and I'm struggle trying to detect a simple absence of event.
What I'm trying to detect is wheter an event of type CurrencyEvent with a certain id does not occur in certain amount of time. I would like to detect the…
nach0
- 379
- 1
- 3
- 14
0
votes
1 answer
Is it possible with CEP to correlate events with complex patterns?
We have using CEP already to manipulate some events. We have been using patterns from cep to correlate the events and produce meaningful outputs. For example we have the pattern sequence
that a.followedBy b followed by c. So far the events were…
IsidIoan
- 403
- 2
- 5
- 13
0
votes
1 answer
Persist Apache Flink window
I'm trying to use Flink to consume a bounded data from a message queue in a streaming passion. The data will be in the following format:
{"id":-1,"name":"Start"}
{"id":1,"name":"Foo 1"}
{"id":2,"name":"Foo 2"}
{"id":3,"name":"Foo…
Gobinath
- 904
- 1
- 15
- 23