FlinkCEP - complex event processing for Apache Flink
Questions tagged [flink-cep]
368 questions
0
votes
1 answer
Flink CEP: java.lang.NoSuchMethodError
flink run /home/admin/Documents/flink_cep/Flink-master/dist/Kinesis.jar
When I am trying to run Jar file in command line, getting error but my code is running fine in Netbeans IDE:
Avinash
- 485
- 1
- 7
- 15
0
votes
1 answer
Complex event processing for log files source
I would want to process log files like CEP (Complex Event Processing), but CEP is intended to use streams, not log files as source.
Are there exist CEP like tools for log files (batch data with timestamps) source ?
Or should i convert my log files…
Eras Rasmuson
- 11
- 1
- 5
0
votes
1 answer
flink SourceFunction<> is being replaced in StreamExecutionEnvironment.addSource()?
I ran into this problem when I was trying to create a custom source of event. Which contains a queue that allow my other process to add items into it. Then expect my CEP pattern to print some debug messages when there is a match.
But there is no…
Maxi Wu
- 1,274
- 3
- 20
- 38
0
votes
1 answer
how to add new event to flink CEP data stream?
I am using flink 1.5.2 to solve a CEP problem.
my data is from a List, some other process will add new Event object to that list while system is running. It is not socket or network message. I've been reading the official site example. Here are the…
Maxi Wu
- 1,274
- 3
- 20
- 38
0
votes
1 answer
Facing Race Condition In Flink connected Stream in apache flink
Facing a Race Condition while implementing process function in flink
connected streams. I am having Cache Map that is being shared between two
functions processElement1 & processElement2 that is being called parallelly
by 2 different threads.…
puneet kinra
- 1
- 2
0
votes
1 answer
Apache Flink 1.3.2 connectivity issue with Kafka 1.1.0
I'm using a cluster of Apache Flink 1.3.2. We're consuming Kafka messages and since upgrading the broker to 1.1.0 (from 0.10.2) we noticed this error in the log frequently:
ERROR o.a.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase - Async…
razvan
- 559
- 7
- 23
0
votes
1 answer
Apache Flink 1.4.2 akka.actor.ActorNotFound
After upgrading to Apache Flink 1.4.2 we get following errors every few seconds on one TaskManager out of 3.
2018-06-27 17:33:46.632 [jobmanager-future-thread-2] DEBUG o.a.flink.runtime.rest.handler.legacy.metrics.MetricFetcher - Could not…
razvan
- 559
- 7
- 23
0
votes
2 answers
Combining Results from different Flink Jobs
I have 3 jobs that read from the same input stream.
Each gives a different output
How do I combine the results from different Jobs
and create a single JSON string
Example: {"key":"input_msg", "result_1":"job1_result",...}
I am hoping to avoid…
Sub Zero
- 69
- 11
0
votes
1 answer
Why the result of Relaxed Contiguity doesn't includes the result of Strict Contiguity?
From the official document for Flink CEP, we see that the result of Relaxed Contiguity doesn't includes the result of Strict Contiguity "{a2 b}", however it contains the result "{a1 b}" , in my understanding the result of Relaxed Contiguity should…
YuFeng Shen
- 1,475
- 1
- 17
- 41
0
votes
1 answer
Why the time between ingestion time of last matched event and time of CEP match and fire the pattern are so long?
I write a very sample CEP Pattern, which just match three sequence latters 'abc',however even for so such simple pattern , it took Flink(test both for 1.5 and 1.4.2) almost 1 seconds(sometimes around 0.5 second) between the ingestion time of last…
YuFeng Shen
- 1,475
- 1
- 17
- 41
0
votes
2 answers
What does it mean that "broadcast state" unblocks the implementation of the “dynamic patterns” feature for Flink’s CEP library?
From the Flink 1.5 release announcement, we know Flink now supports "broadcast state", and it was described that "broadcast state unblocks the implementation of the “dynamic patterns” feature for Flink’s CEP library.".
Does it means currently we can…
YuFeng Shen
- 1,475
- 1
- 17
- 41
0
votes
1 answer
how to make a stream of Map[String, Any] using flink
let's assume that we have this json
{
"Account Informations": {
"User Info": {
"User Name": "Albert Goldstein",
"Date": "03/27/2015 08:35:11",
"Location": "New York, USA"
},
"User": {
"Email":…
TheEliteOne
- 105
- 1
- 11
0
votes
1 answer
Apache Flink how to sink from Java ObjectNode -> JSON string?
So this takes in JSON strings -> Java ObjectNode.
final DataStream inputStream = env
.addSource(new RMQSource(
connectionConfig, // config for the RabbitMQ connection
…
atkayla
- 8,143
- 17
- 72
- 132
0
votes
3 answers
How to report a value in real time in Fink?
I want three values, they are aggValueInLastHour aggValueInLastDay aggValueInLastThreeDay.
I've tried like below.
But I don't want to wait, means that I'm not prefer to use sliding window to do aggregation.(3 day window must wait three days' data,…
Brutal_JL
- 2,839
- 2
- 21
- 27
0
votes
1 answer
Flink CEP unable to detect pattern when parallelism > 1
I have a simple program using flink CEP library to detect multiple failed login from a file of log records. My application uses Event time and I am doing a keyBy on the logged in 'user'.
The program works fine when I set the…
Debajyoti Pathak
- 104
- 6