Stack Overflow
Stack Overflow

Questions tagged [flink-cep]

FlinkCEP - complex event processing for Apache Flink

368 questions
1
vote
1 answer

Dynamic Pattern Evaluation using Apache Flink

I am newbie to Apache Flink i am trying dynamic evaluation of patterns in a stream using flink CEP. I am trying find the users who performed the following action login,addtocart and logout and its able to detect the pattern but if i am defining…
YRK
  • 153
  • 1
  • 1
  • 22
1
vote
1 answer

Apache Flink - duplicate message processing during job deployments, with ActiveMQ as source

Given, I have a Flink job that reads from ActiveMQ source & writes to a mysql database - keyed on an identifier. I have enabled checkpoints for this job every one second. I point the checkpoints to a Minio instance, I verified the checkpoints are…
vvra
  • 2,832
  • 5
  • 38
  • 82
1
vote
2 answers

What are the ways to access the flink state from outside the flink cluster?

I am new to Apache flink and building a simple application where I am reading the events from a kinesis stream, say something like TestEvent{ String id, DateTime created_at, Long amount } performing aggregation (sum) on field amount on above…
Pooja Agrawal
  • 51
  • 2
1
vote
0 answers

Why does this ProcessWindowFunction always compute every incoming element and not all elements of one window?

I am working to set up a Apache Flink Streaming Job which computes very simple IoT data. It consumes (Source) from a RabbitMQ therefor uses RMQSource. This works fine and also the parsing of this data works fine. However, for this parsed datastream…
Gregor Fernbach
  • 11
  • 2
1
vote
1 answer

Execution time of FlinkCEP

I'm using Flink and FlinkCEP for Detection of Complex Events on Datastreams. For research purposes, I need to measure solely the recognition time. I am using Flink / FlinkCEP - 1.7.1. I am creating the stream within the Flink Environment using the…
alextroupi
  • 21
  • 2
1
vote
1 answer

Measuring event-time latency with Flink CEP

I have implemented a pattern with Flink CEP that matches three Events such as A->B->C. After I have defined my pattern I generate a PatternStream patternStream = CEP.pattern(eventStream, pattern); with a PatternSelectFunction such that…
Robin Ellerkmann
  • 2,083
  • 4
  • 29
  • 34
1
vote
1 answer

Order of events processing in Flink and recovery

I am researching Flink for more than a week now. We are consuming events from Kafka and we want events belongs to a specific object id needs to process in the order of event time. So far my research tells me, I should be using keyby and…
Gajendra Naidu
  • 395
  • 3
  • 16
1
vote
1 answer

Error No Runner was specified and the DirectRunner was not found on the classpath

I am running a word count example on single node flink cluster running flink 1.6.1 and keep getting this error. I am using beam version 2.8.0. ERROR jobmanager_1 | 2018-10-28 07:20:41,401 ERROR…
abhish_gl
  • 363
  • 1
  • 10
1
vote
0 answers

Apache Flink: AND conditions in CEP Patterns

I'm new to Apache Flink and the CEP library. I have two (or more) patterns that use data from different sources. If the two patterns have matching events, I want to send and alert, but the order of matching does not matter, that is, I want an…
Paul Bruce
  • 11
  • 1
1
vote
1 answer

Is there a work-around to handle multiple "temporal constraints" in Flink CEP?

As stated in CEP document (https://ci.apache.org/projects/flink/flink-docs-release-1.5/dev/libs/cep.html) that only one temporal constraint is allowed in a pattern sequence, I'm struggling to find out a way to handle a business case that contains 2…
Hayes Yang
  • 13
  • 4
1
vote
0 answers

flink program behaves differently in parallelism

I am using Flink 1.4.1 and I am using CEP. I have to calculate lifetime order amount by the same user in each order. So when I sending orders Order A -> amount: 500, Order B -> amount: 200, Order C -> amount: 300 and calculating key by the user…
Pranjal shrivastava
  • 21
  • 2
1
vote
1 answer

Apache Flink 1.4.2 com.esotericsoftware.kryo.KryoException: java.lang.UnsupportedOperationException

Using Apache Flink 1.4.2 I get following exception com.esotericsoftware.kryo.KryoException: java.lang.UnsupportedOperationException Serialization trace: data (org.apache.flink.api.java.utils.ParameterTool) parameterTool…
razvan
  • 559
  • 7
  • 23
1
vote
1 answer

Looks like a bug in flink-training-exercises for the CEP example

I got a example for the CEP in the following URL https://github.com/dataArtisans/flink-training-exercises/blob/master/src/main/java/com/dataartisans/flinktraining/exercises/datastream_java/cep/LongRides.java And the "goal for this exercise is to…
YuFeng Shen
  • 1,475
  • 1
  • 17
  • 41
1
vote
1 answer

Apache Flink CEP how to pass in time window based on event value?

Pattern pattern = Pattern.begin("start") .next("middle").where(new SimpleCondition() { @Override public boolean filter(Event value) throws Exception { return value.getName().equals("error"); …
atkayla
  • 8,143
  • 17
  • 72
  • 132
1
vote
2 answers

Apache Flink: How to use skip strategy?

I want to skip matched event after first Pattern Match. How can I use Flink's skip strategy? I have a simple scenario if downloads > 1000 then give an alert to the user. In my implementation, After the first match, it continuously gives alert due…
NIrav Modi
  • 6,038
  • 8
  • 32
  • 47
1 2 3
…
24 25