Stack Overflow
Stack Overflow

Questions tagged [flink-cep]

FlinkCEP - complex event processing for Apache Flink

368 questions
1
vote
2 answers

Flink Complex Event Processing

I have a flink cep code that reads from socket and detects for a pattern. Lets say the pattern(word) is 'alert'. If the word alert occurs five times or more, an alert should be created. But I am getting an input mismatch error. Flink version is…
Jay Vignesh
  • 179
  • 2
  • 16
1
vote
1 answer

flink streaming create file ( csv or text) on time window

I am new to flink I have transformation suppose like this val supportTask= customSource .map( line => line.split(",")) .map( line =>…
Sanjay Rabari
  • 2,091
  • 1
  • 17
  • 32
1
vote
1 answer

Is there a Apache Flink machine learning tutorial in Java language

I am in search of a tutorial that tells us to setup a basic apache flink machine learning. Current available material is in scala language.
Narendra Pandey
  • 514
  • 4
  • 11
  • 26
1
vote
2 answers

Flink S3 Hadoop 2.8.0

We were trying to use S3 for Flink backend state and checkpoints and used a bucket in Frankfurt (V4 authentication) It gave the error I posted here (Cannot access S3 bucket with Hadoop) and it was due to hadoop. However hadoop 2.8.0 works but there…
razvan
  • 559
  • 7
  • 23
1
vote
0 answers

Can Flink run multiple streams based off initial patterns?

I'm trying to understand if Flink can perform the way I need it to. Using the CEP library for pattern matching, is it possible to set up multiple streams based off initial pattern match? For instance, a message comes in and matches pattern x1, and…
ko1984
  • 41
  • 2
1
vote
1 answer

Flink expected HA behaviour when a TaskManager fails

I created a HA Flink v1.2 cluster made up of 1 JobManager and 2 TaskManagers each in its own VM (not using YARN or hdfs). After I start a job on the JobManager node I kill one TaskManager instance. Immediately in the Web Dashboard I can see the…
razvan
  • 559
  • 7
  • 23
1
vote
1 answer

Flink-CEP use of hashCode and equals

Does Flink-CEP use hashCode() and equals() for comparison if the pattern definition only has attribute level comparisons? I'm asking because I can't guarantee hashCode() correctness.
rbinnun
  • 1,169
  • 2
  • 10
  • 18
1
vote
1 answer

How to write a Flink CEP program where the order of events doesn't matter

The CEP library makes it simple to write a program to describe that can tell if X is followed by Y. val pattern = Pattern.begin("start").where(_.value == "X") .next("end).where(_.value == "Y") But how would i describe a program where I don't…
Drew Verlee
  • 1,880
  • 5
  • 21
  • 30
1
vote
1 answer

Flink and Dynamic templates recognition

We plan to use Flink CEP for processing a big amount of events according to some dynamic templates. The system must recognize chains of events (sometimes complicated chains with conditions and grouping). The templates will be created by user. In…
Rumata Estorsky
  • 55
  • 5
1
vote
1 answer

Apache Flink CEP Timout Pattern in not defined by time window

I am using PatternTimeoutFunction for discarding the event sequence when it falls out of the defined time window. I am setting the watermark as follows public Watermark checkAndGetNextWatermark(Event lastElement, long extractedTimestamp) { …
ravthiru
  • 8,878
  • 2
  • 43
  • 52
1
vote
1 answer

Ho can I do a lazy match with Flink CEP

I want to use FlinkCEP to only do a 'lazy' match on a pattern. How can I do this? e.g. I have an input stream ACABCABCB and i want to match on A followedBy C to get only 3 matches and not 6 matches. I've created the following example to illustrate…
FredT
  • 11
  • 3
1
vote
0 answers

Flink: Syncronize/connect two streams

I have two streams, the first, with CEP library, it´s used it to detect patterns ON-OFF. In the second stream are values that I have to add. I'm looking for way to connect the two streams, so that when I receive an OFF frame, I return the device…
jag
  • 95
  • 2
  • 15
1
vote
2 answers

Flink on YARN : Amazon S3 wrongly used instead of HDFS

I followed Flink on YARN's setup documentation. But when I run with ./bin/yarn-session.sh -n 2 -jm 1024 -tm 2048, while being authenticated to Kerberos, I get the following error : 2016-06-16 17:46:47,760 WARN …
c-val
  • 181
  • 1
  • 2
  • 13
1
vote
1 answer

Flink Kafka Consumer throws Null Pointer Exception when using DataStream key by

I am using this example Flink CEP where I am separating out the data as I have created one application which is Sending application to Kafka & another application reading from Kafka... I generated the producer for class TemperatureWarning i.e. in…
AKSHAY SHINGOTE
  • 407
  • 1
  • 8
  • 22
1
vote
1 answer

Flink CEP Streaming : Batch Mode,Continuous or Micro-Batch?

I am trying to understand this Flink CEP example https://github.com/tillrohrmann/cep-monitoring ..I executed this example of Flink CEP on distributed mode (1 master & 3 cores)..Now I am writing the output to files,hence my output is getting written…
Akki
  • 493
  • 1
  • 11
  • 23
1 2 3
…
24 25