Stack Overflow
Stack Overflow

Questions tagged [flink-cep]

FlinkCEP - complex event processing for Apache Flink

368 questions
0
votes
1 answer

How to test keyedbroadcastprocessfunction in flink?

I am new to flink i am trying write junit test cases to test KeyedBroadCastProcessFunction. Below is my code ,i am currently calling the getDataStreamOutput method in TestUtils class and passing inputdata and patternrules to method once the input…
user13906258
  • 161
  • 1
  • 13
0
votes
1 answer

Why flink 1.10.1 is not loading stored states after flink crash-restart with FsStateBackend

I'm using Flink 1.10.1 with FsStateBackend as state backend for checkpoints. I have some stateful operations that during the application is running (running as .jar application not as a cluster) they work as expected, but if the application stop(or…
Alter
  • 903
  • 1
  • 11
  • 27
0
votes
1 answer

Flink CEP Event Not triggering

I have implement the CEP Pattern in Flink which is working as expected connecting to local Kafka broker. But when i connecting to cluster based cloud kafka setup, the Flink CEP is not triggering. final StreamExecutionEnvironment env =…
DINESH S
  • 15
  • 1
  • 6
0
votes
2 answers

Unable to submit Job in Flink using post request via curl request (Request did not match...)

I was trying to send a post request to Flink Job manager running on Kubernetes cluster. While sending post request of /jar/run for a class which doesn't need any command line arguments, it works fine. But while trying to submit a different class in…
Anish Sarangi
  • 172
  • 1
  • 14
0
votes
2 answers

Flink 1.10.1 behaves different with parallelism max than 1

First of all I already have found this question here: flink program behaves differently in parallelism, and it looks the same issue that I'm facing right now, but I think I do need CEP in my scenario, because I have more than 1.000.000 records that…
Alter
  • 903
  • 1
  • 11
  • 27
0
votes
1 answer

Fix JobId in Apache Flink

Is there anyway to fix the job id in Apache Flink within local execution environment from Java? Kind regards. Thanks in advance.
Alter
  • 903
  • 1
  • 11
  • 27
0
votes
1 answer

flink missing state value on k8s - Resume job while jobmanager/taskmanager crashes

While the flink job cluster(deployment/pod) running on kubernetes, we delete the jobmanager and taskmanager(kubectl delete pod XXX). We found the state are missing from previous pod which rocksDB and checkpoint file path is mounted from PVC after…
Jeff
  • 117
  • 10
0
votes
1 answer

How to update the Broadcast state in KeyedBroadcastProcessFunction in flink?

I am new to Flink i am doing a pattern matching using apache flink where the list of patterns are present in broadcast state and iterating through the patterns in processElements function to find the pattern matched and i am reading this patterns…
YRK
  • 153
  • 1
  • 1
  • 22
0
votes
1 answer

Customize Flink - Prometheus metrics

I need to export custom metrics from Flink 1.10 to Prometheus. I have my custom metrics already created and working, but the issue is that when I print out (in terminal for example) to see the metrics, a lot of metrics comes out from Flink and I…
Alter
  • 903
  • 1
  • 11
  • 27
0
votes
1 answer

how can I get job submitting time and use it in Flink application?

I'm currently developing a stream processing application, one of the functionality is to take events that happen in the time zone [time of submitting the job, time of submitting the job + T ]. how can access to that particular variable (time of…
Maher Marwani
  • 43
  • 1
  • 5
0
votes
1 answer

How to check DataStream in flink is empty or having data

I am new to Apache flink i have a datastream which implements a process function if certain conditions is met then the datastream is valid and if its not meeting the conditions i am writing it to sideoutput. I am able to print the datastream is it…
YRK
  • 153
  • 1
  • 1
  • 22
0
votes
1 answer

Using ROW_NUMBER with Flink SQL

I am trying to run the following SQL statement on Flink version 1.10 select startAreaID, endAreaID from ( select startAreaID, endAreaID, ROW_NUMBER() OVER (ORDER BY cnt DESC ) as row_num from ( select startAreaID, endAreaID, count(1) as…
Ahmed Awad
  • 95
  • 8
0
votes
1 answer

why is it bad to execute Flink job with parallelism = 1?

I'm trying to understand what are the important features I need to take into consideration before submitting a Flink job. My question is what is the number of parallelism, is there an upper bound(physically)? and how can the parallelism impact the…
Maher Marwani
  • 43
  • 1
  • 5
0
votes
2 answers

How to get output of the values that are not matched in filter function in Apache flink

I am newbie to Apache flink i am trying to filter words that starts with letter "N" and i am getting output but how can i get words which don't starts with word "N" below is the code i am using package DataStream; import…
YRK
  • 153
  • 1
  • 1
  • 22
0
votes
1 answer

How to generate power off alert using flink-streaming

How to generate power off alert using flink-streaming. e.x: I have a site which sends data to the flink-job via kafka.      Let's say, we received data on 26 April 1992 10:23:52 after that site had some problem it did not send any data. In that case…
MadProgrammer
  • 513
  • 5
  • 18
1 2 3
…
24 25