FlinkCEP - complex event processing for Apache Flink
Questions tagged [flink-cep]
368 questions
1
vote
1 answer
Simple Scala API for CEP example don't show any output
I'm programming a simple example for testing the new Scala API for CEP in Flink, using the latest Github version for 1.1-SNAPSHOT.
The Pattern is only a check for a value, and outputs a single String as a result for each pattern matched. Code is as…
midnight1247
- 356
- 4
- 17
0
votes
0 answers
Table result to String
I am trying Dynamic rule with Table API, In my system I have SQL rule coming from Kafka. So I have used a broadcast mechanism to implement the same. But I am stuck on how can I give results back to the output.
@Override
public void…
Keyur Makwana
- 13
- 4
0
votes
0 answers
How to reference nested objects in Flink cep SQL in MATCH_RECOGNIZE clause
I am using Flink CEP with SQL for processing events, the schema is determined by the JSON event, while trying to execute the given SQL it gives bellow exception can. we have defined DTO’s for the event (contains nested Dto's), does any one know what…
Krutik Gadhiya
- 1
- 1
0
votes
0 answers
Flink cep MATCH_RECOGNIZE not processing all events
I am using MATCH_RECOGNIZE for pattern matching in events, I am trying to find average usage less than 60 withing 10 seconds interval, the issue here is that in result i am only seeing only 2 result (till the marked position in the data bellow) not…
Krutik Gadhiya
- 1
- 1
0
votes
0 answers
Cannot load user class: org.apache.flink.connector.kafka.sink.KafkaSink
Flink version: 1.17.1
in local environment through IDE the job is starting and working without any errors,
when starting the job through Flink Web ui in ubuntu environment, the job is started successfully but when any event is pushed to kafka topic…
Krutik Gadhiya
- 1
- 1
0
votes
0 answers
flink Lookup join with unbounded stream and bounded hive table not working
i'm looking for sample working code snippet for lookup join of a stream with a hive table in flink. using 1.16 version. The flink documentation provides examples with creating a new hive table and a stream table backed by a kafka connector.…
user3415433
- 1
- 2
0
votes
0 answers
Flink Different checkpoints for different pipelines
I have a use case where I want to run 2 independent processing flows on Flink. The two flows will have a high parallelism. So 2 flows would look like
Source1 -> operator1 -> Sink1
Source2 -> operator2 -> Sink2
I setup the above 2 flows as 2…
Vicky
- 2,999
- 2
- 21
- 36
0
votes
1 answer
My flink pattern detection program only return the first match, not all matched patterns
I have a simple Flink application, trying to detect a pattern over an event stream which is created from the text file below:
1,A
2,B
3,C
4,A
5,C
6,B
7,D
8,D
9,A
10,D
I define the pattern this way:
Pattern pattern =…
0
votes
1 answer
Using AsyncDataStream and RichAsyncFunction with SingleOutputStreamOperator
I'm aggregating over a keyed stream using a SingleOutputStreamOperator object in the form
stream = env.fromSource(...)...sideOutput(...).window(...).aggregate(...)
After I obtain the aggregates I would like to send each record to a REST endpoint…
Black
- 4,483
- 8
- 38
- 55
0
votes
2 answers
out of order events in a generated event streams from a text file
In my Flinkcep application, I have a text file containing simple data (timestamp, type) as follow:
1,A
2,B
3,C
4,A
5,C
6,B
7,D
8,D
9,A
10,D
I can read this file and create an event stream from it, each event has a long field called "timestamp" and…
0
votes
0 answers
Whay is a null pointer exception thrown in Flink CEP library when an entry is not found in the Shared Buffer?
We get the following error from the Flink CEP library. We use an in memory backend. SHouldn't this condition be handled in the Flink CEP library? Is this a bug?
org.apache.flink.util.FlinkRuntimeException: Failure happened in filter function.
…
user20130987
- 1
- 1
0
votes
0 answers
java.util.ServiceConfigurationError: io.grpc.NameResolverProvider: Provider io.grpc.netty.shaded.io.grpc.netty.UdsNameResolverProvider not a subtype
While submitting the flink job on the data proc cluster getting java.util.ServiceConfigurationError: io.grpc.NameResolverProvider: Provider io.grpc.netty.shaded.io.grpc.netty.UdsNameResolverProvider not a subtype exception. We are trying to read the…
Nagesh B Viswanadham
- 27
- 3
0
votes
0 answers
Flink job No Class Found exeception even after providing the depencies
I am not able to connect to pubsub from the flink job running on the Dataproc cluster.
Please find the code which I am using to connect to the Pubsub
{
StreamExecutionEnvironment streamExecEnv =…
Nagesh B Viswanadham
- 27
- 3
0
votes
0 answers
How to print read messages from pubsub in the flink
While reading the messages from the pubsub with flink code I am not able to print them on the console. Where do I find the read messages. Please find the code base as well as the output on the command line interface
public class…
Nagesh B Viswanadham
- 27
- 3
0
votes
1 answer
The configuration does not specify the checkpoint directory 'state.checkpoints.dir'
While submitting the flink job on the dataproc cluster getting the below error. Please find the code base and the error. I am using the flink 1.9.3 version.
The program finished with the following…
Nagesh B Viswanadham
- 27
- 3