Flink CEP Event Not triggering

Question

I have implement the CEP Pattern in Flink which is working as expected connecting to local Kafka broker. But when i connecting to cluster based cloud kafka setup, the Flink CEP is not triggering.

final StreamExecutionEnvironment env = StreamExecutionEnvironment.getExecutionEnvironment();
    //saves checkpoint
    env.getCheckpointConfig().enableExternalizedCheckpoints(
            CheckpointConfig.ExternalizedCheckpointCleanup.RETAIN_ON_CANCELLATION);
    env.setStreamTimeCharacteristic(TimeCharacteristic.EventTime);

I am using AscendingTimestampExtractor,

consumer.assignTimestampsAndWatermarks(
    new AscendingTimestampExtractor<ObjectNode>() {
      @Override
      public long extractAscendingTimestamp(ObjectNode objectNode) {
        long timestamp;
        Instant instant = Instant.parse(objectNode.get("value").get("timestamp").asText());
        timestamp = instant.toEpochMilli();
        return timestamp;
      }
    });

And also i am getting Warn Message that,

AscendingTimestampExtractor:140 - Timestamp monotony violated: 1594017872227 < 1594017873133

And Also i tried using AssignerWithPeriodicWatermarks and AssignerWithPunctuatedWatermarks none of one is working

I have attached Flink console screenshot where Watermark is not assigning. Updated flink console screenshot

Could Anyone Help?

Since the parallelism is 1, the problem is not an idle source. Can we see the whole job graph -- what comes after CEP? — David Anderson, Jul 06 '20 at 11:34
@DavidAnderson Thanks for reply. After CEP there in no block we are just logging the matched event in json format.As i am seeing **currentOutputWatermark** as some numeric value like -9223372036854776000. I have updated the flink console screenshot in Question session . But the same jar with local setup working expected when it moves everthing to cluster then the problem arise. — DINESH S, Jul 07 '20 at 04:09
I suspect your problem is caused by using per-partition watermarking with an idle partition. — David Anderson, Jul 07 '20 at 05:51
@DavidAnderson Thanks..! it works now. problem with ideal partition in kafka cluster causes this issue — DINESH S, Jul 07 '20 at 11:36

David Anderson · Accepted Answer · 2020-07-07T11:42:51.930

CEP must first sort the input stream(s), which it does based on the watermarking. So the problem could be with watermarking, but you haven't shown us enough to debug the cause. One common issue is having an idle source, which can prevent the watermarks from advancing.

But there are other possible causes. To debug the situation, I suggest you look at some metrics, either in the Flink Web UI or in a metrics system if you have one connected. To begin, check if records are flowing, by looking at numRecordsIn, numRecordsOut, or numRecordsInPerSecond and numRecordsOutPerSecond at different stages of your pipeline.

If there are events, then look at currentOutputWatermark throughout the different tasks of your job to see if event time is advancing.

Update:

It appears you may be calling assignTimestampsAndWatermarks on the Kafka consumer, which will result in per-partition watermarking. In that case, if you have an idle partition, that partition won't produce any watermarks, and that will hold back the overall watermark. Try calling assignTimestampsAndWatermarks on the DataStream produced by the source instead, to see if that fixes things. (Of course, without per-partition watermarking, you won't be able to use an AscendingTimestampExtractor, since the stream won't be in order.)

Flink CEP Event Not triggering

1 Answers1