I am using sarama kafka consumer which has a MaxProcessingTime of 250ms. When i send a large message ~400000 bytes, the partition gets blocked, i.e., my kafka consumer stops reading from that partition and the lag on that partition keeps on increasing. Is this possible because of MaxProcessingTime value?
Asked
Active
Viewed 386 times
0
-
Could you show related code and have you tried to get some logs from where the consumer blocks ? – iamabug Nov 02 '19 at 02:54
-
I have same issue. Did you figure out the root cause? – Viktor Nov 28 '19 at 05:48
-
@Viktor didn't figure the root cause but upgrading sarama and sarama-cluster (consumer libraries) to latest version did the trick for me – Vishal Gaikwad Nov 28 '19 at 08:00