0

I have a producer that sends messages in the form of a list of dictionaries. The consumer reads messages but I am not able to fetch the messages that arrive in the last 'n' minutes. Any help would be appreciated.

anonymous
  • 3
  • 3
  • You may probably add a publishedTime to the list of dictionary. Then, when you consumer fetch data, it can fetch until the published Time is too far from now – Vinetos Oct 29 '20 at 06:45
  • I have to do this using the processing time for each message. – anonymous Oct 30 '20 at 06:33

1 Answers1

0

There is provision to rewind particular timestamp. In order to do that you need to manually assign partitions for topic in the consumer and then use seek method.

Knight71
  • 2,927
  • 5
  • 37
  • 63