Get response from Kafka producer after each send command

Question

I am using spring boot Kafka to send messages to a topic. My requirement is to read data incrementally from a table and publish it into a topic based on a date time field and as it is a scheduled process i need to store the date-time field from each message after each successful send message to Kafka.

Any suggestions what is the best way of doing this.I believe i cannot use asynchronous callback for something like this as i need to update the variable after each call to the producer.

Also i cannot use Kafka connect due to infrastructural constraint.

score 0 · Answer 1 · answered Oct 22 '20 at 21:35

0

ListenableFuture<SendResult<String, String>> future = template.send(...);
SendResult<String, String> sendResult = future.get(10, TimeUnit.SECONDS);
Long timestamp = sendResult.getProducerRecord().timestamp();

If the send fails, the get will thrown an exception.

answered Oct 22 '20 at 21:35

Gary Russell

166,535
14
146
179

Does this method waits before sending another message? – Gaurav singh Oct 22 '20 at 21:48
Yes, calling `get()` on the future waits for it to complete; to speed things up, you can do multiple sends and save the futures in a `Collection` and wait for them all later. – Gary Russell Oct 22 '20 at 22:06

Get response from Kafka producer after each send command

1 Answers1