1

The case. KCL reads a batch of 500 records from kinesis. Something bad happens (e.g. Unexpected error). KCL will lose all 500 records with data. Because KCL marks these 500 records as read and handled even though errors occur.

If I use AWS Lambdas instead of KCL, all records will be just read second time from kinesis after errors firing.

Can KCL behave like Lambdas and repeatedly read the same records from Kinesis if I got error before?

Bogdan Surai
  • 1,197
  • 14
  • 16
  • How are you planning to trigger Lambda? Kinesis Video Streams can't be used as trigger directly. – py_ml Sep 11 '19 at 11:28
  • @py_ml I didn’t work with Kinesis Video Streams. But use a lot of regular Kinesis Streams. It’s possible to add triggers for lambdas in lambda’s configs. Kinesis is available as a trigger there. – Bogdan Surai Sep 11 '19 at 12:11
  • Oh, sorry, somehow I managed to read Kinesis Video Stream, yes Kinesis Data Streams are available as trigger. – py_ml Sep 11 '19 at 12:44

0 Answers0