I have a sink connector that writes rows to a MySQL database. I'd like to skip rows which have a "source": "whatever" key: value pair. Is this possible?
Asked
Active
Viewed 280 times
1
-
You have to write your own Single Message Transform (SMT) in order to achieve this. – Giorgos Myrianthous Sep 17 '19 at 17:38
-
I figured that might be the case but wanted to make sure there wasn't an easier way to do this. Thanks – Sep 17 '19 at 17:41
-
But also, how do you get an SMT to simply not write to a database? – Sep 17 '19 at 19:52
-
1@Hassan, It has to return `null` for particular message and message won't be passed to `SinkTask`. It is generic behaviour of Kafka Connect - apply to all types of Connectors – Bartosz Wardziński Sep 18 '19 at 00:09
-
@wardziniak Makes sense, thanks – Sep 18 '19 at 00:40