Kafka Producer vs Kafka Connector

Question

I need to push data from database(say Oracle DB) to a kafka topic by calling a stored procedure.I need to do some validations too on message

Should i use a Producer API or Kafka Connector.

score 2 · Accepted Answer · answered May 11 '20 at 15:35

2

You should use Kafka Connect. Either that, or use the producer API and write some code that handles:

and that integrates with hundreds of other technologies in a standardised manner for ease of portability and management.

At which point, you'll have reinvented Kafka Connect ;-)

To learn more about Kafka Connect see this talk. To learn about the specifics of database->Kafka ingestion see this talk and this blog.

answered May 11 '20 at 15:35

Robin Moffatt

1

Thanks a lot .I have written the code .but i think it makes more sense to use Kafka Connect.No point in re-inventing the wheel. – Pale Blue Dot May 11 '20 at 15:42
I agree :) Please remember to mark the question as answered if it is. – Robin Moffatt May 11 '20 at 15:45
MoffattJust one question is begugging connector hard ?As mentioned here in this article `https://medium.com/@stephane.maarek/the-kafka-api-battle-producer-vs-consumer-vs-kafka-connect-vs-kafka-streams-vs-ksql-ef584274c1e` – Pale Blue Dot May 11 '20 at 15:57
1

@amitjain please check this question https://stackoverflow.com/q/45717658/7109598 about debugging – Iskuskov Alexander May 11 '20 at 16:39

1 Answers1