0

Is there a sink connector for debezium to MySQL Database ? I'm able to connect to source and can watch the topic with schema and all the changes on the source database. You can have a look at sample schema topic for one table as below. Please help me understand how to proceed from here. Why I'm converting every change to Json format if the CDC queries are available on the source DB.

{"schema":{"type":"struct","fields":[{"type":"int32","optional":false,"field":"ID"}],"optional":false,"name":"SourceDBChandra.world_x.city.Key"},"payload":{"ID":5}} {"schema":{"type":"struct","fields":[{"type":"struct","fields":[{"type":"int32","optional":false,"field":"ID"},{"type":"string","optional":false,"default":"","field":"Name"},{"type":"string","optional":false,"default":"","field":"CountryCode"},{"type":"string","optional":false,"default":"","field":"District"},{"type":"string","optional":true,"name":"io.debezium.data.Json","version":1,"field":"Info"}],"optional":true,"name":"SourceDBChandra.world_x.city.Value","field":"before"},{"type":"struct","fields":[{"type":"int32","optional":false,"field":"ID"},{"type":"string","optional":false,"default":"","field":"Name"},{"type":"string","optional":false,"default":"","field":"CountryCode"},{"type":"string","optional":false,"default":"","field":"District"},{"type":"string","optional":true,"name":"io.debezium.data.Json","version":1,"field":"Info"}],"optional":true,"name":"SourceDBChandra.world_x.city.Value","field":"after"},{"type":"struct","fields":[{"type":"string","optional":false,"field":"version"},{"type":"string","optional":false,"field":"connector"},{"type":"string","optional":false,"field":"name"},{"type":"int64","optional":false,"field":"ts_ms"},{"type":"string","optional":true,"name":"io.debezium.data.Enum","version":1,"parameters":{"allowed":"true,last,false,incremental"},"default":"false","field":"snapshot"},{"type":"string","optional":false,"field":"db"},{"type":"string","optional":true,"field":"sequence"},{"type":"string","optional":true,"field":"table"},{"type":"int64","optional":false,"field":"server_id"},{"type":"string","optional":true,"field":"gtid"},{"type":"string","optional":false,"field":"file"},{"type":"int64","optional":false,"field":"pos"},{"type":"int32","optional":false,"field":"row"},{"type":"int64","optional":true,"field":"thread"},{"type":"string","optional":true,"field":"query"}],"optional":false,"name":"io.debezium.connector.mysql.Source","field":"source"},{"type":"string","optional":false,"field":"op"},{"type":"int64","optional":true,"field":"ts_ms"},{"type":"struct","fields":[{"type":"string","optional":false,"field":"id"},{"type":"int64","optional":false,"field":"total_order"},{"type":"int64","optional":false,"field":"data_collection_order"}],"optional":true,"field":"transaction"}],"optional":false,"name":"SourceDBChandra.world_x.city.Envelope"},"payload":{"before":{"ID":5,"Name":"Amsterdam","CountryCode":"NLA","District":"Noord-Holland","Info":"{"Population":731200}"},"after":{"ID":5,"Name":"Amsterdam","CountryCode":"NLD","District":"Noord-Holland","Info":"{"Population":731200}"},"source":{"version":"1.9.5.Final","connector":"mysql","name":"SourceDBChandra","ts_ms":1658210588000,"snapshot":"false","db":"world_x","sequence":null,"table":"city","server_id":1,"gtid":null,"file":"binlog.000002","pos":958398,"row":0,"thread":49,"query":null},"op":"u","ts_ms":1658210588985,"transaction":null}}

Nagendra Varada
  • 1
  • Debezium is for fetching data _from_ a database (specifically its replication stream) and writing to Kafka. Sink connectors are for writing data from Kafka _to_ a datastore. I don't understand what you think a Debezium sink connector would be for? – snakecharmerb Jul 19 '22 at 08:33
  • Thanks for your comment @snakecharmerb. How can I post kafka topics into other databases like MySQL. In documentation Debezium is providing Source and sink connectors to transfer the data. – Nagendra Varada Jul 19 '22 at 08:41

0 Answers0