How do I achieve Change Data Capture in CnosDB

Asked Feb 16 '23 at 08:07

Active Mar 07 '23 at 13:44

Viewed 48 times

I am migrating some of the IoT data from MySQL to CnosDB and then replicate some of the anomalies and also the changes/delta of the change to ClickHouse for further analysis.

Currently I have to do full replication (similar to full backup). Is there an easy way to just replicate the change data from CnosDB to ClickHouse. FYI. I am using the Kafka in the middle to stream the data.

edited Mar 07 '23 at 13:44

asked Feb 16 '23 at 08:07

Munin

1,576
2
19

https://kb.altinity.com/altinity-kb-integrations/mysql-clickhouse/ – Denny Crane Feb 16 '23 at 17:53
It's unclear what do you mean by changes? Deltas in values? Rows Updates? Rows Deletes? – Denny Crane Feb 16 '23 at 17:54
Clickhouse is able to ingest data from Kafka. See Kafka Engine. See kafka connect https://clickhouse.com/docs/en/integrations/kafka/intro/ – Denny Crane Feb 16 '23 at 17:56
I just updated the question. I mean the deltas. – Munin Feb 17 '23 at 10:43

How do I achieve Change Data Capture in CnosDB

0 Answers0