Stack Overflow
Stack Overflow

Questions tagged [oracle-cdc]

Oracle Change Data Capture related questions

44 questions
5
votes
2 answers

Kafka Connector for Oracle Database Source

I want to build a Kafka Connector in order to retrieve records from a database at near real time. My database is the Oracle Database 11g Enterprise Edition Release 11.2.0.3.0 and the tables have millions of records. First of all, I would like to add…
Lefteris Souvleros
  • 51
  • 1
  • 3
3
votes
0 answers

Alternative of Debezium with aws services

I have a use case where I need to capture the data changes in Postgres DB and push the messages to SQS. This use can easily be achieved with debezium and Kafka but is there any alternative to do the same thing with AWS services preferably SQS? Like…
mia
  • 73
  • 10
2
votes
1 answer

Merge data logic for CDC snowflake

I am working on a logic for merging duplicate rows from one table(1000+ rows) into another empty table based on the product_id and extraction_date. The extraction_date is used to determine which data is the latest. In cases where extraction_date is…
debaroti
  • 23
  • 2
2
votes
2 answers

Create Kafka connect without confluent

I recently started with Kafka and I try to create a Kafka connect to connect to oracle but I can't do it. The information I found is about confluent, but that does't work in Windows ... How can i configure one or create it with java? I use for my…
Lanre
  • 101
  • 2
  • 8
2
votes
1 answer

Getting the writable operation error while using oracle cdc

I am getting the following error while connecting through oracle cdc client and my origin database is read only database but the error is database required for writable operation. please help Caused by: java.sql.SQLException: ORA-01300: writable…
Kum
  • 31
  • 5
2
votes
3 answers

Spring Integration Flow with Jdbc Message source which has dynamic query

I am trying to do a change data capture from oracle DB using spring cloud data flow with kafka as broker. I am using polling mechanism for this. I am polling the data base with a basic select query at regular intervals to capture any updated data.…
Akhil Ghatiki
  • 1,140
  • 12
  • 29
2
votes
0 answers

Oracle CDC in Talend

I am trying to setup a CDC in Talend on an Oracle database. I am following the steps as listed here: https://www.talendforge.org/tutorials/tutorial.php?language=english&idTuto=42 However, when i try to establish the CDC in the main DB conneciton, i…
Janardan Kelkar
  • 170
  • 8
1
vote
1 answer

Kafka connect -Debezium- Oracle JDBC Sink connector error consuming debezium(oracle) CDC event

I have below images running in docker. quay.io/debezium/connect:2.0 quay.io/debezium/kafka:2.0 quay.io/debezium/zookeeper:2.0 container-registry.oracle.com/database/enterprise:latest debezium-source-connector config "name": "customers-connector", …
javadev
  • 69
  • 1
  • 1
  • 7
1
vote
1 answer

Issue with merge task for CDC snowflake using stream and task

I have a basic task which merges data from the source table into the target table using a stream. Creating the tables and stream create or replace table source_json_table_trial( v variant ); create or replace table target_json_table_trial like…
Worker
  • 43
  • 4
1
vote
0 answers

AWS DMS Tasks fails after few days stating storage used by swap files exceeded the limit for task

I am running 8-10 ongoing replication tasks in AWS DMS, with multiple tables inside each task. But one task in specific gets fails ~twice per week. It has a highly transactional table in which ~1 mil updates happen per 10 mins. Error- Reading from…
Aim_headshot
  • 111
  • 1
  • 6
1
vote
0 answers

How to convert a partitioned table into a non-partitioned table by using Oracle online redefinition with the object id kept

It is not difficult to convert a partitioned table into a non-partitioned table if we use a Oracle online redefinition and the object id of the source table is changed as a result of the operation because the interim table (non-partitioned) becomes…
Sigularity
  • 917
  • 2
  • 12
  • 28
1
vote
1 answer

Debezium CDC connector says no ocijdbc11 in java.library.path

I am trying to deploy debezium CDC connector to capture data from Oracle DB. We have prepared the Oracle DB and Xstream connector. I am getting following exception: { "name": "test-debezium-2", "connector": { "state": "RUNNING", …
Zamir Arif
  • 341
  • 2
  • 13
1
vote
1 answer

Found ddl change for a table in CDC management console

our target db is DB2 and source is ORACLE, we found ddl changes in CDC management console and i need to fix the instance in to proper running condition.
avi nash
  • 11
  • 1
1
vote
1 answer

AWS DMS with CDC to S3. How would it handle row updates and deletes?

Let's say that I DMS data from e.g. MS SQLS using CDC directly to S3. If there is a row delete or update in the source DB, would DMS create new objects in S3 when those events take place? Or would it delete / overwrite the previous one? In other…
Amelio Vazquez-Reina
  • 91,494
  • 132
  • 359
  • 564
1
vote
1 answer

Getting error with Oracle 11g CDC in StreamSets

com.streamsets.datacollector.util.PipelineException: PREVIEW_0003 - Encountered error while previewing : com.streamsets.pipeline.api.StageException: JDBC_87 - Interrupted while waiting to read data at…
Ritesh Srivastava
  • 174
  • 8
1
2 3