1

My company would like to make use of Change Data Capture to replace Interchange of Interface Files between Upstream System and Downstream Systems. Upstream System runs in Oracle Database and contains superset of data while Downstream Systems run in MySQL Database and contains subset of data which are not totally mutual exclusive. We decided to use CDC because we would like to enjoy

  • Data transfer by delta instead of full-set
  • Automatic data synchronization
  • Automatic re-send if data transfer interrupted

However, compared with interface file, we found the following drawback of CDC

  • Too complex from Architecture's point of view
  • High security control demand in both ends and the middle network
  • Complex data management as different recipients need different sets of data
  • Create single point of failure
  • Not transparent in the data transferred, compared with plain text file
  • Difficult to control effective time of data in downstream system if synchronization is real-time
  • Considerably high cost than File Transfer

How can we overcome the above disadvantages?

Thom A
  • 88,727
  • 11
  • 45
  • 75
Stanley Stein
  • 397
  • 1
  • 3
  • 17
  • There are lots of CDC solutions available from different vendors (Attunity, Informatica, AbInitio, etc). Have you taken a look at any of those alternatives? – nvogel Feb 19 '16 at 07:56
  • I evaluated Informatica as it supports various types of database data replication. The product seems one of most sophisticated ones in the market. However, existence of the software still produces 1) Too complex from Architecture's point of view; 2) Complex data management as different recipients need different sets of data; 3) Create single point of failure; 4) Not transparent in the data transferred, compared with plain text file. Rather CDC product, Enterprise Job Schedulers such as Control-M, Tidal and UC4 can serve automation of data transfer with less impact to architecture. – Stanley Stein Mar 16 '16 at 04:12
  • Ref: [link](http://www.softpanorama.org/Admin/job_schedulers.shtml) – Stanley Stein Mar 16 '16 at 04:13

0 Answers0