1

We have created a flow in nifi,

-- From hive(selecthiveql) we are getting 4257 records

-- based on output of selecthiveql we are passing the data based on attribute to replaceText Processor with the insert query into it and passing it to putsql processor

-- when data is being is loading into the oracle, we are getting data loss. we were able to load only 4000 out of 4257 records.

I have attached the screenshot as well. Please have a look at it.

If anyone help us in this scenario would be very helpful. enter image description here

priyanka
  • 287
  • 2
  • 5
  • 11
  • Do you think it might possibly be something to do with the "failed t update database due to a failed batch update" message? How are we supposed to guess why that failed? – Alex Poole Feb 10 '17 at 12:48
  • 1
    4000 is a suspiciously round number. Is some kind of loop with a counter involved? – APC Feb 10 '17 at 13:58
  • 1
    What happens to the `failure` and `retry` outputs from PutSQL? Can you route all the outputs separately to make them more visible, maybe to LogAttribute processors? That might help you reconcile the count of records. – James Feb 10 '17 at 17:42
  • @priyanka You need to check query for insert rows by put the failure relationship into any processor.Just open content view and copy that query into SQL Server.If that query runs in SQL Server then NiFi PutSQL should run – Mister X Feb 11 '17 at 04:30

0 Answers0