1

I am exploring nifi, as of I have created processor group with number of processor which basically select data from Oracle DB and insert in to mongoDB. the the flow works as expected.

The flow is QueryDatabaseTable -> SplitAvro -> ConvertAvorToJson -> PutMongoRecord

In QueryDatabaseTable I have custom query select * from employee, which gives me 100 records and these 100 records inserted into mongoDB. But here issue is QueryDatabaseTable is called again and again, so in result same 100 records are get added in mongoDB again and again. Is there any way to stop this repeated execution? Thanks in advance.

Update: I am using Nifi 1.9.2

PFB QueryDatabaseTable setting tab below

enter image description here Scheduling

enter image description here

Properties

enter image description here enter image description here

Update 2: Configuration

Community
  • 1
  • 1
Hitesh Ghuge
  • 793
  • 2
  • 10
  • 39

1 Answers1

0

Use maximum-value columns if you want to prevent duplicates selection.

Bera
  • 673
  • 2
  • 12
  • 31