0

I have 3 processors running parallel I want to wait untill all have finished their jobs. All 3 processors will put the message in kafka topic once they finish their job. And once all have finished I want to trigger the next job. For this I explored the possible options like below.

  1. Use wait-notify. wait after all 3 processors and then notify for the next job
  2. Put each processors status in DistributedMapCache then on every put message in kafka topic check this cache and all 3 processors status is done then trigger next job
  3. write some poller who will keep on polling these 3 processors and trigger next jobs

What is the best way to achieve the same?

happy
  • 2,550
  • 17
  • 64
  • 109

1 Answers1

0

Using Wait-Notify will be the bestway/cleaner to achieve this case.

  • We can also acheive the same case using Merge Content processor for waiting 3 flowfiles and then trigger the next job (there are some cases where this solution won't work).

Refer to this link for more details.

notNull
  • 30,258
  • 4
  • 35
  • 50
  • Can you check this I have used wait & notify https://stackoverflow.com/questions/55629056/wait-notify-for-parallel-sequential-processing-in-nifi – happy Apr 11 '19 at 09:25