8

NiFi UI - Screenshot

In the image, there are 3 GenerateFlowFile processors connected to a LogAttribute processor. I would like to know the need for Funnel. Please clarify.

I understood one such use of funnel where it can be used to merge components from two different process group as described in this youtube video.

Vasanth Subramanian
  • 1,040
  • 1
  • 13
  • 32
  • 3
    in queue you could manage the priority of flow files. after funnel you have one queue and you are able to manage the priority of all incoming dataflows. – daggett Dec 29 '19 at 23:24

1 Answers1

16

Well, imagine having 20 of those GenerateFlowFile processors. Imagine having to replace the LogAttribute processor with a different processor. It would be a hard job doing this since they are connected directly to the LogAttribute processor. However, if you had a Funnel between them, you would only need to replace the destination of the Funnel and not all of the processors.

I also use it for debugging flows. When I need a quick destination to test the intermediate result of a flow.

Basically what a Funnel does, is to just transfer FlowFiles forward as it gets them.

Ben Yaakobi
  • 1,620
  • 8
  • 22
  • +1. Rather than creating a process group for these, funnel would come handy. I learned this later after having Process groups created for my needs, and now changing them to funnel ( at least, this fits perfectly in my use case). Although, we also need to determine based on the use cases. – Ak777 Apr 01 '21 at 05:59