7

I am trying to understand difference between Apache Nifi and Hortonworks Data Flow (HDF).

How they differ from each other in terms of capability and overall design ? What will be possible use cases for Nifi and HDF ?

Shashi
  • 2,686
  • 7
  • 35
  • 67

1 Answers1

11

Hortonworks Data Flow (HDF) is a platform for data collection, curation, analysis, and delivery. It is made up of Apache NiFi, Apache Kafka, Apache Storm, and Apache Ranger. You can read more about it here: https://hortonworks.com/products/data-center/hdf/

Apache NiFi is an open-source data flow tool, and is one of the tools included in HDF.

Bryan Bende
  • 18,320
  • 1
  • 28
  • 39
  • 3
    From architecture point of view , Does HDF needs to be installed on different server other than HDP ? So that HDF can talk to HDP cluster. – Shashi May 16 '17 at 18:24
  • 1
    For a production deployment, HDF services should not be installed on the same servers as HDP services, but the servers do need to be able to communicate with each other. – Bryan Bende May 17 '17 at 18:56
  • @BryanBende : In the recent HDF (3.0.1.1) version the NiFi version is 1.2, Can I upgrade the NiFi version to 1.4 in the HDF? Or should I wait for HDF to roll out an update that has NiFi with 1.4 version? – user4321 Oct 25 '17 at 19:24
  • HDF 3.0.1.1 is actually closest to Apache NiFi 1.3.0. For HDF it is best to wait for the next official HDF release to get the NiFi updates. – Bryan Bende Oct 25 '17 at 20:48
  • Thank you Bryan. Wanted to use the Process Group Variables in NiFi 1.4 version. So seems like the best thing to do is to wait until HDF release the new version. – user4321 Oct 25 '17 at 21:01