Stack Overflow
Stack Overflow

Questions tagged [apache-minifi]

MiNiFi is a subproject of Apache NiFi. It is a complementary data collection approach that supplements the core tenets of NiFi in dataflow management, focusing on the collection of data at the source of its creation.

42 questions
0
votes
1 answer

MiNiFi - How to get processors list and number of queued flowfiles?

I'd like to monitor state of the running MiNiFi flow, especially get list of the processors and number of queued flowfiles for each processor. I'm trying to use FlowStatus Script Query, eg.: $ ./minifi.sh flowStatus…
trivelt
  • 1,913
  • 3
  • 22
  • 44
0
votes
2 answers

stopping MiNiFi on Windows

I need the ability to stop MiNiFi running on a windows machine. Here: https://docs.hortonworks.com/HDPDocuments/HDF3/HDF-3.4.0/minifi-quick-start/content/stopping_minifi.html It tells me to use: bin/minifi.sh stop or sudo service minifi…
user3335999
  • 392
  • 1
  • 2
  • 17
0
votes
1 answer

Kafka Processor does not keep the state of attributes of flowfile

I update few attributes of the flowfile and put the same in kafka but when I consume the same from consumekafka_2.0 processor that attributes are lost. Is this not supported ? Do I need to customise this processor? When I saw the below source code…
happy
  • 2,550
  • 17
  • 64
  • 109
0
votes
0 answers

Preprocessing and Postprocessing in Nifi

I have a requirement where in I want to do some preprocessing and postprocessing for each processor. Basically I want to add start time end time and some extra details on each flowfile So what will be the best way. Create custom controller…
happy
  • 2,550
  • 17
  • 64
  • 109
0
votes
1 answer

minifi: listfile processor is not fetching the files from the location

i am just started exploring minifi with nifi, both installed on my local machine. minifi: i have listfile -> fetchfile -> RemoteProcessGroup RPG: url: http://localhost:9090/nifi Transport Protocol: HTTP after i start the minifi, it…
natarajan k
  • 406
  • 9
  • 24
0
votes
1 answer

MiNiFi - NiFi Connection Failure: Unknown Host Exception : Able to telnet host from the machine where MiNiFi is running

I am running MiNiFi in a Linux Box (gateway server) which is behind my company's firewall. My NiFi is running on an AWS EC2 cluster (running in standalone mode). I am trying to send data from the Gateway to NiFi running in AWS EC2. From gateway, I…
riyaB
  • 307
  • 1
  • 3
  • 21
0
votes
1 answer

Nifi: Flow content (dynamic json format) to csv

I have case: in flow content is always json format and the data inside json always change (both kyes and values). Is this possible to convert this flow content to csv? Please note that, keys in json are always change. Many thanks,
Thuy Le
  • 11
  • 6
0
votes
1 answer

Get UUID of System and Update as Attribute in NiFi FlowFile

Is there a way to get the unique UUID of the system (Generated using dmidecode) in NiFi and set it as an Attribute to a FlowFile.
Daniccan
  • 2,755
  • 1
  • 18
  • 27
0
votes
1 answer

Shipping Logs Securely to a Remote Process Group using MiNiFi

I am having a little bit of challenge with NiFi…MiNiFi precisely. We use MiNiFi to ship logs from remote systems to a NiFi Instance, from there to Kafka and into Elasticsearch. We can successfully do this without https, However, recently I was …
Princewill Ezeidei
  • 177
  • 10
0
votes
1 answer

Can we promote only single flow from a single process group containing one flows in nifi

I am trying to use NiFi registry for flow promotion from Dev to QA environment, let says I have process group named PG1, and it has flows consisting of many processes, lets say flow f1 has processors p1 --> p2 --> p3 and flow f2 has processors…
Anand K
  • 21
  • 2
0
votes
1 answer

Apache MiNifi- Putelasticsearch

i make flow, which process real time data from local server and send relevant data to Elasticsearch. I use Minifi, but when I run MiNifi it returned the following error. Does anyone know, where is the issue? Thanks ERROR [Timer-Driven Process…
Erika Bednárová
  • 1
-1
votes
1 answer

how to run minifi as a service in windows 7?

I want to run a minifi bat file as a window service. Is there any way where we can do this in windows 7? Thanks!
natarajan k
  • 406
  • 9
  • 24
1 2
3