Questions tagged [nifi-processor]

12 questions
1
vote
1 answer

what can be a better way to remove empty flowfiles which contents only curly braces

Is there any better way to remove the empty flowfile which contents only curly braces {} . I have achieved, (attaching the flow for reference) but looking for short and effective method like Jolt Spec or any other to reduce the processing time and…
samrathal
  • 67
  • 4
1
vote
1 answer

Nifi 1.16.3 fails to start when changing sensitive.props.key value

We're encountering some errors when starting Nifi 1.16.3 after calling encrypt-config.sh in a secure environment. For background, Nifi is deployed and managed using an in-house deployment product, and is used as a component within our application…
Mvfm
  • 31
  • 4
1
vote
2 answers

How to handle arrays with QueryRecord?

I'm working in Apache NiFi and I've a question: how to handle nested arrays in JSON with QueryRecord processor? For example I've a JSON: { "offerName":"Viatti Strada Asimmetrico V-130 205/55 R16 91V", "detailedStats":[ { …
funnelCONN
  • 149
  • 1
  • 11
0
votes
0 answers

how to populate audit columns in the database while loading data from Json to oracle table?

Imagine I have employees json file which needs to be populated into employees table in oracle using Apache Nifi. my source file does not have the time of insert and update, I want to populate created time with processing time, created user name with…
0
votes
3 answers

How to do Dynamic property naming in NIfi?

I'm in a situation where I need to be able to set the name of a property using Expression Language. Is there any way to do that? I try to create an attribute using an UpdateAttribute processor and put in ${property1} as the property name. Now,…
Destiel
  • 35
  • 6
0
votes
0 answers

How to Configure InvokeAWSGatewayApi 1.17.0 processor in nifi

I'm getting error response on InvokeAWSGatewayApi 1.17.0 processor, i have filled both the Access Key ID and Secret Access Key correctly, Same is working fine in Postman, as in Postman we have additional fields available in Authorization as Service…
self lab
  • 63
  • 5
0
votes
1 answer

Get the previous month in NIFI

I am using the update attribute to check my file if its for previous month. My file name looks like this 2_EXAMPLE_MMM_2023. I am using the expression ${now():minusMonths(1):format('dd_EXAMPLE_MMM_YYYY')} But my version says there is a unexpected…
0
votes
2 answers

Nifi-registry pod error on flow_git when using custom image

Initially I was using official Nifi-registry image of Apache. I used the official docker file and created new nifi-registry image. On deploying it in the cluster I'm getting the following error and the pod doesnot spin up. 2023-02-22 14:32:54,459…
0
votes
1 answer

NiFi Processor Issue

In Nifi “ExecuteScript” processor. When the python script (running from “ExecuteScript” processor) trying to import “unidecode” module throwing error saying “No module found” and the “unidecode” module is installed for Python 2.x on Nifi…
Aman Gupta
  • 21
  • 2
0
votes
0 answers

Authenticate ElasticSearchClient in Nifi with Kerberos

I have been trying to push the audit payload to elastic search datasource from my Nifi pipeline. I see PutElasticsearchRecord we could have ElasticSearchClientServiceImpl set with username and password. But my requirement is with a principal and…
Scorpy
  • 95
  • 4
  • 11
0
votes
0 answers

How to call oracle Store procedure in Apache NiFi

I need to use ORACLE stored procedure with input param and this input PARAM is coming from flow file and get output from that stored procedure. is any processor is available with run stored procedure and return the out put in avro schema or any…
user19296047
0
votes
3 answers

Replace column values using Apache NiFi

I have a sample csv looks like this ID,FNAME,PROBLEM_COL 1,sachith, 2,nalaka, 3,john, 4,adams, Always PROBLEM_COL value is empty. I want to replace empty with null string. For that I used UpdateRecord processor and CSVReader with Use String Fields…
Sachith Muhandiram
  • 2,819
  • 10
  • 45
  • 94