Questions tagged [ingest]

41 questions
0
votes
1 answer

DB2 ingest of decimal data from csv

i am looking for a db2 method to import a .csv file (IMPORT.CSV) like this: 2020-01-01;1.234.567,12345 in the a DB2 table MY_TABLE: CREATE TABLE MY_TABLE ( DTRIF DATE, SALDO DECIMAL(18,5) ); i tried "INGEST"…
0
votes
1 answer

Botkit : mutation of the BotkitMessage object throughout middlewares

The user sends Hi there ! (stored in message.text) from the chatbot UI; However, the ConversationPlugin's ingest middleware mutates message.text  to the value Hello. My question is : why isn't this value kept by the time the receive  middleware runs…
devio
  • 1,147
  • 5
  • 15
  • 41
0
votes
1 answer

How do I ingest data from a CSV file stored on OneDrive into a Kusto temp table?

I have an Excel file people use to edit data outside Azure Data Explorer (Kusto). What is the Kusto code I would use to ingest this data as needed into Kusto query? So far it seems I need to use: .create table (Name:type, Name:type) to create a…
user2151027
  • 203
  • 1
  • 3
  • 5
0
votes
2 answers

Automatic edit of file in dockerized container

I have my dockerized container for elasticsearch and kibana running, with it automatically installing some plugins once i start the docker container. I need to edit the config/elasticsearch.yml file to enable the usage of that one plugin and i am…
richylyq
  • 1
  • 4
0
votes
1 answer

hadoop Ingest files

i am very new to hadoop ask for your help. I'm doing the process of digesting files from one directory to another. The following comand that I use: Blockquote hadoop fs -copyFromLocal ./tmp/text.txt ./tmp/harSourceFolder2 but the results always…
0
votes
1 answer

lookaround in POSIX regex to match all spaces except the last (for gsub)

...freaking out because of this simple problem: I'm using an Ingest pipeline with the gsub processor to replace all (white)spaces except the last. E.g.: "hello world regex is fubar " to result in "hello, world, regex, is, fubar" How can I convert…
nonNumericalFloat
  • 1,348
  • 2
  • 15
  • 32
0
votes
1 answer

How can i pass all attributes from an xml to flowfile?

I have a nifi flow, that consists in introducing values from a xml into a hive table. I need to do that xml evaluation automatically because it has a lot of values. Right now i'm doing that by introducing all the elements in the xml manually…
Wylliam M
  • 25
  • 6
0
votes
1 answer

extract data from csv failed

so i tried to extract data from csv, but its seems i failed i have already tried, but it seems i always got it wrong this is my message data "message" : """42307;"FX2CHTPEKAFB";"PACKING CYL COP JUPITER Z …
0
votes
1 answer

Pipeline for parsing Cloudfront logs

Problem with parsing date and time in ingest node Pipeline. problem with parse Cloudfront logs timestamp: Log example: 2019-01-23 00:47:29 FRA2 542 113.139.67.32 GET xxxxx.net /media/no_image 404 - okhttp/3.8.1 - - Error …
mkop
  • 91
  • 1
  • 6
-1
votes
1 answer

DB2 - Ingest vs Update

While working on DB2, I have 2 tables: TABLE_A > 2 columns: CLAIM_ID, CODEID_A TABLE_B > 2 columns: CLAIM_ID, CODEID_B The goal is to write a DB2 Update statement that would check if CLAIM_ID of TABLE_A is the same as CLAIM_ID of TABLE_B, then…
P_user526
  • 65
  • 3
  • 11
-2
votes
1 answer

How to ingest db logs into splunk? I need only logs to be Warning , Error , Critical , ORA-* logs. any sample prop changes would be appreciated

I have the host details list and log directories. Keywords I need to get log for to be ingested into splunk on the below list Warning , Error , Critical , ORA-* logs
1 2
3