Questions tagged [pentaho-spoon]

Spoon is the graphical transformation and job designer associated with the Pentaho Data Integration suite — also known as the Kettle project.

Spoon is the graphical transformation and job designer associated with the Pentaho Data Integration suite — also known as the Kettle project.

Documentation: http://wiki.pentaho.com/display/EAI/Spoon%2BUser%2BGuide

828 questions
0
votes
1 answer

How to ignore hidden column in MS Excel input in pentaho jobs?

In my source extracts having only 16 columns by default. in my first file having 4 hidden columns between sitename and campaignname. in my second file having 2 hidden columns between sitename and campaignname like wise my all the file columns are…
0
votes
1 answer

How to add a variable in put files with SecureFTP job step in Pentaho?

I have a job that have some subjobs and transformations. This job get files from sftp and do some operations with those files and finally move this file to another folder in a remote ftp. I would like to move the file into…
mrc
  • 2,845
  • 8
  • 39
  • 73
0
votes
1 answer

Getting error "you must have a tty to run sudo" when we run through Pentaho

I am getting a you must have a tty to run sudo error when I run a shell script with a R script in it. Weird thing is, it doesn't happen every time. I think it is because of RAM issue, but I am not sure.
karan arora
  • 176
  • 9
0
votes
0 answers

How to manage foreign keys with Kettle/Spoon?

I'm filling my data warehouse's table (MySQL) after some transformations with spoon. However, my dimension table is filled and I've to fill my fact table from a CSV file. So, when I try doing it, kettle warn me there are some records that violate…
F. Petrulio
  • 95
  • 2
  • 9
0
votes
1 answer

Which Security provided by pentaho in S3 output any encryption?

I am using Pentaho, and used s3 output step to put the file in S3 bucket but I want to know which in-transit security is provided by pentaho and how to apply AES encryption in Pentaho?
0
votes
1 answer

Pentaho Spoon: Set SQL script result to value of new field

I currently have tried multiple ways (Execute SQL script, Table input, Database joins) to accomplish what I am trying to do. I need the sum and count respectively that my sql scripts below create to be put into a brand new field, or have these value…
0
votes
1 answer

How to call same job twise in pentaho job with different parameter?

I am creating pentaho jobs In first set variable box i am passing value sysdate the first dfp job working perfectly. In second set variable box i am passing value sysdate+1 ,so sysdate+1 file is picked correctly to process but second dfp job only…
Velu
  • 57
  • 2
  • 11
0
votes
1 answer

Use Redshift as Pentaho PDI database repository

I am running Spoon here on PDI CE 7.0 and trying to set up for the first time my database repository. I am able to use a SQL Server as my database repository, but I was wondering if I could use my Redshift server as my database repository. When I…
0
votes
1 answer

pentaho, spoon: how to validate text file content and move file after processing

I am doing a work for a master with pentaho and I would like to know hot to di something. I receive a text file that I have to validate the content(type, lenght,..), if the content is correct the file is proccesed but if there is any bad field I…
JJoe
  • 1
  • 1
0
votes
1 answer

Pentaho: how to retrieve data stored in two files: one for mapping and other for rows

I need read these data and then load them into oracle tables using (if possible) a single spoon transformation. The data are stored in pairs of two files. Each pair has one file (data-type_yyyymmdd.txt) with each row placed in each line ended with…
gwarah
  • 241
  • 2
  • 10
0
votes
0 answers

Pentaho Spoon chrashes when rightclicking in the Explorer

Every time I right-click in the Explorer on the left side (e.g. on Database Connections in the View-tab), Spoon crashes and I have to terminate it via task manager. The right click works on any other part of Spoon, except in the Explorer. I tried…
MConan
  • 171
  • 1
  • 2
  • 8
0
votes
0 answers

How to pass parameters as header api step pentaho?

I am doing an ETL to connect to an API that uses Oauth 2.0 has an acces method. I have one generate rows step that define: oauth_consumer_key ='A' oauth_nonce = Get from response oauth_signature = Get from…
mrc
  • 2,845
  • 8
  • 39
  • 73
0
votes
0 answers

Metadata injection on JSON input

I'm creating a job that takes the inputs of a json input from a table and i'm trying to do a etl metadata injection, i tried with v5.4,v6.0 but non is working. Is there any work around for my scenario?
0
votes
1 answer

Kettle or PDI: share same DB connection between different steps

I've multiple DB connections in a Kettle (Pentaho Data Integration) trasformation. There are some lookup steps and a table output steps. They must use the same DB connection. I'm searching a way to change the DB connection in a step and…
Daniele Licitra
  • 1,520
  • 21
  • 45
0
votes
1 answer

How to enter a multiline value in Pentaho Spoon UI?

I'm now using Spoon from PDI-CE 7.0 under windows 10 to edit transformations. I never found a convenient way to "paste from clipboard" a multiline String value into simple steps like "Data Grid" or "Generate rows".. Is there a trick that I'm missing…
Myobis
  • 1,347
  • 16
  • 27