Stack Overflow
Stack Overflow

Questions tagged [pdi]

PDI Pentaho’s Data Integration, also known as Kettle, provides extraction, transformation, and loading (ETL) capabilities.

PDI (Pentaho Data Integration), formally known as Kettle, is a project of data integration. It delivers powerful Extraction, Transformation, and Loading (ETL) capabilities, using a groundbreaking, metadata-driven approach.

External Links:

440 questions
1
vote
1 answer

Generate serie of queries in PENTAHO

How do I build a general query based in a list of tables and run/export the results? Here is my conceptual structure conceptual structure Basically the from clause in query would be inserted by the table rows. After that, each schema.table with true…
Caio Mattos
  • 33
  • 6
1
vote
1 answer

Pentaho PDI - Not setting constant

I can't for the life of me figure out why my transform which I have setting a 'constant' value is not setting it? Anywhere I can look for details? Here's the add header - constant step So WHY do I not get my test value in the output?? I even…
Tony
  • 8,681
  • 7
  • 36
  • 55
1
vote
2 answers

PDI Subtract 1 Min from system date variable

I'm trying to use PDI to subtract 1min or 60seconds from the default system date (variable). I have this command connected to a calcuator step. But it either gives me an error or NO time value 2020/04/20 11:51:00 - Calculator.0 - ERROR (version…
Tony
  • 8,681
  • 7
  • 36
  • 55
1
vote
1 answer

pentaho data integration - cant connect to mysql

anyone can help me to resolve my problem? i can't connect from pentaho to mysql Error connecting to database [mysql - simpeg] :org.pentaho.di.core.exception.KettleDatabaseException: Error occurred while trying to connect to the database Driver…
Roby Ap
  • 33
  • 1
  • 4
1
vote
1 answer

ORA-00001 / TOP001 - Pentaho Error Handling

I'm trying to handle errors in a PDI transformation, but I'm not able to capture the Oracle error : Error inserting/updating row ORA-00001: unique constraint (string.string) violated PDI Error_code = TOP001 PDI generated an empty reject file. The…
fsantos
  • 11
  • 2
1
vote
1 answer

Pentaho PDI unable to use parameter in transformation

Using Pentaho PDI 8.3.0 I am unable to use a parameter in a REST call within a transformation. What I've done is: Create a transformation and given it a parameter called PAGE_NR with default value 1 Create a job Call the transformation with…
JustLudo
  • 1,690
  • 12
  • 29
1
vote
0 answers

Pentaho JsonInput GET fields

I'm trying to use PDI to read data from an API (json) and now I'm simply trying to use json input to get a few specific fields but the get fields button on the input step gives me. ERROR (version 8.3.0.0-371, build 8.3.0.0-371 from 2019-06-11…
Tony
  • 8,681
  • 7
  • 36
  • 55
1
vote
1 answer

Pentaho "kettle.properties" file - which one am I using?

When one runs a job from the server (by selecting server as below), does PDI pick up the "kettle.properties" file from the server or from the local computer they are running the job from? What about the Pentaho User Console portal - where is the…
ERR
  • 213
  • 1
  • 6
  • 17
1
vote
1 answer

How to call a stored procedure in Pentaho Data Integration ? A Typical scenario

I have scenarios like where I do not have select access on to the whole table or table's to one of my Source DB, the only way I could get access required columns and bring the data into the Pentaho layer is by stored procedure. Below is the sample…
Koushik pandinya
  • 11
  • 1
  • 2
1
vote
1 answer

Pentaho/PDI/Kettle: How to fill "Insert / Update" with values from an Excel-Spreadsheet?

I've got an Excel-Spreadsheet where: Column A is filled with the names of target fields (Table field) Column B provides names of the source fields (Stream field) Column C tells you whether to update the field or not, i.e. Value is either "Y" or…
notAnExpert
  • 123
  • 1
  • 5
  • 15
1
vote
1 answer

Pentaho Data Integration Import large dataset from DB

I'm trying to import a large set of data from one DB to another (MSSQL to MySQL). The transformation does this: gets a subset of data, check if it's an update or an insert by checking hash, map the data and insert it into MySQL DB with an API…
Sukhdev Mohan
  • 13
  • 8
1
vote
0 answers

Pentaho 8.2 : Pentaho never opens after increasing Java Memory

I am using Pentaho 8.2 community edition. I have the common error of Java Heap Memory. According to this forum on other topics which refer this issue, I followed the instructions to increase the memory in the .bat file But when I increase the…
Thanos
  • 11
  • 1
1
vote
1 answer

XPath using Get data from XML - Pentaho

I am calling Xero's API and then, using Get data from XML step. How can I extract Depreciation Expense - 218.8? I've tried /Rows/Row/Cells/Cell/Attributes/. and Rows/Row/Cells/Cell/Value - among other options but they didn't work. And another…
eponkratova
  • 467
  • 7
  • 20
1
vote
1 answer

Pentaho "Make the transformation database transactional" plus commit frequency

By using Make the transformation database transactional property, If I get it right, a single commit is done at the end of the transformation (or rollback if there is an error or an abort) However, the Commit size is still avaiable on the table…
Julio
  • 5,208
  • 1
  • 13
  • 42
1
vote
1 answer

PDI: Is there is a way I can substitute comma separated strings in Table Input SQL where column in?

I'm trying to substitute a comma separated string in the WHERE COLUMN IN query inside table input in PDI. I have a string query = ("car", "bike") and I want to substitute in SELECT * FROM vehicles where item in ?. I tried to pass this string to the…
Puneet Sidhu
  • 95
  • 9
1 2 3
…
29 30