Questions tagged [pentaho-data-integration]

Tag to be used for Pentaho Data Integration (all versions). Pentaho Data Integration prepares and blends data to create a complete picture of your business that drives actionable insights.

Pentaho Data Integration prepares and blends data to create a complete picture of your business that drives actionable insights.

It provides intuitive drag-and-drop data integration coupled with data agnostic connectivity spanning from flat files and RDBMS to Hadoop and beyond.

Features:

  • Graphical extract-transform-load (ETL) designer to simplify the creation of data pipelines
  • Rich library of pre-built components to access, prepare, and blend data from relational sources, big data stores, enterprise applications, and more
  • Powerful orchestration capabilities to coordinate and combine transformations, including notifications and alerts
  • Agile views for modeling and visualizing data on the fly during the data preparation process
  • Integrated enterprise scheduler for coordinating workflows and debugger for testing and tuning job execution
825 questions
3
votes
2 answers

Error connecting with SAP ERP System with Pentaho ETL tool

I am trying connect SAP ERP System with Pentaho Data Integration tools by required properties. As like below image. But didn't connect with SAP ERP System. If I click on Test button then nothing saying. But, If I try to execute query then showing…
Badrul
  • 921
  • 1
  • 7
  • 16
3
votes
1 answer

Get valid date range. Minimum and maximum

I need to get the values of a table by validity range. Currently I make a group by the columns of the table and I make a min and max about the year; but this gives me the wrong result for the case of the example. I would need to solve it with…
3
votes
2 answers

MySQL Pentaho communication link error ETL

When trying to load one month data from DW by the last day of the month or second last day of the month, while loading the data, communication link error comes and it stops the running job. due to this last few set of data is not loading. About…
Sathish D
  • 4,854
  • 31
  • 44
3
votes
1 answer

How can I replace the value of a field(s) based on another field(s) in Pentaho

I need to replace some values that I get from a database with the values of another field (same database), providing the other field is populated. In my database I have the following fields (amongst others): RMM, RMY, IRM, IRY If IRM is populated I…
J.A
  • 41
  • 2
  • 6
3
votes
2 answers

blocking Step vs Block this step until steps finish in Pentaho transformation

What is the use case of blocking step in Pentaho Transformations ? In which scenarios we will be using this step in Pentaho transformations. I understood that "block this step until steps finish steps" is to control synchronization by configuring…
Rams
  • 729
  • 10
  • 11
3
votes
0 answers

Pentaho PDI: Metadata related Null Pointer Exception in Scripting task

Using Pentaho PDI 6, with: A) CSV Input on .csv (4 row .csv from IBM), with ASCII file encoding (preview rows works fine) connected to B) CPython Script Executor, installable from Tools -> MarketPlace. Assumes Python, Pandas, Numpy installed. Script…
Kwame
  • 752
  • 7
  • 19
3
votes
3 answers

Kettle: How to get max date for each group of rows

I'm reading an excel sheet using Kettle and this sheet has three fields: code, description and date. Example: 1 - description A - 01/JAN/2013 2 - description A - 15/JAN/2013 3 - description A - 04/JAN/2013 4 - description B - 02/JAN/2013 5 -…
rafaelim
  • 644
  • 6
  • 13
2
votes
2 answers

Pentaho Data Integration (PDI) 9.4 Marketplace missing, how to install Plugin now?

I've just installed Pentaho Data Integration (PDI) version 9.4 (Community Edtition). I'm following this guide to install the new Plugin. The problem is I don't have "Marketplace" in "Tools -> Marketplace" like the guide said (the Show plugin…
2
votes
1 answer

Pentaho Data Integration not working with Openjdk 16

After upgrading from openjdk 15 to openjdk 16, pentaho data integration (version pdi-ce-9.1.0.0-324) throws a java class error. To reproduce the error message download and install openjdk 16 from…
2
votes
2 answers

Pentaho treating empty string as null

Hello i'm particularly new to pentaho and why when the table_input has an empty string, and when do insert to table_output the data becoming null for example in the table input ID|name 1|dan 2| 3|itzy 4|kim 5|(null) i do preview my query, and it's…
2
votes
0 answers

PDI transformation does not send messages to Kafka server

I have a transformation in Pentaho Data Integration (PDI) that makes a query to NetSuite, builds JSON strings for each row and finally these strings are sent to Kafka. This is the transformation: When I test the transform against my local Kafka it…
2
votes
0 answers

Pentaho PDI on Ubuntu 18

I have Pentaho setup and running on Windows 10, I am planning to migrate to Ubuntu. Has anyone setup Pentaho on Ubuntu 18.04? If yes, what is the configuration you are using? Pentaho documentation says mentions Ubuntu 14 and 16 to be used and are…
2
votes
1 answer

Error installing Pentaho Data Integration (PDI, Kettle) on Mac OS Catalina

When I try to run PDI on Mac OS Catalina I get this error: App Transport Security has blocked a cleartext HTTP (http://) resource load since it is insecure. Temporary exceptions can be configured via your app's Info.plist file. I have tried to…
Airton Gessner
  • 215
  • 2
  • 11
2
votes
1 answer

How to convert string to date type in the Pentaho?

I am try to convert string value to date. The string has this format : yyyy-MM-dd. But when I try to convert using select values (in meta-date I selected fildname, type = Date and currency = dd/MM/yyyy I got this error : String : couldn't convert…
Beto
  • 579
  • 1
  • 5
  • 15
2
votes
0 answers

Pentaho Spoon: Pass variable to MongoDB input

I'm trying to create a Job which is suppose to : Get me the maxID in a MongoDB collection Give me all documents from another collection verifying id < maxID In the first transformation I retrieve the maxID and set the…
1
2
3
54 55