Questions tagged [pentaho-data-integration]

Tag to be used for Pentaho Data Integration (all versions). Pentaho Data Integration prepares and blends data to create a complete picture of your business that drives actionable insights.

Pentaho Data Integration prepares and blends data to create a complete picture of your business that drives actionable insights.

It provides intuitive drag-and-drop data integration coupled with data agnostic connectivity spanning from flat files and RDBMS to Hadoop and beyond.

Features:

  • Graphical extract-transform-load (ETL) designer to simplify the creation of data pipelines
  • Rich library of pre-built components to access, prepare, and blend data from relational sources, big data stores, enterprise applications, and more
  • Powerful orchestration capabilities to coordinate and combine transformations, including notifications and alerts
  • Agile views for modeling and visualizing data on the fly during the data preparation process
  • Integrated enterprise scheduler for coordinating workflows and debugger for testing and tuning job execution
825 questions
0
votes
2 answers

Pentaho "Return value id can't be found in the input row"

I have a pentaho transformation, which is used to read a text file, to check some conditions( from which you can have errors, such as the number should be a positive number). From this errors I'm creating an excel file and I need for my job the…
0
votes
2 answers

Generated random value (uuid) in Pentaho as Column value?

I have a transformation in Pentaho which looks like this: This transformation populates a table PRO_T_TICKETS in PostgreSQL. And this table primary key is named OID and has the uuid data type. Here is a snip of my Database Join query: I want to…
0
votes
1 answer

previewing a db2 table failed: org.pentaho.di.core.exception.KettleDatabaseException

Previewing a db2 table through pentaho failed with the following errors, any advice would be appreciated: 2017/09/27 11:27:18 - Carte - Installing timer to purge stale objects after 1440 minutes. 2017/09/27 14:01:59 - C:\Projects\lovebuy\bbb.ktr :…
user6047898
0
votes
1 answer

Pentaho - Draw a target line in bar graph using Pentaho Report Designer

I need to draw a target line as shown in the image using Pentaho report designer in a Pentaho Bar Graph.
0
votes
2 answers

Pentaho Generating report and scheduling mail job with attachment

I am very new in Pentaho. can anyone guide me how to create report in PDF file and sending over mail as attachment on schedule basis using PDI .Any tutorial or demo will help
0
votes
1 answer

Unable to write checkpoint information to logging table

All my jobs running in the repository is failing with the below error 2017/09/22 06:18:52 - job_load - Unable to write checkpoint information to logging table 2017/09/22 06:18:52 - job_load - 2017/09/22 06:18:52 - job_load - Couldn't execute SQL:…
Srini V
  • 11,045
  • 14
  • 66
  • 89
0
votes
1 answer

Conversion of Oracle Query to PostgreSQL

I am posting a part of my query which is in Oracle and it as follows: cast(from_tz(cast((Select max(d.startdate) from Public.result_slalom d where d.eventid = a.eventid and d.modifydate = (Select max(e.modifydate)…
0
votes
2 answers

Remove duplicated row from 2 tables in different database

I have 2 users table in different databases and I would like to get only unique rows from one those tables. On the following example, I need the list of emails which have no duplicate name. I am using Pentaho DI Kettle. Table Users from database…
0
votes
1 answer

Using PostgreSQL with Pentaho

I have created a DB join in one of my Pentaho Steps. I am shifting my environment from Oracle to PostgreSQL. Being totally new to PostgreSQL I am unable to get rid of the bugs. The join is as following: select t.contract, t.calender, …
0
votes
1 answer

User defined JSON input to Expected JSON output using PDI Metadata Injection

I have created a transformation which will read the Flat Json data from a '.js' file and modify the JSON fields(keys) based on the metadata input field names and meta data target field names specified by the user. Also, I am using the ETL Metadata…
BAKS BALA
  • 1
  • 1
0
votes
1 answer

PDI Metadata Injection for JSON Input

Actually, I need to create a transformation which will read the JSON file from the system directory and rename the JSON fields(keys) based on the metadata inputs. Finally, write the modified JSON into '.js' file using JSON output step. This…
BAKS BALA
  • 1
  • 1
0
votes
3 answers

Kettle database lookup case insensitive

I've a table "City" with more than 100k records. The field "name" contains strings like "Roma", "La Valletta". I receive a file with the city name, all in upper case as in "ROMA". I need to get the id of the record that contains "Roma" when I search…
Daniele Licitra
  • 1,520
  • 21
  • 45
0
votes
3 answers

Make a DB INSERT based on Text File Input metadata

I'm developing an ETL and must do some routines for monitoring it. At the begining, I must make in INSERT on DB to create a record informing the filename and starting process datetime. This query will return the record's PK and it must be stored.…
Hikari
  • 3,797
  • 12
  • 47
  • 77
0
votes
2 answers

Continue stream based on result of a DB query

I'm developing an ETL. The first step is a Text File Input, that adds to the stream some metadata from "Additional output fields", including filename and last modified. I must make a query to DB verifying if that filename with that last modified…
Hikari
  • 3,797
  • 12
  • 47
  • 77
0
votes
0 answers

Create report using data from 3 excel sheets sheets in pentaho

I just want to create a report using few excel sheets as the input in pentaho. After creating the report need to send it through email and to be specific the email should be scheduled.