Questions tagged [pentaho-data-integration]

Tag to be used for Pentaho Data Integration (all versions). Pentaho Data Integration prepares and blends data to create a complete picture of your business that drives actionable insights.

Pentaho Data Integration prepares and blends data to create a complete picture of your business that drives actionable insights.

It provides intuitive drag-and-drop data integration coupled with data agnostic connectivity spanning from flat files and RDBMS to Hadoop and beyond.

Features:

  • Graphical extract-transform-load (ETL) designer to simplify the creation of data pipelines
  • Rich library of pre-built components to access, prepare, and blend data from relational sources, big data stores, enterprise applications, and more
  • Powerful orchestration capabilities to coordinate and combine transformations, including notifications and alerts
  • Agile views for modeling and visualizing data on the fly during the data preparation process
  • Integrated enterprise scheduler for coordinating workflows and debugger for testing and tuning job execution
825 questions
0
votes
1 answer

I want to convert string 20171110 to date format yyyy-mm-dd in Pentaho

I have a string "20171110" and I want this to be converted to Date format yyyy-mm-dd of date datatype in Pentaho Data Integration. I tried using select values and calculator but nothing worked. Please suggest.
sneha
  • 169
  • 1
  • 4
  • 11
0
votes
1 answer

How to generate output based on variable in a single spoon transformation?

I am new to pentaho. I am stuck with one issue. I have a spoon transformation. I have an input file with data. Based on the input file, an output file need to be generated. My issue is how to generate output file with different file names based on…
Jince Martin
  • 211
  • 1
  • 3
  • 14
0
votes
1 answer

convert string value in ate format in java script

i have a problem in converting a string date value into valid date format in pentaho-data-itegration .could someone help me to convert string date'08-Mar-2017' into date format (2017-03-08 00:00:00) in pentaho.
0
votes
1 answer

Jenkins Pentaho Error

I have a PDI Kitchen job on my server that I run through a script using Crontab on my Ubuntu 14.04 server and everything runs fine. Now I am trying to schedule it using Jenkins (which is installed in the same server) and I get the following…
0
votes
2 answers

Pentaho - Reuse field Multiple Times in a query

I have a field, item_id, being passed from one transform step to another. I want to use that field multiple times in the next transform step for use in a UNION. select x, y from table1 where item_id = ? UNION select w, z from table2 where item_id =…
ed4becky
  • 1,488
  • 1
  • 17
  • 54
0
votes
1 answer

Error with accents to Run Transformation Kettle Pentaho

I have a problem with accents using pentaho data integration to migrate data from sql server to postgresql but just in some cases increases a one symbol. The data type in Sql Server is type Varchar(MAX) and PostgreSQL is type Text For Example: Sql…
0
votes
1 answer

Output row for each input in a column Pentaho Data Integration Spoon

I am new to Pentaho Data Integration, and I am looking to take the below column data and have an output for each entry in the date columns. Not sure how this can be done in spoon. I have looked into the Denormalisation step, but examples are not…
Clint
  • 93
  • 1
  • 2
  • 7
0
votes
1 answer

Pentaho Flow Input->Output->Input not working

I have a Table Input step that retrieves some data form a table A. Data is passed to an Insert/Update step to a table B. For each row inserted/updated, I want to execute another Table Input on table C using one of the field values passed from the…
ed4becky
  • 1,488
  • 1
  • 17
  • 54
0
votes
1 answer

can't Edit and create new transformation in pentaho data integration

I am new to Pentaho and facing an issue when editing or creating new transformation in spoon. Below are the details of problem. java.lang.NullPointerException at…
0
votes
1 answer

getting error while trying to connect windows pentaho to virtual machines HDFS

i am new to pentaho and bigdata......every time i try to connect my windows pentaho to my Linux based virtual machines HDFS..this error pops up..i'v tried a couple of solutions but haven't had any luck with them....i would really appreciate if any…
usama
  • 1
  • 2
0
votes
1 answer

How should I control the duplication of calculation version using Pentaho?

I have a table result_slalom where data is populated via ETL Jobs of Pentaho. When ETL runs for the first time it creates version-1. Now, if data is changed after new calculations it becomes version-2. I need to make changes only in the…
0
votes
1 answer

Passing SQL query as a Parameter in Pentaho?

There is a Pentaho step where I am stuck. This is my SQL query in one of my Pentaho step: select t.val_1 as Contract, t.val_2 as Service, t.val_3 as Calender, t.val_4 as MSPProvider, t.val_5 as MSPCustomer, …
0
votes
1 answer

Insert Update/Merge/Dimension Lookup/ Update using Pentaho

There is a table 'TICKETS' in PostgreSQL.I perform an ETL job using Pentaho to populate this table. There is also a GUI on which a user makes changes and the result is reflected in this table. The fields in the table are : "OID" Char(36) <------…
0
votes
1 answer

Flatten Invoice Header with Invoice Lines in Kettle

If you have an invoice header with several values (invoice #, date, location) and an unknown amount of invoice lines with several values (product, price, tax), is there a way to flatten this data to one row that extends in cases where the quantity…
0
votes
1 answer

How to get all results from results set in pentaho kettle step Input table?

I have simple transformation consisting of 2 steps. 1 step (Input table) makes query to DB and 2 step (Java class) processes results. 2 step takes much time (it is normal in my case) but after 1 hours I get error of closed results set Server has…
palandlom
  • 529
  • 6
  • 17