Stack Overflow
Stack Overflow

Questions tagged [pentaho-data-integration]

Tag to be used for Pentaho Data Integration (all versions). Pentaho Data Integration prepares and blends data to create a complete picture of your business that drives actionable insights.

Pentaho Data Integration prepares and blends data to create a complete picture of your business that drives actionable insights.

It provides intuitive drag-and-drop data integration coupled with data agnostic connectivity spanning from flat files and RDBMS to Hadoop and beyond.

Features:

  • Graphical extract-transform-load (ETL) designer to simplify the creation of data pipelines
  • Rich library of pre-built components to access, prepare, and blend data from relational sources, big data stores, enterprise applications, and more
  • Powerful orchestration capabilities to coordinate and combine transformations, including notifications and alerts
  • Agile views for modeling and visualizing data on the fly during the data preparation process
  • Integrated enterprise scheduler for coordinating workflows and debugger for testing and tuning job execution
825 questions
0
votes
1 answer

Pentaho kettle denormalizer or concat

I have one step that I need to concat x rows into one separated by coma or similar. I have this data on my final step: I need to have the "tarifas" row in the same column with the 5 diferent "tarifas" for the same "REFERENCIA" :…
Gerard Luque
  • 163
  • 2
  • 13
0
votes
0 answers

Postgres idle connections - Jobs running using Pentaho

I use Postgresql for my database and jobs are run regularly with the help Carte servers (Pentaho BI tool). Recently, I've realized there are a lot of idle connections to postgresql, preventing the new jobs that I'm creating to connect to the DB. I…
Sri Sanagavarapu
  • 1
0
votes
1 answer

Pentaho Data Integration: convert number string without separator to decimal

I'am reading a fixed lenght file with "Text File input" step. In a position i have a number, let's say: 0000001234 I need to read this number like 1,234, with 3 decimal values. There is an option to do that? I'have tryed with precision and decimals…
Daniele Licitra
  • 1,520
  • 21
  • 45
0
votes
1 answer

Pentaho Data Integration : Combination Lookup/Update : Not all rows inserted

My question is simple, I want to know why not all my rows inserted to my PostgresDB. Because I need all rows inserted. The step (Combination L/U) is got succeeded with green tick mark. Shouldn't the step got red tick mark on it if it's not…
blackgee
  • 15
  • 1
  • 6
0
votes
1 answer

How to run a select sql statement within a field in the Pentaho?

I have a table with a 'query' field containing a select sql and another 'parameters' field containing the sql parameters. I have merged these two fields into a new field containing a correct select sql statement. Now I need to execute this new field…
Carlos Lindberg
  • 23
  • 5
0
votes
1 answer

CDA kettle over kettleTransFromFile diffren behaviour vs Pentaho Data Integration

I create in pentaho server a form using CDE. This form is a table with some input fields. On button click is generate an array which is send as parameter value. IN db table i have 3 columns: alfa, beta, gamma. //var data = JSON.stringify(array); var…
DGA
  • 258
  • 3
  • 15
0
votes
4 answers

Pentaho Data Integration (PDI) How to use postgresql bulk loader? My transformation running forever

I'm new to PDI, im using PDI 7, i have excel input with 6 rows and want to insert it into postgresDB. My transformation is : EXCEL INPUT --> Postgres Bulk Loader (2 steps only). Condition 1 : When i Run the transformation the Postgres Bulk Load not…
blackgee
  • 15
  • 1
  • 6
0
votes
1 answer

What is difference between Pentaho DI "variables" and "fields"?

Could not find much information about this. I can see that fields can have multiple copies per row in a transformation. But what are variables? Are they unique across all rows a transformation produces? But, by the name, variables are meant to…
Akshay Lokur
  • 6,680
  • 13
  • 43
  • 62
0
votes
1 answer

Java Pentaho Exception MongoDB

I have designed a transformation in Pentaho Data Integration ui tool and wrote a java code to execute the transformation. I followed below resources link as it is, try { /** * Initialize the Kettle Enviornment */ …
Thusira Dissanayake
  • 153
  • 1
  • 4
  • 15
0
votes
2 answers

How to execute X times a Job Executor step

Introduction To keep it simple, let's imagine a simple transformation. This transformation gets an input of 4 rows, from a Data Grid step. The stream passes through a Job Executor, referencing to a simple job, with a Write Log…
Kapusch
  • 287
  • 1
  • 13
0
votes
1 answer

How to launch two jobs simultaneously after the execution of one Job in Pentaho

I have a Main Pentaho job that has three jobs Job1, Job2 and Job3 in it. I want to execute Job2 and Job3 as soon as Job1 is finished. I tried to do it, but Pentaho executes Job2 first and then Job3 in the last. Is there any way that both the jobs…
Ujjwal Chowdary
  • 125
  • 2
  • 5
  • 18
0
votes
2 answers

curl doesn't work from Pentaho Data Integration but it does in the terminal

I would like to execute the following curl from a transformation using the Execute a process step: curl -k --basic --user "user:pass" -d "input.string=\"{\"parameter\":3}\""…
José Carlos Guevara Turruelles
  • 481
  • 8
  • 23
0
votes
3 answers

How to use Pentaho Spoon to rename files that do not have an extension

I am new to using Pentaho Spoon. I have about 100 text files in a folder, none of which have file extensions. I have found that if I create a job and move a file, one at a time, that I can simply rename that file, adding a .txt extension to the…
FunkyLikeLeeDorsey
  • 3
  • 1
  • 4
0
votes
1 answer

Pentaho Data Integration - Running a transformation with pan.bat

I am trying to make a batch file to schedule it on Windows Task Scheduler to run a Pentaho Data Integration transformation with pan.bat The thing is that I run successfuly each line of the code below, but when I try to run the batch file, it does…
Alexandre Ribeiro
  • 1,384
  • 1
  • 13
  • 19
0
votes
1 answer

About component "Note" : how should I use the "Raise" and "Lower" options

I'm using Pentaho DI ETL from a few weeks ago, and as in Talend DI ETL, there is the possibility to use a component "Note". This is quite useful to distinguish the main features of a job, and bring more informations at the first overview when…
Kapusch
  • 287
  • 1
  • 13
1 2 3
…
54 55