Stack Overflow
Stack Overflow

Questions tagged [pentaho-data-integration]

Tag to be used for Pentaho Data Integration (all versions). Pentaho Data Integration prepares and blends data to create a complete picture of your business that drives actionable insights.

Pentaho Data Integration prepares and blends data to create a complete picture of your business that drives actionable insights.

It provides intuitive drag-and-drop data integration coupled with data agnostic connectivity spanning from flat files and RDBMS to Hadoop and beyond.

Features:

  • Graphical extract-transform-load (ETL) designer to simplify the creation of data pipelines
  • Rich library of pre-built components to access, prepare, and blend data from relational sources, big data stores, enterprise applications, and more
  • Powerful orchestration capabilities to coordinate and combine transformations, including notifications and alerts
  • Agile views for modeling and visualizing data on the fly during the data preparation process
  • Integrated enterprise scheduler for coordinating workflows and debugger for testing and tuning job execution
825 questions
0
votes
1 answer

How to connect the QuickBooks (QODBC) data through Pentaho (Kettle) for ETL?

I am trying to connect the QuickBooks (QODBC) application data through Pentaho (Kettle) for ETL process. Would like to know how can we connect the QuickBooks (QODBC) application data through Pentaho.
Rajasekaran M
  • 163
  • 2
  • 16
0
votes
2 answers

How to Enable Logging to a Text file for the Entire job with sub jobs in it in Pentaho

I am trying to store the logs of a Pentaho job that has 10 sub jobs and transformations inside it. I know i can do individually for each job and transformation by going into the settings and writing them to a text file. But i don't want too many…
Ujjwal Chowdary
  • 125
  • 2
  • 5
  • 18
0
votes
1 answer

Missing Step Plugin in Linux Environment Pentaho

I created a transformation with a mongoDBOutput which I run from my Java application. I edited my kettle.properties to add KETTLE_PLUGIN_BASE_FOLDERS as explained here Java Pentaho Exception MongoDB. This works fine on my windows machine. However,…
Winnie
  • 89
  • 2
  • 9
0
votes
1 answer

Get a value of the kettle pentaho flow

I'm working with the pentaho data integration, Spoon. Short description: I want to get the number of times a value has appeared in the flow for each line that reads from the flow. Long description: I am doing the transformation of the fact table,…
Alejandro Reina
  • 273
  • 1
  • 3
  • 10
0
votes
1 answer

How to make a step in pentaho transformation runs twice or more in a day?

I have 1 transformation that contains multiple steps. I want to run one of them twice in a day (every 12 hours). Any idea to make it?
Sandy
  • 210
  • 3
  • 16
0
votes
1 answer

Pentaho Data Integration (Spoon) Value Mapper Wildcard

Is there a wildcard character for the Value Mapper transformation in Pentaho Spoon? I've done some digging and only found wildcard solutions for uploading files and documents. I need to be able to map any and all potential values that contain a…
Pat
  • 1
  • 1
  • 1
0
votes
1 answer

How to speed up the data fetching from oracle database to pentaho data integration?

I am using pentaho data integration 5.4.1.130 and Oracle 12c. I have successfully connected oracle database using ojdbc7.jar (using jre 1.7.0.51 for pentaho). But when I tried to preview a table from oracle database in transformation, I'm getting…
Kannas Somasundar
  • 33
  • 1
  • 1
  • 5
0
votes
2 answers

Postgres to Json. Pentaho 7.0 ( Data Integration)

I make a query to a database of postgres and I bring two fields, "USER" and "CREATED" (DATE) I extract the year from the creation date, and then it is traversing the records and according to the year and the user create the new json object And I…
Jose
  • 47
  • 7
0
votes
1 answer

Pentaho Kettle (PDI) table input step with field substitution running slower than using literal

I'll go straight to the point. I have a table input step, which reads records with a query that includes a where clause, as follows: SELECT * id, name, surname, creation_date FROM users WHERE creation_date > ? If a put a literal (i.e.…
vantesllar
  • 469
  • 4
  • 13
0
votes
1 answer

Named Parameters not being substituted in Pentaho Mongo Input Query Expression

I have created a transformation in Pentaho Kettle where I am pulling some data from Mongo Collection, via Mongo Input, but the problem I am facing is I have created two named parameters in the same transformation and they are not being replaced in…
andy
  • 41
  • 1
  • 8
0
votes
0 answers

Named Parameters not being replaced in Pentaho Table Input

I have created a transformation in Pentaho Kettle (5.2 CE), and it is pulling some table data from a data source and dumping into a destination data source. In input table query I am using two named variables (para1 and para2): select col1,…
andy
  • 41
  • 1
  • 8
0
votes
1 answer

Pentaho Wirting to Microsoft Excel

I am using Pentaho to query an Oracle database. My sql and query has worked fine and returned results. However when I add the step of Microsoft Excel Output, it does not output any data that happens to be a time stamp. When I go to the step and…
user4816679
0
votes
4 answers

Order step metrics in Pentaho Data Integration

I´m working on a rather long Transformation in Kettle and I put some Steps in the middle of the Flow. So now my Step metrics are all scrambled up and very hard to read. Is there any way i could sort this to be in order (with the direction of the…
coffee_bear
  • 31
  • 1
  • 8
0
votes
0 answers

XBASE-Input -> com.linuxense.javadbf.DBFException: Failed to parse Number: multiple points

I have a problem with the "Extract from XBase File" ste in pentaho data integration I can't extract file content and I have this error : 2017/03/10 10:01:14 - Extraction depuis Fichier XBase.0 - ERROR (version 7.0.0.0-25, build 1 from 2016-11-05…
Akino
  • 303
  • 1
  • 4
  • 16
0
votes
3 answers

Concat each n rows in pentaho

I am trying to form a transformation where I need to concatenate each 10 row value. 1st step: Table input (query from Postgres DB: select id from tablename) sample result from the above query: id …
Arunraj
  • 558
  • 5
  • 21
1 2 3
…
54 55