Stack Overflow
Stack Overflow

Questions tagged [pentaho-data-integration]

Tag to be used for Pentaho Data Integration (all versions). Pentaho Data Integration prepares and blends data to create a complete picture of your business that drives actionable insights.

Pentaho Data Integration prepares and blends data to create a complete picture of your business that drives actionable insights.

It provides intuitive drag-and-drop data integration coupled with data agnostic connectivity spanning from flat files and RDBMS to Hadoop and beyond.

Features:

  • Graphical extract-transform-load (ETL) designer to simplify the creation of data pipelines
  • Rich library of pre-built components to access, prepare, and blend data from relational sources, big data stores, enterprise applications, and more
  • Powerful orchestration capabilities to coordinate and combine transformations, including notifications and alerts
  • Agile views for modeling and visualizing data on the fly during the data preparation process
  • Integrated enterprise scheduler for coordinating workflows and debugger for testing and tuning job execution
825 questions
0
votes
1 answer

Customize Pentaho Spoon components using Java

I'm still pretty new on Pentaho Soon. I'd like to know if this would be possible to be achieved. In the past I had many bad experiences with SSIS, so I decided at the time to develop my own ETL using C#. In practice, .Net only does the extract step.…
Hikari
  • 3,797
  • 12
  • 47
  • 77
0
votes
2 answers

Generate consecutive rows in Pentaho

How do I generate consecutive rows in Pentaho Spoon? I have a text file and I am using "Sample Rows" step to select every third line from the text file. But the problem with the "Sample Rows" is that I have to manually type "3,6,9,12....". I tried…
Allen BMC
  • 27
  • 1
  • 1
  • 5
0
votes
0 answers

Pentaho report designer ,Could not connect to HTTP server on ''local host''

Pentaho version -- prd-ce-3.9.0-GA (database connection MySQL) I am getting the error Could not connect to HTTP server on ''local host'' I tried with htttps//127.0.0.1:8080/pentaho and htttps//192.7.*.*:8080/pentaho(my local machine IP) but I…
Bilal
  • 17
  • 2
  • 6
0
votes
2 answers

Transition from MS SQL to Pentaho Kettle

I have a few ms SQL scripts which I would like migrate to kettle. Ideally what I would like to do is for each step of the script to be a single step in kettle. But I am finding it difficult to wrap my head around the ms SQL statements and the…
Abdullah Zainul Abidin
  • 65
  • 8
0
votes
1 answer

adding a UUID4 ID to each row in Pentaho

I am inserting the result of a SELECT statement from a relational table into another table using Pentaho, is it possible to add a UUID4 identifier to each row and then insert. Data before insertion : ip country city …
Sarang Manjrekar
  • 1,839
  • 5
  • 31
  • 61
0
votes
3 answers

Pentaho error Required subelement 'user'

I get a error when I try to preview the query: I get this error : ParentException: java.lang.RuntimeException: Required subelement 'user' at org.osjava.sj.loader.convert.DataSourceConverter.convert(DataSourceConverter.java:54) at…
Hayk Manukyan
  • 1
  • 3
0
votes
1 answer

Pentaho report which contains more than 7 connections are not working in pentaho DI server

I am new to pentaho. Recently i created a job which generates some report. I am using JNDI connection in the report(.prpt). If I am using more than 7 connections inside a report, it will fail to generate report but it's working smoothly with reports…
Joyal George
  • 127
  • 10
0
votes
1 answer

reading csv columns dynamically in Pentaho Kettle

If I have a Table Input step with a query such as Select * from myTable and it goes to a User Defined Java Class step, the following code allows me to grab the column names dynamically from the table. RowMetaInterface rowMetaInterface =…
eych
  • 1,262
  • 2
  • 16
  • 37
0
votes
2 answers

How to generate Password Protected output file in Pentaho Data Integration?

Stuck in a strange problem. As per client requirement, I need to generate all text output files in PDI with password-protection. I have implemented PGP encryption and Symmetric cryptography(OpenPGP configured on mysystem). But I am at loss how to…
Vikas Kumar
  • 87
  • 2
  • 18
0
votes
0 answers

I can't see my transformation files (PDI) in Pentaho user console

I have csv files in the local file system that contain output results of a program. I want to use Pentaho CDE to visualize those data in graphs (Pie charts ...) I can do that if I upload my csv files directly as a datasource. But I would like to…
AsmaaM
  • 63
  • 2
  • 3
  • 12
0
votes
1 answer

How to ignore hidden column in MS Excel input in pentaho jobs?

In my source extracts having only 16 columns by default. in my first file having 4 hidden columns between sitename and campaignname. in my second file having 2 hidden columns between sitename and campaignname like wise my all the file columns are…
Velu
  • 57
  • 2
  • 11
0
votes
1 answer

I want to create multi tenancy in pentaho BI?

how to create multi tenancy in pentaho ? How to attached the tenant Id in pentaho session? is there any setting to enable the multi tenancy in pentaho?
Dilip Gavande
  • 11
0
votes
1 answer

Best way to cache data to use among different transformations

I have a transformation that reads millions of ids from a mega data store. I would like to somehow store those ids in a list or hashmap. I have about a dozen other transformations. Each of those transformations gets input data (ids) from other…
eych
  • 1,262
  • 2
  • 16
  • 37
0
votes
1 answer

How to call same job twise in pentaho job with different parameter?

I am creating pentaho jobs In first set variable box i am passing value sysdate the first dfp job working perfectly. In second set variable box i am passing value sysdate+1 ,so sysdate+1 file is picked correctly to process but second dfp job only…
Velu
  • 57
  • 2
  • 11
0
votes
2 answers

How to copy files in local folder to sftp using pentaho copy file step

I have to copy the files in local folder to sftp location using pentaho. i have tried with "copy step"step from spoon jobs by providing local path in file/folder source path and sftp details file/folder destination. while executing i am getting…
user3625039
  • 1
  • 1
  • 3
1 2 3
…
54 55