Questions tagged [pentaho-data-integration]

Tag to be used for Pentaho Data Integration (all versions). Pentaho Data Integration prepares and blends data to create a complete picture of your business that drives actionable insights.

Pentaho Data Integration prepares and blends data to create a complete picture of your business that drives actionable insights.

It provides intuitive drag-and-drop data integration coupled with data agnostic connectivity spanning from flat files and RDBMS to Hadoop and beyond.

Features:

  • Graphical extract-transform-load (ETL) designer to simplify the creation of data pipelines
  • Rich library of pre-built components to access, prepare, and blend data from relational sources, big data stores, enterprise applications, and more
  • Powerful orchestration capabilities to coordinate and combine transformations, including notifications and alerts
  • Agile views for modeling and visualizing data on the fly during the data preparation process
  • Integrated enterprise scheduler for coordinating workflows and debugger for testing and tuning job execution
825 questions
0
votes
0 answers

Deleting records from fact table and dimension table

I want to delete records from target table as records deleted from a source. I used merge/rows and delete stop both individuals, but I solved my problem in delete case when I deleted record from source. Then, after transformation fact table had only…
Adil
  • 11
  • 4
0
votes
1 answer

Schedule reports in Pentaho user console

How to schedule reports in Pentaho User Console. Also let me know how to email scheduled reports particular address in Pentaho User Console.
0
votes
1 answer

Add an Update SQL Query on a Pentaho Kettle Transformation

I have a scenario where I would like to run an update script after a table input and table output job, can anyone assist? I have tried these four but I can't seem to figure out how to make them work. My Current Transformation Here's the…
0
votes
1 answer

Converting string to integer with "%" special character in Pentaho

Hi I am facing an issue while converting string value to integer. Actually I am reading data from the table and there are fields like 39% and they are string data type. Now i want to convert them into INteger datatype and load them in to another…
user8922081
0
votes
1 answer

Scheduling job in Pentaho BI server

I am using a pentaho community edition 7. I want to schedule a JOB with two sub transformations in it. I want to schedule it to run on every monday. Can anyone please guide me in saving the files using the correct filepaths and schedule them from BI…
user8922081
0
votes
1 answer

Converting Time into Minutes in Pentaho (PDI Script)

I want to calculate sum of activity time(HH:mm:ss) for various transactions in PDI. For example, consider 3 activity times: 1) Activity 1 - 01:22:03, 2) Activity 2 - 01:10:11 and 3) Activity 3 - 00:22:20. The sum of all this time should be…
0
votes
1 answer

Slave server option not visible in Spoon

In my company we have an Hadoop based ETL solution. These are some of the steps being invoked in our data-flow: Exporting data from SQL Server Importing into Hive Applying transformations etc Storing processed data into Solr Our goal is to be…
abiratsis
  • 7,051
  • 3
  • 28
  • 46
0
votes
1 answer

Errors relating to date data type using Pentaho Spoon

I am reading a CSV file with information about tweets using Spoon. There is a created_at field at which time the tweet was sent. However, the format is varied, with some examples being 'yyyy/MM/dd HH:mm', 'yyyy-MM-dd HH:mm', 'MM/dd HH:mm' and…
AshNaz87
  • 376
  • 3
  • 14
0
votes
2 answers

Merge two mongo collections with query condition in pentaho

I have a problem querying two collections and combining the results to form another collection. Collection1: { "ResourceCost" : 0.0032258065, "ResourceId" : "i-08c35f123eea43f30", "Unit" : "USD", "billdate" :…
0
votes
2 answers

Pentaho: Getting only one in row from JSON input file

I am getting one JSON file from SFTP and trying it to insert into oracle but in the preview section i am getting only one row and only one row inserting into table. I already tried to modify to number to preview rows to 10000 but nothing working…
Tejas
  • 11
  • 4
0
votes
1 answer

Extract mail attachment and move to a target folder

My customer wants to send an excel data file (.xlsx) via Outlook mail. And I wish to extract this attachment and put it in a folder on the 'network' for further processing. I wish to use Pentaho for this process. Mail comes --> Attachment Extracted…
0
votes
1 answer

AccessDenied error while connecting AWS S3 using Pentaho

enter image description here Please see the screenshot- I am new to Pentaho and AWS S3. I am trying to download a file from Amazon S3 using Pentaho but getting the following error:- org.jets3t.service.S3ServiceException: S3 GET failed for '/' XML…
0
votes
1 answer

Pentaho multiple type conversion from CSV

I have tried pentaho for loading csv file and storing into Database. One of the column in CSV have multiple type values say 2.7777777777777E-06, 0, 2222, 2 , 35.023 My transformation doesn't support type conversion. Please help me for getting this…
0
votes
1 answer

carte server error with german umlaut

I am running the community edition from pentaho with Version 7.1 and i am facing a problem which i can't solve. I have a transformation where i use german umlaut like ä, ö, ü because i read in text or define text which contains this letters.…
0
votes
2 answers

Pentaho Import uniqe records into database

I am quite new to Pentaho Spoon and I would like to import records of an csv file to an database table. However, only unique records should be imported into the database table. That is why I need to compare EACH record with all records of the…