2

Is there any way to handle load balancing in Pentaho ETL Servers? PDI should be able to handle switching of the servers once the memory increases more than the set target to a new server without having to fail or restart the job. A feature quite similar to Informatica powercenter.

I know we can cluster the data in PDI and also load balancing of server are usually done in the server side. Is it possible to do the same from a PDI point of view?

[Note: Apologies if you think this question is broad.]

Rishu Shrivastava
  • 3,745
  • 1
  • 20
  • 41

1 Answers1

0

I found a document in their enterprise edition support saying,

As of now dynamic load balancing and fail over features are not supported with PDI server.

But I think you can do jobs & transformation level clustering. I found several URLs which might help you.

creating-clustered-transformations

partitioning-data-on-clustered-pentaho

clustering-in-kettle

How to build a simple PDI cluster

Create Carte Clusters

And also alternatively you can have dynamic load balancing and fail over feature on the database server side rather than on PDI server.

Marlon Abeykoon
  • 11,927
  • 4
  • 54
  • 75
  • Sorry @Marlon i was not looking for this answer. I know how to build in cluster in PDI and scale the data across. Rather i would like to know how to handle high availability and load balancing of jobs and data. – Rishu Shrivastava May 16 '16 at 21:11