Open Source ETL framework

Question

I was asked to prototype two ETL frameworks. The requirements are as follows:

Open Source
Available to Linux
Maintained
Logs can be viewed on web browser (nice to have)
Written in Perl, Python, Ruby or Java

The raw file can be anything (excel, csv, html page etc..) The target database is MySQL.

Dont just drop names, please indicate the advantages/disadvantages based from your experience.

Thanks!

score 7 · Answer 1 · edited Jan 18 '12 at 09:54

7

One of the most popular Java based ETL would be Talend.

Jaspersoft ETL is another one extended from Talend and has a nice eclipse based UI.

edited Jan 18 '12 at 09:54

daxim

39,270
4
65
132

answered Jan 18 '12 at 03:46

Husain Basrawala

1,757
15
21

thanks, I will evaluate this. – jchips12 Jan 18 '12 at 23:55
It looks like Jaspersoft has stopped the development of Jaspersoft ETL, it last release was in March 2016. – OJVM Sep 11 '18 at 14:02

score 4 · Accepted Answer · answered Jan 18 '12 at 03:55

4

I've used Kettle. It has its own GUI, but if you rather use the API to do the ETL yourself it's also supported. It has proved to be very useful to me and there are a few plugins already available for it.

answered Jan 18 '12 at 03:55

edgarator

296
1
4
17

score 3 · Answer 3 · answered Jan 19 '12 at 08:42

Another option is CloverETL. It is written in Java and there is an open source, LGPL version of its Engine. As well it has a free version of GUI called CloverETL Community.

It can process any of the indicated sources and connects to a number of databases, including MySQL.

Open Source ETL framework

3 Answers3

Linked