Data Mining open source tools

Question

I'm due to take up a project which is into data mining. Before I jump in I wanted to probe around for different data mining tools (preferably open source) which allows web based reporting. In my scenario the data would be provided to me, so I'm not supposed to crawl for it.

In a nutshell, I am looking for a tool which does - Data Analysis, Web based Reporting, provides some kind of a dashboard and mining features.

I have worked on the Microsoft Analysis Services and BOXI and off late I have been looking at Pentaho, which seems to be a good option.

Please share your experiences on any such tool which you know of.

cheers

One more point - I would like a tool which can interface well with either .NET code or even Python. — Arnkrishn, May 07 '09 at 17:17

score 12 · Answer 1 · answered May 07 '09 at 16:55

12

I believe WEKA is the best open source DM software out there.

Check it: http://www.cs.waikato.ac.nz/ml/weka/

answered May 07 '09 at 16:55

Alix Axel

151,645
95
393
500

But only for classification, a subtopic of data mining. – Has QUIT--Anony-Mousse Mar 10 '12 at 13:17

ybakos · Answer 2 · 2010-10-21T22:17:06.033

9

Weka is great, but you might want to try the Orange Data Mining toolkit instead.

http://www.ailab.si/orange/

Edit: And as of November 2010, I must say I really like KNIME.

edited Oct 21 '10 at 22:17

answered Sep 10 '09 at 04:15

ybakos

8,152
7
46
74

2

+1 for KNIME. I discovered this a few weeks ago, and have been very impressed with what it can do. Supports Java, Python, and R scripts, and the BIRT add-on makes writing reports a breeze. – Patrick Cuff Jan 20 '11 at 12:08

Shane · Answer 3 · 2009-10-31T17:22:14.763

R has a lot of excellent packages related to data mining. In particular, look at:

It also ties into Weka (see the RWeka package). And it can be integrated with either .Net (through COM) or Python (through RPy or RPy2).

I would agree regarding Pentaho for a reporting platform, although it's a very large project depending upon what you're using it for.

score 5 · Answer 4 · answered Mar 09 '10 at 15:45

5

You should also check out Apache Mahout . It can be quite useful for some large-scale machine learning tasks such as user clustering.

answered Mar 09 '10 at 15:45

random.bit

59
1
1

The Apache licence is the biggest plus, because other mentioned libraries use GPL that prohibits commercial use cases – TomR Apr 08 '15 at 20:42

score 5 · Answer 5 · edited May 31 '11 at 21:31

5

RapidMiner is my preferred data mining tool.

edited May 31 '11 at 21:31

Andrei Sfat

8,440
5
49
69

answered May 31 '11 at 08:48

Trevor Kemmer

59
1
1

score 3 · Answer 6 · answered Nov 03 '10 at 04:11

I would try with the new google tools.

-first you need to get the api id for the google-storage, which is where you are going to store and manipulate the data you are going to analyze.

-Then you need to get the api id for google-prediction-api (http://code.google.com/apis/predict/docs/getting-started.html), which for what I saw it is a fantastic outsourced data mining processor. The Prediction API allows you to get more from your data and makes its patterns more accessible. Besides using traditional numeric and nominal data you can also use text data that thanks to this api can be utilized for exampled to categorize emails by language.

-Finally you can use bigQuery that will allow you to perform Ad-hoc analysis, Standardized reporting, Data exploration App prototyping (http://code.google.com/apis/bigquery/)

score 3 · Answer 7 · answered Feb 12 '12 at 08:31

3

KEEL (http://keel.es) is written in Java and is good for using evolutionary computation for data mining.

answered Feb 12 '12 at 08:31

aliassaila

83
1
4

score 2 · Answer 8 · answered May 07 '10 at 09:53

Have a look at list of Open Source software's for Machine learning maintained by JMLR. you can find it here:

http://mloss.org/software/

http://jmlr.csail.mit.edu/mloss/

They represent State of Art!

My issue with Weka is that a number of algorithms in it are outdated.

score 2 · Answer 9 · answered Oct 06 '10 at 11:00

2

i believe RapidMiner is an excellent tool that should be added to this list.

answered Oct 06 '10 at 11:00

mariana soffer

1,853
12
17

score 2 · Answer 10 · answered Feb 24 '12 at 08:07

2

WEKA (Already mentioned), Orange (http://orange.biolab.si/), Tanagra (http://data-mining-tutorials.blogspot.com) you can find good tutorials there.

Are very good tools for data mining.

answered Feb 24 '12 at 08:07

codious

3,377
6
25
46

Phil · Answer 11 · 2015-04-08T23:11:28.160

2

You could check my software, the SPMF data mining framework.

It is an open-source Java software that offers more than 70 algorithms for:

frequent itemset mining,
association rule mining,
sequential pattern mining
sequential rule mining.
and more..

edited Apr 08 '15 at 23:11

answered Mar 05 '12 at 04:24

Phil

3,375
3
30
46

score 1 · Answer 12 · answered Sep 18 '09 at 20:40

1

Pentaho is a very professional solution. Definitely a very good choice.

answered Sep 18 '09 at 20:40

Pascal Thivent

562,542
136
1,062
1,124

score 1 · Answer 13 · answered Jan 04 '10 at 13:29

1

You can look at Data Mining SDK and its blog.

answered Jan 04 '10 at 13:29

sashaeve

9,387
10
48
61

score 1 · Answer 14 · answered Mar 02 '10 at 14:04

1

A list of some open source data mining tools are listed here: http://dataminingtools.net/browse.php

answered Mar 02 '10 at 14:04

Datakid

11
1

score 1 · Answer 15 · answered Mar 09 '10 at 16:00

1

Eclipse BIRT http://www.eclipse.org/birt/phoenix/project/description.php

answered Mar 09 '10 at 16:00

crowne

8,456
3
35
50

score 1 · Answer 16 · answered Jun 07 '10 at 03:36

1

I believe KNIME deserves to join this list as well.

answered Jun 07 '10 at 03:36

radek

7,240
8
58
83

score 1 · Answer 17 · answered Nov 25 '11 at 17:57

Weka is strong for classification and /machine learning/. To many, this is considered to be more a part of artificial intelligence than of actual data-mining. RapidMiner is largely along the same lines, but with a much nicer UI. Pentaho is the professional support for Weka AFAICT.

You might want to have a look at ELKI, http://elki.dbs.ifi.lmu.de/ which is a comparable project that focuses on clustering algorithms and outlier detections, two other key tasks of data-mining.

score 0 · Answer 18 · answered Mar 09 '10 at 15:41

you can take a look at data mining tool, weka

Here is a link to a collection of tutorials and videos on WEKA Tutorials:http://www.dataminingtools.net/browsetutorials.php?tag=weka

Videos: http://www.dataminingtools.net/videos.php?id=6

score 0 · Answer 19 · answered Dec 29 '10 at 13:11

Along with the tools, i would strongly suggest learning Python and R. These languages help a lot during analysis. Also, large datasets can be 'custom-analysed'. You might also create your own custom dashboard using Javascript(check out the numerous charting and visualization libraries)

score -1 · Answer 20 · answered May 07 '09 at 18:36

-1

I am a python-er myself and I have to say:

Yes! All of that can be done in Python.

I last played around with Beautiful Soup[0]. It's a really simple to use module that lets you grab/mine data from html and xml (excellent for 'screen scraping').

If you dont know python, .... well It's really easy to learn.

[0]http://www.crummy.com/software/BeautifulSoup/

answered May 07 '09 at 18:36

machinaut

495
2
4
17

1

Data mining is all about discovering "hidden" knowledge in data, it has nothing to do (at least directly) with screen scrapping, but thanks for pointing me at Beautiful Soup, I'll play around with it. =) – Alix Axel May 08 '09 at 02:08
1

**All of it can be done in ASSEMBLER, too!** – Has QUIT--Anony-Mousse Dec 23 '11 at 07:28

Data Mining open source tools

20 Answers20

Linked