Monitoring disk I/O on hadoop cluster with ganglia

Question

I deployed hadoop 2 (HDP2), and would like to get the disk i/o metrics of my slave nodes in ganglia. I didn't find any relevant metric so far.

What metric do you suggest to use or to add to ganglia ?

Thanks

score 2 · Answer 1 · answered Jan 06 '14 at 07:07

2

You can also use Ganglia Python Module Disk-stat provided here

answered Jan 06 '14 at 07:07

vishnu

Can you explain how to use Ganglia Python Module Disk-stat? Thank you very much . github.com/ganglia/gmond_python_modules/tree/master/diskstat. – gwgyk Jun 30 '15 at 03:32

score 1 · Answer 2 · answered Dec 25 '13 at 08:39

1

cloudera-manager can help monitor the cluster status including Disk I/O

answered Dec 25 '13 at 08:39

zhutoulala

harschware · Answer 3 · 2015-01-24T23:24:38.510

1

As stated by @vishnu: Ganglia Python Module Disk-stat provided here

You can also use gmetric scripts that you would run from cron from here

Finally, you can use collectl and export disk metrics to ganglia, see here

edited Jan 24 '15 at 23:24

answered Jan 24 '15 at 23:19

harschware

1

Can you explain how to use Ganglia Python Module Disk-stat? Thank you very much . https://github.com/ganglia/gmond_python_modules/tree/master/diskstat. – gwgyk Jun 30 '15 at 03:31

3 Answers3