Questions tagged [ganglia]

Ganglia is a scalable distributed system monitor tool for high-performance computing systems such as clusters and grids. It allows the user to remotely view live or historical statistics (such as CPU load averages or network utilization) for all machines that are being monitored.

Ganglia is based on a hierarchical design targeted at federations of clusters. It relies on a multicast-based listen/announce protocol to monitor state within clusters and uses a tree of point-to-point connections amongst representative cluster nodes to federate clusters and aggregate their state. It leverages widely used technologies such as XML for data representation, XDR for compact, portable data transport, and RRDtool for data storage and visualization.

References

153 questions
2
votes
1 answer

AWS Toolkit for Eclipse : Running AwsConsoleApp issue?

I'm new to AWS, When I try to run AwsConsoleApp.java in eclipse, I'm getting the following error. I have set the access-id and secret-key properly. =========================================== Welcome to the AWS Java SDK! …
Prabhu
  • 840
  • 11
  • 28
2
votes
1 answer

Ganglia gmetad throw segfault error

Has anyone setup Ganglia for metrics collection on a production system? We are using Ganglia version 3.1.7-3.el6 on RHL 6.3 on Amazon (in unicast mode) with RRD tool 1.4.7-1.el6. We are facing major stability issues and Gmetad seems to go down quite…
snehaso
  • 51
  • 1
2
votes
1 answer

How do I change RRDTool graphs?

I'm starting to use Ganglia, which uses rrdtool which are great tools! I would like to change the way of charts, graphs are generated, 'cause I would like to generate charts with HighCharts. RRDTool generates an img which I can change the way it's…
Valter Silva
  • 16,446
  • 52
  • 137
  • 218
2
votes
2 answers

Graphite - Multi archives level retrieval issue

I've configured my files with the following retentions settings: retentions = 10s:7d,1m:30d,5m:1y And this indeed works, however my problem is that the web-app decides to get the data from the lower archive instead of the higher. For…
Tomer Peled
  • 3,571
  • 5
  • 35
  • 57
2
votes
0 answers

out of the box ganglia setup to monitoring yammer-metrics

I don't know anything about ganglia and I would like to know if a setup already exists to monitor yammer-metrics from the servlet Thanks
futoshita
  • 151
  • 1
  • 5
2
votes
2 answers

How to set up alerts on Ganglia?

How can I set up Ganglia so that I get an email if a machine in the cluster is using, for example, greater than 95% of physical RAM?
1
vote
2 answers

Plot a Ganglia graph using AngularJS

I would like to plot a graph in AngularJS, using Highcharts, to be something like this: This graph represents the load of a server in the last hour. So the datapoints given, contains a point and epoch time. The data is received in a JSON format,…
CleverDev
  • 487
  • 6
  • 14
1
vote
1 answer

Ganglia-web how-to add favicon

I cant't add favicon in Ganglia-web Ganglia-web use dwoo templates, and i not found tag in default index.php
zersh
  • 136
  • 5
1
vote
2 answers

Ganglia Metric Value Decay To Zero

I am sending metrics to Ganglia using Gmetric once every 5 minutes. But if the cron task that is sending the metrics is not working, I would expect the metric value on the Ganglia graph to go to zero, whereas it stays at its last updated value. Is…
daniyalzade
  • 981
  • 3
  • 8
  • 19
1
vote
1 answer

XGBoost does not use enough all resources while running Spark in AWS EMR

I'm trying to make a binary classification on a big dataset (5million rows x 450 features) using XGBoost Spark lib in AWS EMR. I've attempted setting many different configurations like: Number of XGboost workers, nthreads, spark.task.cpus,…
1
vote
1 answer

EMR cluster monitoring configuration: Ganglia + InfluxDb

i have an EMR cluster. It is set up by terraform script resource "aws_emr_cluster" "emr-test" { name = "emr-test" applications = [..., "Ganglia", ...] ... } I would like to integrate ganglia with influxDb+Grafana. Found an example of…
Natalia
  • 4,362
  • 24
  • 25
1
vote
0 answers

Ganglia Web does not show status of other nodes, only shows the meta node. Possible reasons?

I have 3 machines in my HDFS cluster: pr2 is the meta node, and pr1 and pr3 are the other 2 nodes. I want to monitor them with ganglia web. To that end, Ganglia (with both gmetad and gmond) has been installed on all 3 nodes, and ganglia web has been…
Kristada673
  • 3,512
  • 6
  • 39
  • 93
1
vote
0 answers

monitoring spark cluster standalone mode with ganglia

I have installed spark 2.0.2 prebuitl for hadoop 2.4 and later from here : https://spark.apache.org/downloads.html . than, I have created my cluster composed from 1 master and 2 workers, also, I have installed Ganglia on the 3 machines (gmetad,…
Assia6
  • 41
  • 6
1
vote
1 answer

Monitor Impala using Ganglia

Is it possible to monitor Impala using Ganglia? There is no reference to it on the Impala documentation and all metrics from Hadoop can be monitored from it. Is there a way to connect the performance metrics generated by Impala on Ganglia?
Ivan
  • 19,560
  • 31
  • 97
  • 141
1
vote
4 answers

How to integrate Ganglia for Spark 2.1 Job metrics, Spark ignoring Ganglia metrics

I am trying to integrate Spark 2.1 job's metrics to Ganglia. My spark-default.conf looks like *.sink.ganglia.class org.apache.spark.metrics.sink.GangliaSink *.sink.ganglia.name Name *.sink.ganglia.host $MASTERIP *.sink.ganglia.port…
Shiva Achari
  • 955
  • 1
  • 9
  • 18
1 2
3
10 11