Questions tagged [cluster-computing]

A computer cluster is a set of connected systems that work together so that in many respects they can be viewed as a single system.

A computer cluster consists of a set of loosely connected computers that work together so that in many respects they can be viewed as a single system. Cluster management is centralized as opposed to a grid's non-central approach. (wikipedia).

5527 questions
20
votes
3 answers

How to notify all (same) Singleton beans in a Glassfish 3.1 Cluster?

I have a JEE6 application that runs on an Glassfish 3.1.2 cluster. One @Singleton Bean contains some kind of (readolny) cache. A User can press a button in the GUI to update the cache with (updated) content from the database. This works well in a…
Ralph
  • 118,862
  • 56
  • 287
  • 383
19
votes
3 answers

RabbitMQ cluster is not reconnecting after network failure

I have a RabbitMQ cluster with two nodes in production and the cluster is breaking with these error messages: =ERROR REPORT==== 23-Dec-2011::04:21:34 === ** Node rabbit@rabbitmq02 not responding ** ** Removing (timedout) connection ** =INFO…
Ranch
  • 875
  • 3
  • 8
  • 13
19
votes
5 answers

What algorithms there are for failover in a distributed system?

I'm planning on making a distributed database system using a shared-nothing architecture and multiversion concurrency control. Redundancy will be achieved through asynchronous replication (it's allowed to lose some recent changes in case of a…
Esko Luontola
  • 73,184
  • 17
  • 117
  • 128
19
votes
4 answers

How to stop AWS EKS Worker Instances

I wonder if that would be possible to temporary stop the worker VM instances so they are not running at night time when I am not working on a cluster development. So far the only way I am aware of to "stop" the instances from running is to delete…
alphanumeric
  • 17,967
  • 64
  • 244
  • 392
19
votes
1 answer

Mongodb cluster with aws cloud formation and auto scaling

I've been investigating creating my own mongodb cluster in AWS. Aws mongodb template provides some good starting points. However, it doesn't cover auto scaling or when a node goes down. For example, if I have 1 primary and 2 secondary nodes. And the…
18
votes
2 answers

Load Balancing (HAProxy or other) - Sticky Sessions

I'm working on scaling out my app to multiple servers, and one requirement is that a client is always communicating with the same server (too much live data is used to allow bouncing between servers efficiently). My current setup is a small server…
Michael Marsee
  • 1,075
  • 2
  • 12
  • 11
18
votes
2 answers

Error with OMP_NUM_THREADS when using dask distributed

I am using distributed, a framework to allow parallel computation. In this, my primary use case is with NumPy. When I include NumPy code that relies on np.linalg, I get an error with OMP_NUM_THREADS, which is related to the OpenMP library. An…
Scott
  • 2,568
  • 1
  • 27
  • 39
18
votes
1 answer

Nodejs Clustering and expressjs sessions

I'm trying to build nodejs application which will take advantage of multicore machines ( a.k.a. clustering ) and I got a question about sessions. My code looks like this: var cluster = exports.cluster = require('cluster'); var numCPUs =…
Deepsy
  • 3,769
  • 7
  • 39
  • 71
18
votes
1 answer

Cluster-wide singleton in Websphere Cluster

I need to run a component using Apache Camel (or Spring Integration) under WAS ND 8.0 cluster. They both run some threads on startup, and stop them on shutdown normally. No problem to supply WAS managed threadpool. But that threads must run on…
17
votes
3 answers

In a hadoop cluster, should hive be installed on all nodes?

I am a newbie to Hadoop / Hive and I have just started reading the docs. There are lots of blogs on installing Hadoop in cluster mode. Also, I know that Hive runs on top of Hadoop. My question is: Hadoop is installed on all the cluster nodes.…
Vijay
  • 263
  • 1
  • 4
  • 12
17
votes
4 answers

Clustering, Sharding or simple Partition / Replication

We have created a Facebook application and it got a lot of virality. The problem is that our database started getting REALLY FULL (some tables have more than 25 million rows now). It got to the point that the app just stopped working because there…
albertosh
  • 2,416
  • 7
  • 25
  • 32
17
votes
1 answer

How does weblogic clustering work?

I'm new to weblogic. I've read http://download.oracle.com/docs/cd/E11035_01/wls100/cluster/overview.html and searched this topic on the internet but still had a hard time understanding some of weblogic's clustering concepts. Can anybody…
Russell
  • 3,975
  • 7
  • 37
  • 47
17
votes
6 answers

How to get the service IP in Kubernetes?

I ran a local cluster according to its official doc here. I followed the steps and it worked properly until I set a replica and tried to exposed it. I mean: ./kubectl expose rc nginx --port=80 the output is this: NAME LABELS SELECTOR …
Hadi
  • 5,328
  • 11
  • 46
  • 67
17
votes
1 answer

ElasticSearch setup for a large cluster with heavy aggregations

Context and current state We are migrating our cluster from Cassandra to a full ElasticSearch cluster. We are indexing documents at average of ~250-300 docs per seconds. In ElasticSearch 1.2.0 it represents ~8Go per day. { "generic": { …
17
votes
1 answer

Apache Helix vs YARN

What is the difference between Apache Helix and Hadoop YARN (MRv2). Does anyone have experience with both technologies? Can someone explain me the advantages/disadvantages of Helix over YARN and why the LinkedIn guys developed their own cluster…
Tobi
  • 219
  • 2
  • 6