Stack Overflow
Stack Overflow

Questions tagged [cluster-computing]

A computer cluster is a set of connected systems that work together so that in many respects they can be viewed as a single system.

A computer cluster consists of a set of loosely connected computers that work together so that in many respects they can be viewed as a single system. Cluster management is centralized as opposed to a grid's non-central approach. (wikipedia).

5527 questions
11
votes
2 answers

How to set up autoscaling RabbitMQ Cluster AWS

I'm trying to move away from SQS to RabbitMQ for messaging service. I'm looking to build a stable high availability queuing service. For now I'm going with cluster. Current Implementation , I have three EC2 machines with RabbitMQ with…
Karthik
  • 929
  • 2
  • 12
  • 24
11
votes
1 answer

How to hunt down obscure HA clustering bug in Wildfly 8.2.0.Final

The setup I have a Wildfly 8.2.0.Final application server running a cluster in domain mode using the full-ha profile. The cluster consists of two instances of wildfly, master and slave, each running on its own virtual machine. The application My…
noamik
  • 756
  • 6
  • 22
11
votes
2 answers

Hadoop: binding multiple IP addresses to a cluster NameNode

I've a four-node Hadoop cluster on Softlayer. The master (NameNode) has a public IP address for external access and a private IP address for cluster access. The slave nodes (datanodes) have private IP address which I'm trying to connect to the…
ikradex
  • 131
  • 2
  • 5
11
votes
1 answer

Apache Camel with ActiveMQ clustering

I'm trying to determine my options for clustering my ServiceMix 3.3.1/Camel 2.1/AMQ 5.3 application. I'm performing high volume message processing and I need to cluster for high availability and horizontal scalability. Here is basically what my…
Ben ODay
  • 20,784
  • 9
  • 45
  • 68
11
votes
1 answer

What is a farm, as opposed to a grid or a cluster?

I'm trying to understand does "farm" mean in computing, so that, if a farm can be exemplified as a cluster, there must be something that a farm is independently of what a cluster is. How is it different than a grid? Do these concepts have a general…
ferhtgoldaraz
  • 1,693
  • 3
  • 15
  • 20
11
votes
2 answers

What are the limitations of implementing MySQL NDB Cluster?

I want to implement NDB Cluster for MySQL Cluster 6. I want to do it for very huge data structure with minimum 2 million records. I want to know is if there are any limitations of implementing NDB cluster. For example, RAM size, number of databases,…
Sunil Kumar Sahoo
  • 53,011
  • 55
  • 178
  • 243
11
votes
1 answer

Difference between "SOCK", "PVM", "MPI", and "NWS" for the R SNOW package

The makeCluster function for the SNOW package has the different cluster types of "SOCK", "PVM", "MPI", and "NWS" but I'm not very clear on the differences among them, and more specifically which would be best for my program. Currently I have a queue…
jpd527
  • 1,543
  • 1
  • 14
  • 30
11
votes
2 answers

Spark cluster fails on bigger input, works well for small

I'm playing with Spark. It is the default, pre-built distribution (0.7.0) from the website, with default config, cluster mode, one worker (my localhost). I read the docs on installing and everything seems fine. I have a CSV file (various sizes, 1000…
gyorgyabraham
  • 2,550
  • 1
  • 28
  • 46
11
votes
1 answer

Node js 0.10.7: cluster support for udp dgram?

I'm trying to run following node js application as mentioned https://github.com/joyent/node/issues/2194 var util = require("util"), dgram = require("dgram"), cluster = require('cluster'); var udp = dgram.createSocket("udp4"); var port =…
Sepp Van Rompaey
  • 165
  • 1
  • 10
11
votes
2 answers

Can one make Apache Solr index transactionally consistent with DB being indexed?

I am new to Solr. I am trying to make a server that stores structured data in a database, and which can be searched using Solr/Lucene. The server can be is clustered into any number of identical nodes for high availability. It seems that the…
AgilePro
  • 5,588
  • 4
  • 33
  • 56
11
votes
3 answers

PHP / PDO with a MySQL Cluster

I have been asked to re-develop an old php web app which currently uses mysql_query functions to access a replicated database (4 slaves, 1 master). Part of this redevelopment will move some of the database into a mysql-cluster. I usually use PDO to…
Ben Holness
  • 2,457
  • 3
  • 28
  • 49
11
votes
6 answers

'Unexpected end of file' and 'error importing function definition' error running shellscript using qsub

I have the following shellscript: #!/bin/sh cd /sw/local/bin/ export LD_LIBRARY_PATH=/sw/local/lib:/usr/local/Trolltech/Qt-4.7.2/lib:$LD_LIBRARY_PATH ./FeatureFinderRaw -in /homes/JG-C1-18.mzML -out /homes/test_remove_after_use.featureXML -threads…
Niek de Klein
  • 8,524
  • 20
  • 72
  • 143
10
votes
3 answers

How should I set up mongodb cluster to handle 20K+ simultaneous

My application uses MongoDB as database. We are expecting 20K+ simultaneous connections to mongodb cluster. How should I config the server if I want to run the mongodb on 20 servers and shard the cluster 20 ways? Here is what I've done so far: On…
Daniel
  • 101
  • 1
  • 4
10
votes
1 answer

GPU allocation in Slurm: --gres vs --gpus-per-task, and mpirun vs srun

There are two ways to allocate GPUs in Slurm: either the general --gres=gpu:N parameter, or the specific parameters like --gpus-per-task=N. There are also two ways to launch MPI tasks in a batch script: either using srun, or using the usual mpirun…
Jakub Klinkovský
  • 1,248
  • 1
  • 12
  • 33
10
votes
4 answers

Can I use kafka over Internet?

Is kafka suitable for Internet-use? More precisely, what I want is to expose kafka topics as "public interface", then external consumers (or producers) can connect to it. Is it possible? I hear there are problems if I want to use the cluster in both…
ntysdd
  • 1,206
  • 2
  • 9
  • 19
1 2 3
…
99 100