Questions tagged [cluster-computing]

A computer cluster is a set of connected systems that work together so that in many respects they can be viewed as a single system.

A computer cluster consists of a set of loosely connected computers that work together so that in many respects they can be viewed as a single system. Cluster management is centralized as opposed to a grid's non-central approach. (wikipedia).

5527 questions
33
votes
3 answers

What are the implications of R + W > N for Cassandra clusters?

This introduction to Cassandra Replication and Consistency (slides 14-15) boldly asserts: R+W>N guarantees overlap of read and write quorums. Please imagine this inequality has huge fangs, dripping with the blood of innocent, enterprise…
Leftium
  • 16,497
  • 6
  • 64
  • 99
33
votes
5 answers

How to change memory per node for apache spark worker

I am configuring an Apache Spark cluster. When I run the cluster with 1 master and 3 slaves, I see this on the master monitor page: Memory 2.0 GB (512.0 MB Used) 2.0 GB (512.0 MB Used) 6.0 GB (512.0 MB Used) I want to increase the used memory for…
Minh Ha Pham
  • 2,566
  • 2
  • 28
  • 43
31
votes
3 answers

ORA-01654: unable to extend index

Calling all Oracle Gurus! I am in the process of clustering a well tested application on WebSphere. The application in question made it about half way through processing 1k of JMS messages from a queue before this happened. ---- Begin backtrace for…
Karl
  • 2,927
  • 8
  • 31
  • 39
30
votes
7 answers

RealWorld HazelCast

Does anyone have any real world experience with Hazelcast distributed data grid and execution product? How has it worked for you? It has an astonishingly simple API and functionality that seems almost to good to be true for such a simple to use…
Bob Clyde
  • 309
  • 3
  • 3
30
votes
1 answer

What is socket, core, threads, CPU?

I am currently volunteering to learn about linux servers and also I am interested in learning about cluster computing techniques. In this lab, they have a small cluster with one head node and two compute nodes. When I tried the lscpu command on…
bioinforesearch
  • 427
  • 1
  • 4
  • 8
30
votes
3 answers

Adding node to existing cluster in Kubernetes

I have a kubernetes cluster running on 2 machines (master-minion node and minion node). I want to add a new minion node without disrupting the current set up, is there a way to do it? I have seen that when I try to add the new node, the services on…
adyanthaya17
  • 317
  • 1
  • 3
  • 4
29
votes
3 answers

Set hadoop system user for client embedded in Java webapp

I would like to submit MapReduce jobs from a java web application to a remote Hadoop cluster but am unable to specify which user the job should be submitted for. I would like to configure and use a system user which should be used for all MapReduce…
Christoffer Soop
  • 1,458
  • 1
  • 12
  • 24
28
votes
7 answers

Starting Zookeeper Cluster. Error: Could not find or load main class org.apache.zookeeper.server.quorum.QuorumPeerMain

(I'm running on CentOS 5.8). I've been following the direction for a Clustered (Multiserver) Zookeeper Set-up, but getting an error when I try to start up my server. When I run the command as described in the documentation: java -cp…
Shark
  • 2,322
  • 5
  • 31
  • 44
28
votes
2 answers

Nodejs application Error: bind EADDRINUSE when use pm2 deploy

Express application deploy with pm2 database is mongodb when run app with command: NODE_ENV=production pm2 start app.js -i max aften has Error: bind EADDRINUSE, this is logs, when error, [app err (l0)] js:1073:26 [app err (l1)] at Object.30:1…
lidashuang
  • 1,975
  • 4
  • 20
  • 22
28
votes
7 answers

In node.js, how to declare a shared variable that can be initialized by master process and accessed by worker processes?

I want the following During startup, the master process loads a large table from file and saves it into a shared variable. The table has 9 columns and 12 million rows, 432MB in size. The worker processes run HTTP server, accepting real-time queries…
Jacky Lee
  • 1,193
  • 3
  • 13
  • 22
27
votes
2 answers

AttributeError: 'Graph' object has no attribute 'node'

I have bellow python code to build knn graph but I have an error: AttributeError: 'Graph' object has no attribute 'node'. It seems that the nx.Graph() has no node attribute but I don't know what should I replace with that. import networkx as nx def…
nino
  • 481
  • 2
  • 6
  • 13
27
votes
1 answer

How do I use Node.js clusters with my simple Express app?

— I built a simple app that pulls in data (50 items) from a Redis DB and throws it up at localhost. I did an ApacheBench (c = 100, n = 50000) and I'm getting a semi-decent 150 requests/sec on a dual-core T2080 @ 1.73GHz (my 6 y.o laptop), but the…
vjk2005
  • 678
  • 1
  • 12
  • 23
26
votes
8 answers

Cluster Shared Cache

I am searching for a java framework that would allow me to share a cache between multiple JVMs. What I would need is something like Hazelcast but without the "distributed" part. I want to be able to add an item in the cache and have it automatically…
GuiSim
  • 7,361
  • 6
  • 40
  • 50
26
votes
2 answers

kill all child_process when node process is killed

How do i make sure all child_process are killed when the parent process is killed. I have something like the below one. Even when the node process is kill i see that FFMPEG continues to run and the out.avi is generated. How can i stop FFMPEG from…
Phani
  • 1,704
  • 3
  • 13
  • 18
24
votes
6 answers

Debugging Node.js processes with cluster.fork()

I've got some code that looks very much like the sample in the Cluster documentation at http://nodejs.org/docs/v0.6.0/api/cluster.html, to wit: var cluster = require('cluster'); var server = require('./mycustomserver'); var numCPUs =…
Chris
  • 405
  • 2
  • 5
  • 13