Questions tagged [cluster-computing]

A computer cluster is a set of connected systems that work together so that in many respects they can be viewed as a single system.

A computer cluster consists of a set of loosely connected computers that work together so that in many respects they can be viewed as a single system. Cluster management is centralized as opposed to a grid's non-central approach. (wikipedia).

5527 questions
10
votes
7 answers

How to be able to "move" all necessary libraries that a script requires when moving to a new machine

We work on scientific computing and regularly submit calculations to different computing clusters. For that we connect using linux shell and submitting jobs through SGE, Slurm, etc (it depends on the cluster). Our codes are composed of python and…
Open the way
  • 26,225
  • 51
  • 142
  • 196
10
votes
1 answer

Start multiple h2o cluster from within R

My intention is to start two or more h2o clusters / instances (not two or more nodes!) from within R on the same computer/server to enable multiple user to connect with h2o at the same time. In addition, I want to be able to shutdown and restart…
constiii
  • 638
  • 3
  • 19
10
votes
1 answer

How does distributed tensorflow work ? (Issue with tf.train.Server)

I have some troubles with the new option of tensorflow that allows us to run distributed tensorflow. I just would like to run 2 tf.constant with 2 tasks but my code never ends. it looks like that : import tensorflow as tf cluster =…
10
votes
5 answers

Free OpenMosix replacement?

I was shocked to learn that OpenMosix is closed. Can you suggest any similar free tool for linux. For those who don't know, OpenMosix is a software package that turns networked computers running GNU/Linux into a cluster. It automatically balances…
Boris Gorelik
  • 29,945
  • 39
  • 128
  • 170
10
votes
2 answers

Interrupting a job in quartz cluster

I have a Quartz setup with multiple instances and I want to interrupt a job wherever it is executed. As it was said in documentation, Scheduler.interrupt() method is not cluster aware so I'm looking for some common practice to overcome such…
Alexander Oleynikov
  • 19,190
  • 11
  • 37
  • 51
10
votes
3 answers

Node.js sending an object with function definitions to worker thread

So I am working on a project in Node.js and I want to open up some extra threads to handle the processing load more efficiently. But I am using classes with function definitions with them and when I try to send those objects to the worker thread,…
9
votes
3 answers

Riak vs GlusterFS

I need to setup a data storage which can store PB level of files (files are mostly small json, images and csv files, but some of them can be ~100MB binary files). I am looking into distributed data storage which is master-less and…
Eric Fong
  • 815
  • 1
  • 8
  • 17
9
votes
1 answer

Java Parallel Processing on cluster systems (cluster computing)

I am developing a web-based application to provide some services. This is a scientific application which performs some processing on data uploaded by users. The methods corresponds to this processing actions are written in Java and they are…
cartoonist
  • 5,991
  • 6
  • 37
  • 40
9
votes
1 answer

Delete old map markers and load new ones in cluster manager

I have a google map, and what I'm trying to do is to refresh markers from firebase every 15 seconds using geoQuery, And that means I delete all the previous markers and add new ones by using this method : private void downloadExtraPrinters(LatLng…
9
votes
2 answers

Should a MongoDB arbiter be included in the client connection configuration?

If a replica set is set up in Mongo with only two nodes, an arbiter needs to be added to ensure that there is always a majority in a vote for a new master. The arbiter never becomes the master itself, it is purely there to provide the casting vote…
Rich
  • 15,602
  • 15
  • 79
  • 126
9
votes
2 answers

Mkmap iOS11 clusters doesn't split up after max zoom, how to set it up?

First, my code is perfectly running. I have well set up and mapView.register my annotation markers and cluster. When I zoom out the annotations fusion as expected in my cluster views, when I zoom in, same good result, except at a certain point. When…
Cory
  • 341
  • 6
  • 15
9
votes
2 answers

Spark rdd.count() yields inconsistent results

I'm a bit baffled. A simple rdd.count() gives different results when run multiple times. Here is the code i run: val inputRdd =…
PeterLudolf
  • 185
  • 1
  • 9
9
votes
3 answers

redis on windows cluster setup

I have downloaded MSOpenTech Redis version 3.x which includes the long awaited clustering feature. My redis database is all working and I can start my cluster on the min 3 nodes required (in cluster mode). Does anyone know how to configure the…
NeilR
  • 161
  • 1
  • 1
  • 4
9
votes
1 answer

JBoss 4.2.2 nodes start to cluster then suspect each other

I have a website running with JBoss 4.2.2 on an existing Red Hat server. I'm setting up a second server so as to have a clustered pair (which will then be load-balanced). However, I can't get them to cluster successfully. The existing server starts…
minamikuni
  • 91
  • 1
  • 2
9
votes
1 answer

Apache Flink streaming in cluster does not split jobs with workers

My objective is to setup a high throughput cluster using Kafka as source & Flink as the stream processing engine. Here's what I have done. I have setup a 2-node cluster the following configuration on the master and the workers. Master…