Questions tagged [distributed]

Multiple computers working together, using a network to communicate

A distributed system consists of multiple autonomous computers that communicate through a . The computers interact with each other in order to achieve a common goal. A computer program that runs in a distributed system is called a distributed program, and distributed programming is the process of writing such programs.

2221 questions
18
votes
2 answers

Distributed issue tracker for git with usable Eclipse Mylyn support?

I'm using git for version control but I'm currently lacking a good issue/bug/ticket tracker with Eclipse Mylyn integration. The features I'm looking for: Open source implementation (so that I can add the features I need in the future. GPL, LGPL,…
Mikko Rantalainen
  • 14,132
  • 10
  • 74
  • 112
18
votes
1 answer

Distributing Haskell on a cluster

I have a piece of code that process files, processFiles :: [FilePath] -> (FilePath -> IO ()) -> IO () This function spawns an async process that execute an IO action. This IO action must be submitted to a cluster through a job scheduling system…
felipez
  • 1,212
  • 9
  • 21
18
votes
4 answers

How does the Raft algorithm guarantee consensus if there are multiple leaders?

As the paper says: Election Safety: at most one leader can be elected in a given term. §5.2 However, there may be more than one leader in the system. Raft only can promise that there is only one leader in a given term. So If I have more than one…
baotiao
  • 775
  • 6
  • 20
18
votes
1 answer

Three phase commit

I understand that three phase commit was made to solve the problem of "two phase commit" when in the second phase the coordinator and the cohort fails at the same time it is impossible to know if the coordinator had decided on a commit…
Ken
  • 365
  • 1
  • 6
  • 16
17
votes
2 answers

Hazelcast (Java) and ETCD (golang) differences/similarities?

Now we building a realtime analytics system and it should be highly distributed. We plan to use distributed locks and counters to ensure data consistency, and we need a some kind of distributed map to know which client is connected to which…
The Architect
  • 665
  • 9
  • 22
17
votes
6 answers

How to design a distributed job scheduler?

I want to design a job scheduler cluster, which contains several hosts to do cron job scheduling. For example, a job which needs run every 5 minutes is submitted to the cluster, the cluster should point out which host to fire next run, making…
coderz
  • 4,847
  • 11
  • 47
  • 70
16
votes
5 answers

Actor-based distributed concurrency libraries for Ocaml and other languages

Question Can anyone recommend a library for Ocaml that offers an actor-based concurrency model for distributed computing? Note here the "actor-based" and "distributed" - I'd like the actor-based model, but also I want seamless handling of…
MGwynne
  • 3,512
  • 1
  • 23
  • 35
16
votes
2 answers

Is Git distributed or decentralized?

I know git used version control to track files. And it is also distributed, meaning more than one computer stores the relevant files. But my doubt is if git is distributed or decentralized? If it is decentralized, then why do we need github, gitlab?…
16
votes
4 answers

How to determine distributed architecture?

I'm trying to get my head around the thought process when designing a large scale application. Let's say I have a client who needs a new customer website and he is estimating 40,000 orders per day with an already 25,000 user base. When desiging the…
Marco
  • 2,453
  • 3
  • 25
  • 35
16
votes
1 answer

keeping a wcf callback channel open indefinitely / reconnecting from client if it faults

i'm currently trying to set up something like this: a server side windows wcf service hangs out and listens via tcp for connections from a client side windows service. when a connection is received (the client calls the CheckIn method on the…
Joshua Evensen
  • 1,544
  • 1
  • 15
  • 33
16
votes
7 answers

How to design and verify distributed systems?

I've been working on a project, which is a combination of an application server and an object database, and is currently running on a single machine only. Some time ago I read a paper which describes a distributed relational database, and got some…
Esko Luontola
  • 73,184
  • 17
  • 117
  • 128
16
votes
3 answers

Enumerating combinations in a distributed manner

I have a problem where I must analyse 500C5 combinations (255244687600) of something. Distributing it over a 10-node cluster where each cluster processes roughly 10^6 combinations per second means the job will be complete in about seven hours. The…
Matthieu N.
16
votes
3 answers

how to rapidly increment counters in Cassandra w/o staleness

I have a Cassandra question. Do you know how Cassandra does updates/increments of counters? I want to use a storm bolt (CassandraCounterBatchingBolt from storm-contrib repo on github) which writes into cassandra. However, I'm not sure how some of…
Adrian
  • 5,603
  • 8
  • 53
  • 85
16
votes
4 answers

Distributed bug tracker to go with DVC

We've pretty much licked the whole distributed thing for version control at this point. I'm not saying everything's perfect, but, from hereon out, it's mostly just a matter of continuing what has already been started. Distributed bug tracking,…
Neil Santos
  • 264
  • 3
  • 10
16
votes
3 answers

What are the differences between Tibco EMS and Rendezvous

What are some of the key differences between these two technologies? Does one have obvious advantages over the other?
jtruelove
  • 3,306
  • 3
  • 25
  • 29