How to load balance > C100K?

Question

Suppose that a hypotetical webapp keeps one connections per user (eg: chat app using comet, long pooling, etc...). How can i load balance such thing to scale beyond the connection limit of a single machine (C10[0]K) ?

I can see round robin DNS as a solution, would like to know what else would be possible...

I also thought so, but couldn't find... could you point some? — Julio Faerman, May 25 '11 at 13:16

score 1 · Answer 1 · answered May 24 '11 at 17:59

1

dns load balancing will do but you don't have much control over it - better use a load balancer.

answered May 24 '11 at 17:59

silviud

2,687
2
18
19

The problem is what to do when you exceed the capacity of a single load balancer. – Julio Faerman May 25 '11 at 13:16
have two or more load balancers handling the traffic, these can as well be mixed with dns round robin – silviud May 25 '11 at 15:01

score 1 · Answer 2 · answered May 24 '11 at 18:35

1

The far extreme of this is Geographic DNS distributing discrete round-robin IP address pools which in turn point to clustered hardware load-balancers using Virtual IP to handle failover. I say hardware since the big hardware load-balancers are designed for truly massive connection-counts.

answered May 24 '11 at 18:35

sysadmin1138

133,124
18
176
300

That's what i think too... do you have an idea of how much "massive" this count is? – Julio Faerman May 25 '11 at 13:17

How to load balance > C100K?

2 Answers2