Questions tagged [load-balancing]

The term load balancing is used to describe technology that is used to evenly distribute work across multiple nodes within a network.

Load balancing is a computer networking method for distributing workloads across multiple computers or a computer cluster, network links, central processing units, disk drives, or other resources. Successful load balancing optimizes resource use, maximizes throughput, minimizes response time, and avoids overload. Using multiple components with load balancing instead of a single component may increase reliability through redundancy. Load balancing is usually provided by dedicated software or hardware, such as a multilayer switch or a Domain Name System server Process.

5217 questions
21
votes
1 answer

What can we do when load balancer becomes the bottleneck?

I just started learning load balancers. Taking a server side application (http/https) load balancer as an example, I assume it listens a specific ip address, then forward the http requests to available servers based on its algorithm. So is it…
Yuxiong Zhu
  • 213
  • 2
  • 7
21
votes
1 answer

Enable HTTPS on GCE/GKE

I am running web site with Kubernetes on Google Cloud. At the moment, everything is working well - through http. But I need https. I have several services and one of them is exposed to the outside world, let's call it web. As far as I know, this is…
21
votes
3 answers

What is the difference between the internal and External load balancer in AWS?

What is the difference between the internal and external load balancer? Assume I created an internal load balancer inside a VPC. Is it possible to access the internal load balancer outside the VPC? Consider I have two AWS accounts A and B. I created…
Nithin
  • 9,661
  • 14
  • 44
  • 67
21
votes
3 answers

Nginx High volume traffic load balancing

For the last 3 weeks we have been testing Nginx as load balance. Currently, we're not succeeding to handle more than 1000 req/sec and 18K active connections. When we get to the above numbers, Nginx starts to hang, and returns timeout codes. The only…
naih
  • 319
  • 1
  • 2
  • 6
21
votes
2 answers

How do I know how many partitions a DynamoDB table is spread over?

Amazon's DynamoDB in designed for guaranteed performances. A customer must provision throughput for each of it's tables. To achieve this performances, tables are transparently spread over multiple "servers" AKA "partitions". Amazon provides us with…
yadutaf
  • 6,840
  • 1
  • 37
  • 48
20
votes
4 answers

Do load balancers flood?

I am reading about load balancing. I understand the idea that load balancers transfer the load among several slave servers of any given app. However very few literature that I can find talks about what happens when the load balancers themselves…
PedroD
  • 5,670
  • 12
  • 46
  • 84
20
votes
3 answers

What is the conceptual difference between Service Discovery tools and Load Balancers that check node health?

Recently several service discovery tools have become popular/"mainstream", and I’m wondering under what primary use cases one should employ them instead of traditional load balancers. With LBs, you cluster a bunch of nodes behind the balancer, and…
20
votes
3 answers

Load balancer and session management

There is a website run by 2 servers. These 2 servers balances the load using Load Balancer. So, if 1 session is created on 1 server and say load is shift to another server immediately, then how session is maintained? I am just interested in the…
Praveen Kumar
  • 1,624
  • 5
  • 18
  • 21
20
votes
5 answers

How does Windows Azure perform load balancing?

I was trying to read up on load balancing in Windows Azure, and all the information about it is extremely vague and non-specific. All I really want is a simple answer: how does Azure perform load balancing? Many applications use sessions or…
Jerod Venema
  • 44,124
  • 5
  • 66
  • 109
20
votes
5 answers

Determine IP Address of Client Behind Amazon ELB

We have some PHP servers on EC2 behind ELB. We would like to determine the locale/region by IP address of the clients connecting to our servers. The problem is the PHP servers only see the IP address of the ELB. We would like to see the IP addresses…
Bill Rosmus
  • 2,941
  • 7
  • 40
  • 61
20
votes
5 answers

How can I modify the Load Balancing behavior Jenkins uses to control slaves?

We use Jenkins for our CI build system. We also use 'concurrent builds' so that Jenkins will build each change independently. This means we often have 5 or 6 builds of the same job running simultaneously. To accommodate this, we have 4 slaves each…
19
votes
3 answers

loadbalancing for kubernetes in non-cloud environment

I see that kubernetes can use ClusterIP and NodePort and LoadBalancing. For loadbalancing it requires cloud. If I do not have cloud provider how can I loadbalance traffic between nodes?! I know that HAProxy can loadbalance but I think this cloud…
yasin lachini
  • 5,188
  • 6
  • 33
  • 56
19
votes
3 answers

Node.js clustering vs multiple Docker containers

From what I understand, Docker containers use multiple threads, and Node.js applications use only a single thread. By running something like pm2, which handles Node.js clustering, I could utilize all cores available to the Docker container. Would…
Kevin Ghadyani
  • 6,829
  • 6
  • 44
  • 62
19
votes
1 answer

Will ASP.Net MVC's AntiForgeryToken Method work with Load Balancers?

Using ASP.Net MVC v2.0, I am starting to research the use of the Html.AntiForgeryToken() method when submitting forms that process data. I can see it sets a hidden value in the form HTML and it sets the same value in a session cookie. The question…
Paul Fryer
  • 9,268
  • 14
  • 61
  • 93
19
votes
2 answers

consistent hashing vs. rendezvous (HRW) hashing - what are the tradeoffs?

There is a lot available on the Net about consistent hashing, and implementations in several languages available. The Wikipedia entry for the topic references another algorithm with the same goals: Rendezvous Hashing This algorithm seems simpler,…
Peter Friend
  • 750
  • 1
  • 7
  • 17