Questions tagged [load-balancing]

Load balancing deal with the techniques involved on using multiple systems to deal with high demands, balancing the load between those multiple systems. Questions deal with networking and server load balancing, using dedicated hardware or not.

Load balancing is a group of techniques used to ensure that loads are spread between multiple systems. The term is used on networking and server environments, with similar results.

Network load balancing involves using multiple connections or links to spread speed or high demand between those connections. That can be done on backbone links, carrier internet links or even from servers to switches to provide more speed using link sharing.

Server load balancing utilizes hardware (hardware load balancers) or software (software load balancers) to spread the requests destined for a domain or system between various servers behind those load balancers (often named backends). Load balancing ensures that high performance and scalability can be achieved by addition of servers.

2747 questions
7
votes
4 answers

How do multiple backup servers work in Nginx?

For the backup directive, The Nginx documentation states rather minimally: marks the server as a backup server. It will be passed requests when the primary servers are unavailable. What if you have multiple backups and the primary server goes…
Benny Bottema
  • 170
  • 1
  • 1
  • 5
7
votes
1 answer

How does load balancer manage TCP connections

I have questions about handling TCP connections by load balancer. I have three servers behind my load balancer, and sometimes due to some processing tasks it happens that no data is being sent between servers and clients, after 5 minutes of being…
whd
  • 73
  • 1
  • 1
  • 7
7
votes
1 answer

How to map a domain name to a load balancer in google cloud platform?

I have successfully set up a load balancer in google cloud platform If I use the IP as shown in the image, I can test and verify that the set up is working as I planned. Now I would like to map a domain name to the IP. I want to use…
Anthony Kong
  • 3,288
  • 11
  • 57
  • 96
7
votes
1 answer

AWS Cloudfront + Load Balancer, url changes from main domain to load balancer subdomain

My setup is as follows: user types example.com on the browser request goes to AWS CloudFront, which redirects HTTP to HTTPS, and forwards the request to the AWS Elastic LoadBalancer (elb.example.com) LoadBalancer forwards the request to the EC2…
7
votes
3 answers

SSL Certificate on Load balancer or server

I have a load balancer distributing traffic between two servers, the public facing urls are all https prefixed. I want to generate a wildcard ssl certificate but I am not sure if is better to place it in the load balancer or in the two servers?…
David Garcia
  • 235
  • 2
  • 3
  • 10
7
votes
1 answer

For SSL bridging, do HTTPS backends verify that the load balancer is using the same private key? If so, how?

We are using the F5 to perform load balancing. When using SSL bridging instead of termination, we generally use a wildcard on the front-end and a regular SSL cert on the HTTPS backend. However, there's some belief among some colleagues that, for…
Belmin Fernandez
  • 10,799
  • 27
  • 84
  • 148
7
votes
2 answers

SSL Cert for one domain and multiple IPs

I have a question about SSL certs and multiple servers. Question: I have one cert, one domain name and I have many servers that hold my website code. Example.com can point to IPs 192.168.1.1, 192.168.1.2,192.168.1.3, and 192.168.1.4. one for USA…
Kevin
  • 223
  • 3
  • 7
7
votes
1 answer

Nginx as a load balancer. Frequent upstream timed out (110: Connection timed out) while connecting to upstream

I'm trying to use nginx on a centos 7 virtual machine as a load balancer to replace an aging Coyote Point hardware device. However in one of our webapps we're seeing frequent and continual upstream timeout errors in the logs and clients are…
Jchieppa
  • 168
  • 4
  • 10
7
votes
5 answers

How can I automaticaly change the DNS A record to point my site to a secondary server in case of a failure?

My hosting is charging me a $50/month fee to put my servers on the same VLAN so that I create a cluster using the Network Load Balancing feature. I'm really not needing split the load between the servers, I was looking for an easy way to create a…
holiveira
  • 889
  • 3
  • 13
  • 14
7
votes
3 answers

Any problems with having an active/active HAProxy setup with Keepalived

Apologies if this has been asked before, but I can't seem to find much on it. We're going to be using HAProxy to load balance our MariaDB Galera Cluster. All the articles/tutorials I have seen on this use Keepalived (or something similar) for an…
Luke Cousins
  • 387
  • 1
  • 3
  • 18
7
votes
1 answer

Load balancing Wordpress on Amazon Web Services: Managing changes

I am relatively new to Amazon Web Services and I am trying to get my head around how Elastic Load Balancing will work in context of my wordpress setup. In addition, I would like some advice on proposed infrastructure. My initial proposed…
Lloyd Rees
  • 85
  • 1
  • 5
7
votes
2 answers

How to scale up a web server supporting long polling

I am planing to add more web application servers to support increasing clients, deploying HAproxy and Keepalived for load balancing and High availability. My server usage has the following characteristic: Jobs are not CPU intensive. Message are…
Mickey
  • 123
  • 1
  • 8
7
votes
2 answers

HAProxy not balancing server load fairly

HAProxy doesn't seem to keep the connections to the servers balanced. Keep this in mind: using HAProxy v1.3.26 5 equally balanced server specs algorithm is round robin, but no weights are applied for each server global max connections set in…
Mark
  • 71
  • 1
  • 3
7
votes
1 answer

How to horizontally scale SSL termination behind HAProxy load balancing?

I've been looking around and no one seems to be trying to scale SSL termination the way I am and I'm curious as to why my approach seems so uncommon. Here's what I want to do followed by why: 10.0.1.1 10.0.1.2 -…
BrionS
  • 181
  • 1
  • 5
7
votes
2 answers

HAProxy -- pause/queue all traffic without losing requests

I basically have the same problem as mentioned in this thread -- I would like to temporarily suspend all requests to all servers of a certain backend, so that I can upgrade the backend and the database it uses. Since this is a live system, I would…
Marc
  • 281
  • 2
  • 9