Questions tagged [load-balancing]

Load balancing deal with the techniques involved on using multiple systems to deal with high demands, balancing the load between those multiple systems. Questions deal with networking and server load balancing, using dedicated hardware or not.

Load balancing is a group of techniques used to ensure that loads are spread between multiple systems. The term is used on networking and server environments, with similar results.

Network load balancing involves using multiple connections or links to spread speed or high demand between those connections. That can be done on backbone links, carrier internet links or even from servers to switches to provide more speed using link sharing.

Server load balancing utilizes hardware (hardware load balancers) or software (software load balancers) to spread the requests destined for a domain or system between various servers behind those load balancers (often named backends). Load balancing ensures that high performance and scalability can be achieved by addition of servers.

2747 questions
9
votes
2 answers

Can a hardware load-balancer route SSL traffic with SNI?

We've got a webserver farm currently hosting 2 applications - both applications are running on all servers. We want to split this so we have a dedicated server farm for each app (we have good reasons for this). We'd hoped to have a single…
potomato
  • 101
  • 4
9
votes
1 answer

Haproxy: SSL encrypted backend with self-signed cert

I'm working to configure HAProxy such that it will terminate the SSL so there's only one place to configure the purchased SSL cert. However, I'd prefer that the connection to the backend servers also be encrypted with SSL. One suggestion I found…
Joe J
  • 233
  • 1
  • 2
  • 6
9
votes
1 answer

Cisco BGP Unequal Cost Load Balancing

I'm trying to implement BGP Unequal Cost Load Balancing feature in my network. According to cisco manuals (long: http://www.cisco.com/c/en/us/td/docs/ios/12_2s/feature/guide/fsbgplb.html, short:…
Shamanu4
  • 194
  • 4
  • 16
9
votes
3 answers

How do big companies like Youtube load balance traffic with only one IP?

Examining the A records for youtube.com (for example), I see only one IP address. How can this be possible, given the volume of traffic they handle? Do they use anycast with load balancers behind it?
Victor
  • 101
  • 1
  • 6
9
votes
2 answers

Gracefully take a server out of Azure Load Balancer (drain stop)

We have an application deployed to Azure IaaS VMs, served by IIS. In order to install updates, we need to take each machine out of the load balancer, one by one. Before moving to Azure, we were using Microsoft NLB which has the function to DRAIN…
nulldotzero
  • 143
  • 1
  • 1
  • 8
9
votes
2 answers

Scale HAProxy for more than 64k websockets

We are trying to design an architecture that will be able to handle more than 64k websockets. We first tried with Amazon ELB, but its design doesn't allow unexpected spike of traffic nor websocket. (TCP mode timeout the websockets unexpectedly) With…
Bastien974
  • 1,896
  • 12
  • 44
  • 62
9
votes
2 answers

How should I configure my ELB health check when using NameVirtualHosts and redirecting to www?

My ELB keeps taking my instances out of service, because the HTTP health check is failing. We have a DNS wildcard, and redirect everything to www: vhost.conf: ServerName www.example.com ServerAlias *.example.com RewriteEngine on RewriteCond…
chris
  • 3,993
  • 6
  • 28
  • 37
9
votes
5 answers

What are the best techniques for preventing denial of service attacks?

Currently I have been using (D)DoS-Deflate to manage such situations on numerous remote servers, along with Apache JMeter for load testing. Overall it has been working fairly well, although I'd like to hear some suggestions from gurus who have been…
John T
  • 1,059
  • 1
  • 15
  • 19
9
votes
5 answers

What is the practical limit for IP addresses in DNS round-robin?

I'm currently running a site whose trafic is distributed among 7 mirror servers right now (using DNS round robin). But soon more mirrors will be necessary given the high amount of traffic which is permanently growing. Is there any practical o…
GetFree
  • 1,500
  • 7
  • 23
  • 37
9
votes
5 answers

Load Balancing a UDP server

I have a udp server, it is a central part in my business process. in order to handle the loads I'm expecting in the production environment I'll probably need 2 or 3 instances of the server. The server is almost entirely stateless, it mostly collects…
Hellfrost
  • 203
  • 1
  • 2
  • 7
8
votes
3 answers

How to tune TCP for high-frequency connections between two nodes

I've been scratching my head for the past few days, trying to come up with a solution for the following problem: In our data center we have a F5 running on BigIP hardware that acts as a single ingress point for HTTPS requests from client machines in…
Christoph
  • 203
  • 1
  • 7
8
votes
2 answers

How can I use a static IP address with an Application Load Balancer in a highly available manner?

I'm overseeing an integration for a customer and their vendor needs a number of IP Addresses to whitelist. The originating server(s) is an Elastic Beanstalk Instance fronted by an Application Load Balancer with all the trimmings via Route53. That's…
8
votes
2 answers

Google Cloud Load Balancer to a Cloud Function directly?

I'm trying to send traffic from a Google Cloud Load Balancer (LB) directly to a Cloud Function. My Cloud Function has an HTTP URL trigger and if I hit that URL from a browser it works, so all I need is a rule on the load balancer to proxy that…
Panda Coder
  • 81
  • 1
  • 3
8
votes
2 answers

SSL certificate and Azure classic load balancer

I have 2 VMs behind a load balancer on Azure. I created a new SSL certificate via Let's Encrypt on one of the VMs using the domain that is assigned to the load balancer. When I connect to that VM directly via IP I see the certificate loaded, but I'm…
Vedran
  • 183
  • 1
  • 1
  • 5
8
votes
4 answers

Howto WCF Service HTTPS Binding and Endpoint Configuration in IIS with Load Balancer?

We have a WCF service that is being hosted on a set of 12 machines. There is a load balancer that is a gateway to these machines. Now the site is setup as SSL; as in a user accesses it through using an URL with https. I know this much, the URL…
Mike G
  • 283
  • 1
  • 4
  • 11