Questions tagged [load-balancing]

Load balancing deal with the techniques involved on using multiple systems to deal with high demands, balancing the load between those multiple systems. Questions deal with networking and server load balancing, using dedicated hardware or not.

Load balancing is a group of techniques used to ensure that loads are spread between multiple systems. The term is used on networking and server environments, with similar results.

Network load balancing involves using multiple connections or links to spread speed or high demand between those connections. That can be done on backbone links, carrier internet links or even from servers to switches to provide more speed using link sharing.

Server load balancing utilizes hardware (hardware load balancers) or software (software load balancers) to spread the requests destined for a domain or system between various servers behind those load balancers (often named backends). Load balancing ensures that high performance and scalability can be achieved by addition of servers.

2747 questions
26
votes
3 answers

Layer 4 vs Layer 7 Load Balancing

I am trying to decide between using a layer 4 load balancing solution for my datacenter or a layer 7 solution. Unfortunately (for my sanity, that is), my use case is simple enough that both solutions would work well, avoiding most of the weaknesses…
26
votes
3 answers

How can I deploy a scalable, reliable haproxy cluster on Amazon EC2?

We need some more advanced functionality than ELB provides (mostly L7 inspection), but it's not obvious how to handle things like heartbeat and high availability with something like haproxy using EC2. There's a high likelihood we'd need 3 or more…
25
votes
2 answers

How is a single IP address load balanced?

I'm aware of "round robin DNS" load balancing, but how can a single IP address be load balanced? Google's DNS servers for example, 8.8.8.8 and 8.8.4.4. Wikipedia's load balancing article states: For Internet services, the load balancer is usually…
Torvero
  • 414
  • 7
  • 14
25
votes
14 answers

Load-balancer options

I am looking at a number of possible options for load-balancing. So far, I am constrained to the following options: DNS server load-balancer, balancing to a cluster of tomcat servers, with terracotta for session replication. Pros - don't have to…
toolkit
  • 402
  • 6
  • 10
24
votes
5 answers

How do I Install Intermediate Certificates (in AWS)?

I have installed private key (pem encoded) and public key certificate (pem encoded) on Amazon Load Balancer. However, when I check the SSL with site test tool, I get the following error: Error while checking the SSL Certificate!! Unable to get the…
getmizanur
  • 593
  • 1
  • 5
  • 13
24
votes
2 answers

LVS vs HAProxy, which should I choose?

I am looking for a solution to load balancing and failover strategy, mainly for big web applications. We have many services to be balanced, such as web, MySQL, and many other HTTP or TCP based services. But I am not sure what their pros and cons…
Mickey Shine
  • 939
  • 4
  • 17
  • 33
21
votes
3 answers

nginx failover without load balancing

I'm having trouble configuring nginx. I'm using nignx as a reverse proxy. I want to send my all requests to my first server. If the first server is down, I want to send requests to second server. In short, how can I have a failover solution without…
Serhat
  • 333
  • 1
  • 2
  • 6
21
votes
2 answers

HA Proxy - roundrobin vs leastconn

Are there any suggestion on when should I use roundrobin & when should I use leastconn? I am using roundrobin currently and observed the loading of my back-end servesr are not evenly distribution. Of course there might be other issue, but we want to…
Ryan
  • 5,831
  • 24
  • 72
  • 91
20
votes
3 answers

EC2 Update my existing AMI

I'm using Elastic Load Balancing to load balance my Auto Scaling Group, for that I have a private AMI that hold my application server (Tomcat) and my web app deployed to it as war ... Now everything works fine ... what if I need to change my tomcat…
20
votes
6 answers

How can I use HAproxy with SSL and get X-Forwarded-For headers AND tell PHP that SSL is in use?

I have the following setup: (internet) ---> [ pfSense Box ] /-> [ Apache / PHP server ] [running HAproxy] --+--> [ Apache / PHP server ] +--> [ Apache / PHP server ] …
Josh
  • 9,190
  • 28
  • 80
  • 128
19
votes
1 answer

Keepalive setting for Gunicorn behind ELB without Nginx

Our app's REST API is served by Gunicorn (not behind Nginx) running on AWS EC2 instances with a typical auto-scaling/load balancing setup. The load balancer's idle timeout is 60 seconds, and Gunicorn's keep-alive timeout is 2 seconds. We've been…
handsofaten
  • 337
  • 1
  • 3
  • 6
19
votes
3 answers

Redirect all HTTP traffic to HTTPS when using the HTTP(S) Load Balancer on Google Compute Engine

I have HTTP/HTTPS Load Balancing set up on Google Compute Engine with 2 Global Forwarding Rules (HTTP and HTTPS). Each rule points to a back-end service with a protocol of HTTP. I want all requests to http://* to go to https://*. As the load…
Ryan Leckey
  • 293
  • 1
  • 2
  • 5
19
votes
2 answers

Is it possible to use multiple load balancers to redirect traffic to my application servers?

I'm new to load balancing and I'm wondering if it's possible to use multiple load balancers to redirect traffic to my application servers. I don't really understand how this can be done. Shouldn't a domain name match one to one with a certain…
19
votes
2 answers

Outlook fails to connect to a load-balanced Exchange 2013 cluster through Direct Access 2012 R2

We have a load-balanced Exchange 2013 SP1 cluster, running MAPI over HTTP. Client connectivity inside our own network works just fine, while clients connected over Direct Access does not connect. The Outlook logs on the client show absolutely no…
pauska
  • 19,620
  • 5
  • 57
  • 75
19
votes
3 answers

Issues with EC2 Elastic Load Balancer DNS and routing

We're trying to run a fairly straightforward setup on Amazon EC2 - several HTTP servers sitting behind an Amazon Elastic Load Balancer (ELB). Our domain is managed in Route53, and we have a CNAME record set up to point to the ELB. We've experienced…
Cera
  • 553
  • 4
  • 6
  • 13