Questions tagged [load-balancing]

The term load balancing is used to describe technology that is used to evenly distribute work across multiple nodes within a network.

Load balancing is a computer networking method for distributing workloads across multiple computers or a computer cluster, network links, central processing units, disk drives, or other resources. Successful load balancing optimizes resource use, maximizes throughput, minimizes response time, and avoids overload. Using multiple components with load balancing instead of a single component may increase reliability through redundancy. Load balancing is usually provided by dedicated software or hardware, such as a multilayer switch or a Domain Name System server Process.

5217 questions
11
votes
1 answer

Automatically append docker container to upstream config of nginx load balancer

I'm running Docker Compose (v2) and have a node service (website) and python based api deployed with nginx sitting in front of them. One thing I would like to do is be able to scale the services by adding more containers. If I know ahead of time…
ExoticChimp
  • 1,884
  • 1
  • 19
  • 37
11
votes
1 answer

Define custom load balancing algorithm

Here is the situation: I have a number of web servers, say 10. I need to use a (software) load balancer which can be implemented using a reverse proxy server, like HAProxy or Varnish. Now, All the traffic that we serve is over https and not http, so…
vish4071
  • 5,135
  • 4
  • 35
  • 65
11
votes
1 answer

Patching Nginx to ip_hash 4 octets instead of 3

I'm currently running two back end servers on my network and load balancing with Nginx on Windows. I am load testing the system at the moment however all of my traffic is directed at one server. This is because the ip_hash algorithm sorts traffics…
Sprout
  • 630
  • 1
  • 5
  • 22
11
votes
2 answers

Curl to Google Compute load balancer gets error 502

If I curl a POST request with file upload to my google compute load balancer (LB) I get a 502 error. If I do the same curl to the worker node behind the LB, it works. If I use a library like PHP Guzzle, it works either way. If I do a basic GET…
Matthew Scragg
  • 4,540
  • 3
  • 19
  • 27
11
votes
3 answers

AWS autoscale ELB status checks grace period

I'm running servers in a AWS auto scale group. The running servers are behind a load balancer. I'm using the ELB to mange the auto scaling groups healthchecks. When servers are been started and join the auto scale group they are currently…
Ofer Velich
  • 1,959
  • 4
  • 19
  • 24
11
votes
2 answers

Difference Between TCP Load Balancer and HTTP Load Balancer and when to use what?

I am trying to understand fundamental use cases between these two and when to prefer one over the other. For example HAProxy support TCP load balancing. In practical cases when this would be a deciding factor? Also What HTTP LB can achieve TCP can…
Abhijit Mazumder
  • 8,641
  • 7
  • 36
  • 44
11
votes
5 answers

How can I defend against DoS attacks using Amazon EC2 Load Balancer?

We usually blacklist IPs address with iptables. But in Amazon EC2, if a connection goes through the Elastic Load Balancer, the remote address will be replaced by the load balancer's address, rendering iptables useless. In the case for HTTP,…
netvope
  • 7,647
  • 7
  • 32
  • 42
11
votes
1 answer

Difference between "SOCK", "PVM", "MPI", and "NWS" for the R SNOW package

The makeCluster function for the SNOW package has the different cluster types of "SOCK", "PVM", "MPI", and "NWS" but I'm not very clear on the differences among them, and more specifically which would be best for my program. Currently I have a queue…
jpd527
  • 1,543
  • 1
  • 14
  • 30
11
votes
3 answers

How to properly configure Apache Httpd as Load Balancer where some hosts may be unavailable

I am using an Apache Httpd instance as proxy in front of multiple Java Tomcat instances. Apache acts as load balancer for the Tomcat instances. The apache config basically looks like follows BalancerMember…
centic
  • 15,565
  • 9
  • 68
  • 125
10
votes
2 answers

Apache ProxyPass - Regex to Exclude Files

I'm trying to exclude all files starting with "dgg-" and ending in ".xml", example: dgg-file-1.xml from using the apache proxy. This works: ProxyPass /myfile.xml ! # single file ProxyPass /directory ! # all files inside dir This doesn't…
Pedro Lobito
  • 94,083
  • 31
  • 258
  • 268
10
votes
1 answer

What's the best practice for getting EC2 instances to join HAProxy automatically?

We're working on scaling out our EC2 architecture to a point where we'd like to manage our own load balancing. We currently have a series of machines configured on HAProxy to do basic load balancing, but we're looking for the 'best practice' means…
iandouglas
  • 4,146
  • 2
  • 33
  • 33
10
votes
3 answers

Azure - 2x extra small or a single small instance

Starting out with Windows Azure, but how do I know which is better to handle web-traffic and a background processor. Would 2x extra small instances be better or a single small instance. If I were to use a small instance, I would make the background…
Jason Jong
  • 4,310
  • 2
  • 25
  • 33
10
votes
2 answers

Sharded load balancing for stateful services in Kubernetes

I am currently switching from Service Fabric to Kubernetes and was wondering how to do custom and more complex load balancing. So far I already read about Kubernetes offering "Services" which do load balancing for pods hidden behind them, but this…
10
votes
2 answers

Subdomain & Pricing of Google-managed SSL certificate in Load Balancing

Can anyone help me with the pricing and support for Subdomain for Google-managed SSL certificate in Load Balancing. I am working with https for Static…
10
votes
2 answers

Ribbon load balancer with webclient differs from rest template one (not properly balanced)

I've tried to use WebClient with LoadBalancerExchangeFilterFunction: WebClient config: @Bean public WebClient myWebClient(final LoadBalancerExchangeFilterFunction lbFunction) { return WebClient.builder() .filter(lbFunction) …