Questions tagged [load-balancing]

The term load balancing is used to describe technology that is used to evenly distribute work across multiple nodes within a network.

Load balancing is a computer networking method for distributing workloads across multiple computers or a computer cluster, network links, central processing units, disk drives, or other resources. Successful load balancing optimizes resource use, maximizes throughput, minimizes response time, and avoids overload. Using multiple components with load balancing instead of a single component may increase reliability through redundancy. Load balancing is usually provided by dedicated software or hardware, such as a multilayer switch or a Domain Name System server Process.

5217 questions
12
votes
2 answers

Load balancing gRPC requests using one of AWS Load Balancers

I'm trying to work out whether I could use one of the (A/E/N)LBs to load balance gRPC traffic. A simple round robin would suffice in our case. I've read that ALB doesn't fully support HTTP2 and therefore can't be used with gRPC. Specifically lack of…
sumek
  • 26,495
  • 13
  • 56
  • 75
12
votes
1 answer

How to load balance gRPC on AWS

I've been looking through this for a week and haven't been able to find anything that has helped me. I'll be upfront, I'm new to AWS so I'm sure things are flying over my head. Problem I am currently writing an application which is being deployed to…
12
votes
2 answers

Scalability 101: How can I design a scalable web application using PHP?

I am building a web-application and have a couple of quick questions. From what I learnt, one should not worry about scalability when initially building the app and should only start worrying when the traffic increases. However, this being my first…
Legend
  • 113,822
  • 119
  • 272
  • 400
12
votes
2 answers

How to Install a Godaddy SSL Certificate on Google Cloud Platform

How do you transfer a Godaddy SSL certificate to the Google Cloud Platform? I am trying to setup an HTTPS load balancer on Google Cloud. I have an SSL certificate from Godaddy, but I'm not sure how to input it into Google Cloud. Google has a form to…
speedplane
  • 15,673
  • 16
  • 86
  • 138
12
votes
1 answer

Node.js + Socket.IO scaling with redis + cluster

Currently, I'm faced with the task where I must scale a Node.js app using Amazon EC2. From what I understand, the way to do this is to have each child server use all available processes using cluster, and have sticky connections to ensure that every…
Steve P
  • 319
  • 3
  • 7
12
votes
2 answers

Why client-side load balancers like Ribbon?

Netflix makes use of Ribbon, which is in their terms a "client-side load-balancer". What are the use-cases and advantages of a client-side load-balancer compared to a traditional load-balancer? Is Ribbon, and other Netflix OSS services AWS -specific…
user1340582
  • 19,151
  • 35
  • 115
  • 171
12
votes
3 answers

What is "Reverse Proxy" and "Load Balancing" in Nginx / Web server terms?

These are two phrases I hear about very often, mainly associated with Nginx. Can someone give me a laymans defintion?
robue-a7119895
  • 816
  • 2
  • 11
  • 31
12
votes
1 answer

Difference between pool and cluster

From a purest perspective, they kind of feel like identical concepts. Both manage sets of reosurces/nodes and control their access from or by external components. With a pool, you borrow and return these resources/nodes to and from the pool. With a…
IAmYourFaja
  • 55,468
  • 181
  • 466
  • 756
11
votes
6 answers

Client IP issue address over https with Rackspace Cloud Load Balancers

We're currently using Lighttpd with FastCGI to serve PHP to our clients. We recently added load balancing through RackSpace Cloud to help us handle our traffic however, the client's IP is now the load balancer IP. All traffic is through HTTPS. We've…
11
votes
1 answer

Deploy SPA application on Google Cloud Storage using Load Balancer and CDN

I'm investigating a way of deploying an Angular or React web application on Google Cloud using GCS, Load Balancer, and CDN. I've set up the LB and the GCS using the urlRewrite, but since the LB does not allow full URL rewrite only pathPrefixRewrite,…
11
votes
1 answer

AWS - Difference between ELB_5XXs and HTTP_5XXs

In AWS Cloud watch, what is the difference between ELB_5xx and Http_5xx errors? And then there is also Backend_connection_errors.
peakit
  • 28,597
  • 27
  • 63
  • 80
11
votes
4 answers

Domain driven design concepts and relation with CQRS

I recently started to become familiar with DDD concepts and CQRS and I realized that one of the most important concepts in CQRS is DDD beside load balancing, NServiceBus and etc but I am curious if we can use DDD concept alone without using it in…
sajadre
  • 1,141
  • 2
  • 15
  • 30
11
votes
2 answers

Is it possible to health check a Kubernetes API server over HTTP or TCP?

I need to load balance a cluster of Kubernetes API servers (version 1.7) on DigitalOcean, but the problem is that the Kubernetes API server seemingly only supports HTTPS and the DigitalOcean load balancer can only do HTTP or TCP health checks. Is…
aknuds1
  • 65,625
  • 67
  • 195
  • 317
11
votes
4 answers

Does AWS support weighted load balancing?

Does AWS natively support weighted load balancing? From what I see, ELB does only support round-robin load balancing (without any configurable weights). I have not found reliable documentation on it, though. The easiest thing that I can think of is…
11
votes
1 answer

Google Cloud LB: Change "server error" default html page

By default, if the load balance can't find a backend to redirect traffic to, for example if all available backends are down, it shows this html page: Transcript: Error: Server Error The server encountered a temporary error and could not complete…