Questions tagged [scalability]

The ability of a system, network, or process, to handle growing amounts of work in a graceful manner or its ability to be enlarged to accommodate that growth.

Scalability is the capability to increase resources to yield a linear (ideally) increase in service capacity. The key characteristic of a scalable application is that additional load only requires additional resources rather than extensive modification of the application itself.

Although raw performance makes a difference in determining the number of users that an application can support, scalability and performance are two separate entities. In fact, performance efforts can sometimes be opposed to scalability efforts.
/msdn/

A system whose performance improves after adding hardware, proportionally to the capacity added, is said to be a scalable system. An algorithm, design, networking protocol, program, or other system is said to scale, if it is suitably efficient and practical when applied to large situations (e.g. a large input data set or a large number of participating nodes in the case of a distributed system). If the design fails when the quantity increases, it does not scale.
/wikipedia/

Scalability is a general quality that holds when the system continues to satisfy its requirements when various usage parameters are increased.

E.g., a file server might be scalable to a high number of users, or to very large files or very high capacity disks.

Scalability goals:

  • Performance under load
    This is a specific type of scalability goal dealing with the performance of the system at times when it is servicing many requests from many users.
  • Large data volume
    This is a specific type of scalability goal dealing with the ability for the system to handle large data sets. Operations should continue to be correct and efficient as data set size increases. Furthermore, the user interface should still be usable as the data presented to users increases in length.
241 questions
1
vote
1 answer

Tomcat scalability - how many servers

I'm trying to size a tomcat cluster. The key factors will most likely be: The size of clustered in-memory cache we decide to use. So for example, if we wanted to support 100GB in-memory cache, then we might need 50 instances (assuming 2GB max heap…
toolkit
  • 402
  • 6
  • 10
1
vote
3 answers

google search engine architecture- how do so many concurrent users do a search on it

With millions of users searching for so many things on google, yahoo and so on. How can the server handle so many concurrent searches? I have no clue as to how they made it so scalable. Any insight into their architecture would be welcomed.
stonebold
1
vote
2 answers

What techniques do you use to design and scale a web app horizontally (in EC2)?

Specifically I'm looking for techniques for scaling a web application which has no central database server, in the cloud, but general advice is great. I have come across GlusterFS, which looks great, but I'm not yet clear how it fits into the…
jberryman
  • 914
  • 2
  • 10
  • 25
1
vote
5 answers

I have to shard a mysql database. I want to start with 12 shards on 2 machines. What is the best way to move some of them when I want to add a new server?

All tables are InnoDb. I would rather not use mysqldump, because the shard sizes will be about 200 GB (about 700 million rows), and that will take too long. I was hoping to just stop mysql for an hour, copy the data files to a new machine, and…
Tim
  • 71
  • 4
1
vote
3 answers

Sharing / replicating EBS across AWS nodes

I would like to use single EBS storage across multiple EC2 nodes (web/app servers). I've read some articles on snapshot sharing, but that doesn't suit well for what we need. We use filesystem for storing DB record attachments, so if one such…
skrat
  • 505
  • 1
  • 7
  • 14
1
vote
1 answer

Safely abort Ansible playbooks when server downtime runs out

Afaik ansible offers no possibility to safely exit a running playbook, so I am wondering which strategy would be wise to not leave hosts in inconstistent states: Lets picture an infrastructure of ~300 database hosts and a weekly downtime of only few…
1
vote
4 answers

How to scale beyond 150 page views per minute?

I have a Facebook app written in PHP. It has 150 page views per minute and will have up to 300 page views per minute till end of this year. While getting more PV I start to have problems with scalability and therefore I would like to ask you for an…
Tom Smykowski
  • 1,125
  • 5
  • 19
  • 27
1
vote
0 answers

RabbitMQ Stomp one central Node or domain based?

We have a server with about 400 instances of an application, each of these instances has its own domain. We want to set up a RabbitMQ(other server) , also Stomp(websockets) for the Frontend and amqp through the backend application. We have the…
demonking
  • 131
  • 3
1
vote
1 answer

How (if at all) is KVM used with enterprise workloads?

This is sort of similar to Q123566, but I want to add a few clarifications: KVM is the Linux-kernel-based virtualization technology (specifically: a hypervisor) that underlies most non-Xen FOSS virtualization platforms/tools. QEMU is an atomic…
0
votes
1 answer

Can logstash be used as a kafka forwarder?

I am looking at the plugins for Logstash and I noticed it had both an input and output plugin for kafka. For a single topic, can Logstash be used to forward kafka topic messages to another kafka server or should I expect there to be some data loss?
Archimedes Trajano
  • 505
  • 2
  • 8
  • 20
0
votes
2 answers

how many databases can a single server handle?

I heard that in general, you don't see a single server running sqlserver having more than 100-150 databases on it. Is this the same case with mysql or postgres?
user2659
  • 1,152
  • 4
  • 20
  • 32
0
votes
1 answer

Servlet hosting with peak capacity

I am hosting a website that is currently run on Google Cloud Storage, and a completely static interface. I am considering upgrading it to allow for better plotting tools, which will require it to run a server, in this case a Java Servlet. The…
0
votes
0 answers

Distribute "RTMP to HLS" process on multiple servers

I have configured a simple live streaming service, for a limited broadcaster, according to this schema: actual service configuration There is a "origin" server where I've installed the NGINX and RTMP modules. This server receives RTMP streams and…
0
votes
2 answers

Efficient large file delivery over web

In the last few weeks we started serving more and more videos by http, ranging from 50 to 500mb each, and as we didn't had a new server to use it just for that i set it up on our live streaming server. The box is pretty decent imho (2 x quad at…
user27056