Questions tagged [scalability]

The ability of a system, network, or process, to handle growing amounts of work in a graceful manner or its ability to be enlarged to accommodate that growth.

Scalability is the capability to increase resources to yield a linear (ideally) increase in service capacity. The key characteristic of a scalable application is that additional load only requires additional resources rather than extensive modification of the application itself.

Although raw performance makes a difference in determining the number of users that an application can support, scalability and performance are two separate entities. In fact, performance efforts can sometimes be opposed to scalability efforts.
/msdn/

A system whose performance improves after adding hardware, proportionally to the capacity added, is said to be a scalable system. An algorithm, design, networking protocol, program, or other system is said to scale, if it is suitably efficient and practical when applied to large situations (e.g. a large input data set or a large number of participating nodes in the case of a distributed system). If the design fails when the quantity increases, it does not scale.
/wikipedia/

Scalability is a general quality that holds when the system continues to satisfy its requirements when various usage parameters are increased.

E.g., a file server might be scalable to a high number of users, or to very large files or very high capacity disks.

Scalability goals:

  • Performance under load
    This is a specific type of scalability goal dealing with the performance of the system at times when it is servicing many requests from many users.
  • Large data volume
    This is a specific type of scalability goal dealing with the ability for the system to handle large data sets. Operations should continue to be correct and efficient as data set size increases. Furthermore, the user interface should still be usable as the data presented to users increases in length.
241 questions
8
votes
0 answers

Multithreading with multi-queue NIC on SMP system

How are packets scheduled from network interface queues to CPUs, then onwards to threads for processing? What needs to be considered when it comes to how packets are hashed across queues, hardware interrupts vs softirqs, CPU/memory/app/thread…
svenx
  • 416
  • 3
  • 4
8
votes
4 answers

Ways to auto scale MySQL servers?

I run a site which has high traffic surges and because of that auto scaling solutions is very profitable for this case. Currently the web server is able to horizontally auto scale but the bottleneck is on the MySQL server. I have tried with Amazon…
Zillo
  • 111
  • 2
  • 4
7
votes
1 answer

IPSec software that can use multiple CPU cores

Can anyone recommend a good IPSec software that can use multiple CPU cores to achieve performance ~2Gbps on Linux dual-CPU quad-core E5620 Xeon setup (total 16HT cores)? I have tried OpenSwan and StrongSwan. The OpenSwan KLIPS stack runs only on a…
user389238
  • 632
  • 4
  • 8
  • 18
7
votes
5 answers

Apache on Windows in production environment? Why not?

"Everyone" know that Apache is for Linux/Unix and on Windows IIS is the way to go. However, I'm not a pro at Linux and it would be an enormous relief for me to use just the same setup in the production environment that I use during development. I'm…
tillda
  • 171
  • 1
  • 3
7
votes
4 answers

postgreSQL vs Cassandra vs MongoDB vs Voldemort?

Which database to decide upon? Any comparisions? Existing: postgresql Issues Not easily scalable horizontal. Needs sharding etc Clustering does not solve the data growth problem Looking for: Any database that is easily horizontally scalable …
7
votes
8 answers

Multiple servers vs 1 big server performance

My team of developers has suggested a server structure for an upcoming project we are developing. Our structure is "logical", meaning that the various logical components of the application (it is a distributed one) relies on different servers. Some…
pistacchio
  • 447
  • 7
  • 18
6
votes
2 answers

Intel Xeon processors: Difference between 2S/4S and S2S/S4S scalability

While comparing Intel Xeon E5 and E7 processors, I've noticed that E5 processors are specified for 2S or 4S scalability, while E7 processors are specified for S2S, S4S, or S8S scalability. I understand that the processors are specified for use in up…
bwDraco
  • 1,636
  • 2
  • 12
  • 25
6
votes
2 answers

Load balancer explanation

I'm trying to figure out how exactly the load balancing of sites like facebook/youtube works, but I have few questions. So after alot reading I figured out that loadbalancing looks like this: When loadbalancer should be a server, who split the…
6
votes
3 answers

Memcached Lagging

Let me preface this by saying that this is a followup question to this topic. That was "solved" by switching from Solaris (SmartOS) to Ubuntu for the memcached server. Now we've multiplied load by about 5x and are running into problems again. We are…
Brad Dwyer
  • 263
  • 3
  • 8
6
votes
3 answers

What are the typical methods used to scale up/out email storage servers?

What I've tried: I have two email storage architectures. Old and new. Old: courier-imapds on several (18+) 1TB-storage servers. If one of them show signs of running out of disk space, we migrate a few email accounts to another server. the servers…
nareshov
  • 61
  • 4
5
votes
4 answers

Best way to improve resilience?

One of the major projects I have lined up for 2010 is attempting to mitigate some of the Single Point of Failures (SPOFs) in a network I currently manage. We currently have a single datacentre rack containing a couple of dozen servers. Inside the…
Tom O'Connor
  • 27,480
  • 10
  • 73
  • 148
5
votes
6 answers

(*nix) Cloud/cluster solutions for scalable web-services

I'm going to build a high-performance web service. It should use a database (or any other storage system), some processing language (either scripting or not), and a web-server daemon. The system should be distributed to a large amount of servers so…
kolypto
  • 11,058
  • 12
  • 54
  • 66
5
votes
6 answers

Where does youtube store so many videos?

If we are to make something like youtube, then what should be the approach with respect to storing the videos? Any idea about what youtube does ?
Aditya
5
votes
0 answers

Is RSS (receive side scaling) in Windows considered unstable?

When asking a customer to enable RSS in their data center to improve network performance (very high UDP packets-per-sec rate), I was told that they generally turn it off, because after various problems in the past, Microsoft and the hardware vendor…
5
votes
3 answers

need advice on building a scalable architecture for moodle

I'm looking into designing an architecture for a moodle based education site, it will serve several thousand users at first but needs to be able to grow to support hundreds of thousands to millions of users across several countries. I was thinking…
Robert
  • 241
  • 2
  • 4
  • 7
1
2
3
16 17