Questions tagged [scalability]

The ability of a system, network, or process, to handle growing amounts of work in a graceful manner or its ability to be enlarged to accommodate that growth.

Scalability is the capability to increase resources to yield a linear (ideally) increase in service capacity. The key characteristic of a scalable application is that additional load only requires additional resources rather than extensive modification of the application itself.

Although raw performance makes a difference in determining the number of users that an application can support, scalability and performance are two separate entities. In fact, performance efforts can sometimes be opposed to scalability efforts.
/msdn/

A system whose performance improves after adding hardware, proportionally to the capacity added, is said to be a scalable system. An algorithm, design, networking protocol, program, or other system is said to scale, if it is suitably efficient and practical when applied to large situations (e.g. a large input data set or a large number of participating nodes in the case of a distributed system). If the design fails when the quantity increases, it does not scale.
/wikipedia/

Scalability is a general quality that holds when the system continues to satisfy its requirements when various usage parameters are increased.

E.g., a file server might be scalable to a high number of users, or to very large files or very high capacity disks.

Scalability goals:

  • Performance under load
    This is a specific type of scalability goal dealing with the performance of the system at times when it is servicing many requests from many users.
  • Large data volume
    This is a specific type of scalability goal dealing with the ability for the system to handle large data sets. Operations should continue to be correct and efficient as data set size increases. Furthermore, the user interface should still be usable as the data presented to users increases in length.
241 questions
4
votes
1 answer

Nginx vs Apache & mod_php for PHP and php+fpm vs fastcgi

It seems to be universally recommended to run Nginx as a reverse proxy in front of Apache but there seems to be a devision in opinion on whether Apache + mod_php or Nginx are better for serving dynamic requests and ditto with php+fpm vs fastcgi when…
ichilton
  • 61
  • 4
4
votes
1 answer

scalability: when to use CDN?

i've read about CDN but dont know exactly what it is for. lets say i've got an international social network (text and image content), and it's growing in traffic from different countries, do i have use of CDN? the picture i got from the sources i've…
ajsie
  • 1,215
  • 4
  • 20
  • 28
4
votes
1 answer

how does a web application cope with thousands of requests?

I went to a few websites and noticed that they all use AJAX technology for many tasks such as chat, messages, and so forth. They use a lot of httprequests obviously. My question is if you build a simple website using AJAX and you expected only few…
netrox
  • 171
  • 7
4
votes
2 answers

10k-20k TCP connections on windows server(s)

What kind of configuration do I need for a Windows based server(s) to support 10K-20K TCP connections simultaneously. 99% of these connection will only send keep alive (but will remain active) signals at 60 seconds interval and rest 1% will be…
Ramesh Soni
  • 162
  • 1
  • 6
4
votes
3 answers

Is there a scalable open source web BB/forum?

Some places say phpBB doesn't scale past 5000 concurrent users. Is there FOSS forum software out there that might go further, to say 7k-10k or more?
jldugger
  • 14,342
  • 20
  • 77
  • 129
4
votes
6 answers

How do I reduce RAM usage on my server?

I have recently launched a site that is very popular but I am having trouble with scalability. My site makes heavy use of FFmpeg and at peak times RAM usage hits the 2 GB point quickly and the swap file starts getting used. CPU usage starts rising…
Abs
  • 1,559
  • 5
  • 19
  • 32
4
votes
2 answers

When do I need more than shared hosting?

What are the guidelines? While the answer could be "when your webpage or queries return slowly -- that answer doesn't quite work for me. What are your reasonable expectations for shared hosting? How do you measure? Pageviews? Visitors? Queries? I'm…
cgp
  • 1,032
  • 3
  • 12
  • 15
3
votes
2 answers

Nosql autoscaling of compute

Most of the nosql autoscaling faces issue due to the fact the data have to be migrated during peak load. What if data is stored in a shared storage like CLVM which has less overhead(compared to NFS or shared file system). Now if each bucket/shard is…
kalyan
  • 249
  • 1
  • 3
  • 11
3
votes
4 answers

Is it normal to get bandwidth as the first scalability bottleneck with a 100 Mbps connection?

I'm stress testing a site that we're making, and we're finding a very surprising result compared to my expectations: Our site starts to load very slow with a few hundred simultaneous people, even though CPU and memory are fine. Looking at Task…
Daniel Magliola
  • 1,432
  • 9
  • 20
  • 33
3
votes
1 answer

How to launch EC2 instance with preconfigured AWS Alarm

I wan't to kill a specific instance when some of it's hardware consumption metrics reaches a certain level. If i create an alarm for the scaling group (setting maximum cpu consumption threshhold to >=50 for example) it will kill the oldest instance…
3
votes
3 answers

How to handle multiple DNS servers efficently?

I've recently added more BIND9 DNS servers to my network, and the work of adding each zone/domain i want the slave nodes to be a slave to is becoming far too repetitive, not to mention that having only one master server creates an easy point of…
ThePopcorn
  • 81
  • 1
  • 2
  • 7
3
votes
2 answers

Standalone / separate server as PHP processor for other nodes

From what I've seen in various docs and example configurations, you could have PHP-FPM set up on a different server/hardware, separate from your webserver (nginx in my case). While most examples list some variation of this: location ~ \.php { …
Andres B
  • 119
  • 6
3
votes
1 answer

Is memory usage the main cause of instance churn on Google App Engine?

I am experiencing sharp drops and spikes in instance count every 30 minutes although the request rate has been stable for 2h at 2.4k RPS. Periodically there are a lot of warmup requests after many instances get shutdown at the same time. This also…
3
votes
1 answer

Using NFS for scalable PHP/MySQL web application

Here's the situation: I have a PHP/MySQL web application that accepts user uploads (pdf files). From these pdf files' pages a preview image is made on the fly and presented to the web app's users. Some pdfs might be on the large side, most will be…
Asciiom
  • 133
  • 4
3
votes
4 answers

How many databases can SQL server express handle

I'm running a SQL EXPRESS 2005 server currently hosting ~50 databases. The databases serve clients' CMS/eCommerce websites. The connections are to a single instance, no user attached instances are being used. Median DB size is 5MB, the largest 20MB.…
felixg
  • 173
  • 1
  • 2
  • 7