Questions tagged [scalability]

The ability of a system, network, or process, to handle growing amounts of work in a graceful manner or its ability to be enlarged to accommodate that growth.

Scalability is the capability to increase resources to yield a linear (ideally) increase in service capacity. The key characteristic of a scalable application is that additional load only requires additional resources rather than extensive modification of the application itself.

Although raw performance makes a difference in determining the number of users that an application can support, scalability and performance are two separate entities. In fact, performance efforts can sometimes be opposed to scalability efforts.
/msdn/

A system whose performance improves after adding hardware, proportionally to the capacity added, is said to be a scalable system. An algorithm, design, networking protocol, program, or other system is said to scale, if it is suitably efficient and practical when applied to large situations (e.g. a large input data set or a large number of participating nodes in the case of a distributed system). If the design fails when the quantity increases, it does not scale.
/wikipedia/

Scalability is a general quality that holds when the system continues to satisfy its requirements when various usage parameters are increased.

E.g., a file server might be scalable to a high number of users, or to very large files or very high capacity disks.

Scalability goals:

  • Performance under load
    This is a specific type of scalability goal dealing with the performance of the system at times when it is servicing many requests from many users.
  • Large data volume
    This is a specific type of scalability goal dealing with the ability for the system to handle large data sets. Operations should continue to be correct and efficient as data set size increases. Furthermore, the user interface should still be usable as the data presented to users increases in length.
241 questions
1
vote
2 answers

Push sub-database to master-database?

Say, I have a big database globalclients which is very very big. Now, I divide this big database to 100 sub-databases, as: chinaclients japanclients koreaclients indiaclients brazilclients etc. Each one running in the corresponding country. Now, I…
Lenik
  • 792
  • 8
  • 13
  • 27
1
vote
1 answer

Too Many/A Lot of Public SSH Keys

A new thing I have been tasked with trying/exploring is setting up a server that will essentially have 200 to 300 people ssh'ing into a single user to run a task. They might only need to do it once a day or several times a day. The problem is that…
Buddy Lindsey
  • 269
  • 3
  • 9
1
vote
1 answer

Is it a good idea to separate the Database and the website files in 2 shared hosting?

Do you think If I did separate the db and the files will make it performs better? and is this easy thing to do? What if I upgrade later on to 2 VPS as well, can I do the same thing without affecting both?
Goma
  • 217
  • 1
  • 3
  • 10
1
vote
1 answer

COM+/Desktop Heap errors in IIS affecting sites at random?

We have a Win2K3 server that is hosting 30+ sites. Each site is configured to have its own unique application pool -- so that we can manually recycle specific sites if needed and not kill sessions for the others. From what I've read, the…
tresstylez
  • 378
  • 1
  • 4
  • 17
1
vote
4 answers

How should I host a site that could potentially get a short spike in traffic of 1000%+

This is a purely theoretical question, but what if I had a site that would normally only get a couple thousand hits a day, but for a few days each month that could shoot to several hundred thousand or even several million hits over the period of 1-3…
James Simpson
  • 1,651
  • 2
  • 15
  • 31
1
vote
2 answers

How to theoretically prevent hardware failures in a collection of 10,000 servers?

From a book about warehouse-scale computers: Although it might be theoretically possible to prevent hardware failures in a collection of 10,000 servers, it would surely be extremely expensive. How is it theoretically possible? Hardware failures…
funk-shun
1
vote
5 answers

How many site visitors can my server handle?

Possible Duplicate: How do you do Load Testing and Capacity Planning for Web Sites I have a website, and I want to host it on my own computer, but I'm wondering if it's good enough. The website checks if the user is logged in and then displays…
coolboycsaba
  • 11
  • 1
  • 2
1
vote
1 answer

How to scale out image hosting/serving?

I asked this question on stackoverflow and it was suggested that I try it here: I'm building a website where users can upload photos and I'd also convert uploaded photos into thumbnails. Planning ahead, if the website gets popular, how do I scale it…
Continuation
  • 3,080
  • 5
  • 30
  • 38
1
vote
1 answer

best practice with memcache/php - multi memcache nodes

So I am working on a web app - that has to be built for scalability. It stores frequent MySQL querys into the cache. I have pretty much everything built and ready to go - but I am concerned on best practices on handling where to cache the data. I've…
user62835
1
vote
3 answers

What is the best way to seed 20.000+ torrents

What is the best (most stable) way to seed 20.000+ torrents on 1 server?
Tim
1
vote
3 answers

Scalable database architecture for heavy read and heavy write?

I am developing a web application which will require scaling to multiple servers. I'll need multiple web servers running my application code, and there will be heavy reads and heavy writes to the database. Clearly I cannot just use one…
Chad Johnson
  • 489
  • 2
  • 7
  • 14
1
vote
3 answers

How to make PHP more scalable on Unix Apache

I'm looking for free/low cost ways to make PHP running on our Unix Solaris servers (under Apache) more scalable and reliable. Do you recommend the free version of the Zend Server? Are there other solutions? This is for a site that on occasion…
Alex
  • 271
  • 3
  • 14
1
vote
2 answers

How to configure reverse proxy/loadbalancer for custom routing

Suppose I have 3 webservers behind a reverse proxy/loadbalancer. Currently I use Apache 2 but don't mind switching. Those webservers are not equal. They have different sets of local data meaning that different kinds of requests will be handled more…
artemb
  • 113
  • 2
1
vote
1 answer

Are there any pitfalls with having multiple MySQL databases on 1 server node?

I want to prepare my database for sharding in the future. But right now I only need 1 node. What I'd like to do is to shard the database into virtual shards, say 12 shards, and put all of them onto the same server node for now. And when I need to…
Continuation
  • 3,080
  • 5
  • 30
  • 38
1
vote
3 answers

What kind of server is used by sites like Pandora or Last.fm to serve media files?

What kind of server is used by sites like Pandora or Last.fm to serve media files? I am assuming they would have something other than webserver for storing and serving media files... what are some of the scalable solutions..
StackUnderflow