Questions tagged [scalability]

The ability of a system, network, or process, to handle growing amounts of work in a graceful manner or its ability to be enlarged to accommodate that growth.

Scalability is the capability to increase resources to yield a linear (ideally) increase in service capacity. The key characteristic of a scalable application is that additional load only requires additional resources rather than extensive modification of the application itself.

Although raw performance makes a difference in determining the number of users that an application can support, scalability and performance are two separate entities. In fact, performance efforts can sometimes be opposed to scalability efforts.
/msdn/

A system whose performance improves after adding hardware, proportionally to the capacity added, is said to be a scalable system. An algorithm, design, networking protocol, program, or other system is said to scale, if it is suitably efficient and practical when applied to large situations (e.g. a large input data set or a large number of participating nodes in the case of a distributed system). If the design fails when the quantity increases, it does not scale.
/wikipedia/

Scalability is a general quality that holds when the system continues to satisfy its requirements when various usage parameters are increased.

E.g., a file server might be scalable to a high number of users, or to very large files or very high capacity disks.

Scalability goals:

  • Performance under load
    This is a specific type of scalability goal dealing with the performance of the system at times when it is servicing many requests from many users.
  • Large data volume
    This is a specific type of scalability goal dealing with the ability for the system to handle large data sets. Operations should continue to be correct and efficient as data set size increases. Furthermore, the user interface should still be usable as the data presented to users increases in length.
241 questions
2
votes
2 answers

How to load balance > C100K?

Suppose that a hypotetical webapp keeps one connections per user (eg: chat app using comet, long pooling, etc...). How can i load balance such thing to scale beyond the connection limit of a single machine (C10[0]K) ? I can see round robin DNS as a…
2
votes
1 answer

M-M or M-S replication of EBS volume across multiple EC2 instances

I would like to share EBS backed file system of size up to 20GB in 200K files across multiple EC2 instances. Master-master would be ideal, but I'd be happy with master-slave solution too. I know that generic Linux solution would be to use DRBD, but…
vartec
  • 6,217
  • 2
  • 33
  • 49
2
votes
2 answers

web app reaching emailing limits - what is the next step up?

Recently i have been working on a popular web app that currently has around 70k members and a lot of traffic, i migrated the site to a new extra large EC2 instance and it seems to be a massive improvement, the site is a lot faster now and all images…
David
  • 123
  • 3
2
votes
2 answers

Enterprise scaling - hardware & server tips

Things change when you are delivering to a large enterprise audience. What are the most important things to think about in relation to your server or server farm when scaling to a very large user base?
Chris Ballance
  • 304
  • 1
  • 7
  • 20
2
votes
5 answers

Will having 3 servers + load balancer help in my situation?

I want to upgrade my server because of the high mysql loads causing slowness + whenever there were backup processes running on the DB, the DB would be inaccessible, so wanted some solution. My current server is an Opteron 2212 with 8GB RAM. My web…
2
votes
2 answers

Best way to prepare for one time digg-like effect

I have a web site which will be featured in a place which will send a large peak of one-time traffic in a couple of weeks. The server hosting the website also hosts the control panel my customers use. The website part is simple and mostly static.…
Niro
  • 1,401
  • 4
  • 20
  • 36
2
votes
1 answer

How to scale out by elvolving from database partitions to sharding?

Say I have a MySQL table: CREATE TABLE tweets ( tweet_id INT NOT NULL AUTO_INCREMENT, author_id INT NOT NULL, text CHAR(140) NOT NULL, PRIMARY KEY (tweet_id) ) PARTITION BY HASH(tweet_id) PARTITIONS 12; All is good. The table lives on a single…
Continuation
  • 3,080
  • 5
  • 30
  • 38
2
votes
2 answers

Designing a web application to scale

While designing a web application facebook application to be precise. Which can spike and increase rapidly because of it vitality and is right intensive. What point should one keep in mind while designing the DB. For example what things should I…
Fahim Akhter
  • 133
  • 1
  • 6
2
votes
1 answer

Does PHP *have* to serialize/unserialize session data between each HTTP request? Or is there a setting just to keep sessions in memory?

I think I understand why sessions are evil but for snappy client user experience I don't want to have to re-query the database on each HTTP request. (As a comparision, Java servlets can effortlessly keep tons of session objects in memory.) Can PHP…
Pete Alvin
  • 281
  • 2
  • 4
  • 12
2
votes
1 answer

What database is easy to maintain and manage in a cluster?

I'm looking for a database (DBMS) that is easy to scale out. I would like to have high availability so I need a multi-master cluster, where the data is replicated to two or more physical computers. I would also like to be able to start with one node…
Jonas
  • 1,187
  • 5
  • 19
  • 33
2
votes
0 answers

Vertically scale server in cloud without restart

For a current project of mine I need a cloud service which can (automatically) scale VMs vertically as the workload can not be scaled horizontally. With scaling I mean assigning more RAM and/or CPU cores to a given instance. This has to happen…
J Heschl
  • 121
  • 1
1
vote
0 answers

Can't scale write bandwidth on Linux with Intel Optanes

I have a computer with 3 Intel Optane drives and iotop shows that sequential write to each one separately achieves ~2.2 GB/sec. I suppose that simultaneous writing on all three would result in ~6.6 GB/sec. But in reality I got only 3 GB/sec if I try…
John Smith
  • 11
  • 1
1
vote
4 answers

file share system architecture asking for advice

I am using Windows platform to setup a web based file share system. In more details, individual users could upload and share documents from web interface (content may be big document, like video files), similar scenario to Google Docs. My current…
1
vote
0 answers

Autoscaling cloud web applications- what method do people use to establish which metric is most suitable to scale off?

I understand with applications hosted in the Cloud, autoscaling is now a very popular method of ensuring applications can scale based on fluctuations load/work. From my reading, I know that most, if not all cloud providers allow users to define…
1
vote
1 answer

Scaling AWS ASG by RequestCount in ELB

We've determined a base metric that the servers in our ASG can handle about 1000 requests per minute. Given that information, we'd like to be able to control the scaling of our ASG based on the RequestCount metric on the ELB. We'd like to do…
jzimmerman2011
  • 323
  • 1
  • 4
  • 12