Questions tagged [scalability]

The ability of a system, network, or process, to handle growing amounts of work in a graceful manner or its ability to be enlarged to accommodate that growth.

Scalability is the capability to increase resources to yield a linear (ideally) increase in service capacity. The key characteristic of a scalable application is that additional load only requires additional resources rather than extensive modification of the application itself.

Although raw performance makes a difference in determining the number of users that an application can support, scalability and performance are two separate entities. In fact, performance efforts can sometimes be opposed to scalability efforts.
/msdn/

A system whose performance improves after adding hardware, proportionally to the capacity added, is said to be a scalable system. An algorithm, design, networking protocol, program, or other system is said to scale, if it is suitably efficient and practical when applied to large situations (e.g. a large input data set or a large number of participating nodes in the case of a distributed system). If the design fails when the quantity increases, it does not scale.
/wikipedia/

Scalability is a general quality that holds when the system continues to satisfy its requirements when various usage parameters are increased.

E.g., a file server might be scalable to a high number of users, or to very large files or very high capacity disks.

Scalability goals:

  • Performance under load
    This is a specific type of scalability goal dealing with the performance of the system at times when it is servicing many requests from many users.
  • Large data volume
    This is a specific type of scalability goal dealing with the ability for the system to handle large data sets. Operations should continue to be correct and efficient as data set size increases. Furthermore, the user interface should still be usable as the data presented to users increases in length.
241 questions
1
vote
1 answer

Best way to setup hosting and scale SaaS application

I'm a software developer with experience setting up hosting environments for small applications and no more than 5k hits a day type of traffic. I just built a SaaS application and I'm wondering how to setup and plan my server configuration to scale…
FAtBalloon
  • 279
  • 1
  • 4
  • 12
1
vote
1 answer

How can I determine Breaking point of my Web application using JMeter?

How can I determine Breaking point of my Web application using JMeter? I have executed the JMeter Testplan with different concurrent users load. EX. 300 users(0% error), 400 users(7% error in a sample, 5% error in another sample), 500 users(more…
1
vote
1 answer

Distributed SSL session cache

Need to setup a scalable backend infrastructure for a mobile app. Connections to the API need to be SSL encrypted. To achieve a simple scalable solution i don't want to terminate SSL at the load balancers. So my options are to terminate it at the…
Wouter
  • 58
  • 5
1
vote
1 answer

PHP-FPM as a dedicated application server?

Just wondering in terms of scalability .. do you reckon PHP-FPM should run on a standalone server or works as well if you run it with NginX on the same server?
1
vote
2 answers

Load testing nginx inside AWS

I'm trying to load test nginx running on AWS. I need to try to optimise it to handle 1Gbps of inbound traffic. Currently I've got it to peak at 85Mbit/s by running nginx on an m1.large with 4 other machines hitting it by using ab with -i (for head…
andy
  • 159
  • 1
  • 10
1
vote
0 answers

Scaling a video processing application on EC2?

I am approaching the need to scale a video-processign application that runs on EC2. So far the setup is one machine: Backbonejs frontend Rails 3.2 Postgresql Resque + S3 for storage The flow of the app is as follows: 1) Request from frontend.…
Stpn
  • 145
  • 4
1
vote
1 answer

Extremely high loads despite Caching

Okay I've got a nice dedicated server running CentOs 6 with 16gb of ram, dual xenon processors, etc. However I've been experiencing high loads due to mysql. Randomly the load will go below 1.0, and page generation time will be < 30ms, and the site…
Stratus
  • 111
  • 2
1
vote
3 answers

Ad server software for high traffic site

The company I work for runs a web site that gets a little over fifty million hits a month. We are looking at replacing our existing custom-written ad server with a prepackaged solution. It fundamentally must be able to scale up to this level of…
1
vote
0 answers

Whats the next scalability step after seperate mysql farms?

I'm running a saas service which is growing rapidly. The customers are ecommerce websites and we get hit on every page view on each of our customers sites (currently 10M's hits/day). The current architecture is Mysql master/slave farms (run with…
Niro
  • 1,401
  • 4
  • 20
  • 36
1
vote
2 answers

Why doesn't IIS scale consistently?

I have a WCF service (written in .NET 4) running under IIS 7.5 on Windows 2008 R2 64-bit. I created a test tool that spawns 10-20 (or more) threads - each thread creates a random payload and hits the server. On the server, I log all the accesses…
AngryHacker
  • 2,877
  • 6
  • 32
  • 33
1
vote
1 answer

unable to set up the ec2 ubuntu instance for auto scaling

I went through enough number of blog post which actually guides how to set up the auto scaling platform. I am using the Ubuntu ec2 32 bit AMI. From which I am trying to scale the instances, I am trying to set up the auto scaling initially in a micro…
Jeevan Dongre
  • 741
  • 2
  • 17
  • 33
1
vote
3 answers

Why is static page response time going up with increased concurrent requests

I don't understand the performance I'm seeing from apache. I would expect that more concurrent apache requests would perform better than fewer, up to a point, but beyond 3 concurrent requests, overall performance is flat. For example, I see the same…
Dan Benamy
  • 205
  • 1
  • 9
1
vote
2 answers

Scalable Web Application Hardware Topology Best Practice

I'm working with an existing web application developed in Ruby with a MySQL back-end, but I think the generic hardware topology question will apply to a wide variety of server architectures. I'm looking for a document / web resource explaining and…
Dave Rix
  • 325
  • 3
  • 8
1
vote
1 answer

Multiple AWS EC2 Instance with Single Database

Currently we are using One EC2 instance to run our Services. And we are planning to add one more instance to put our application Server. Is it better to put the database in separate instance and query from both instances or is there any better…
panalbish
  • 65
  • 1
  • 1
  • 10
1
vote
2 answers

Open source cloud computing with scalable virtual machines

I'm searching for open source software to create my own cloud computing environment, like Ubuntu UEC or Eucalyptus. What I need is that each virtual machine can use resources from multiple nodes (CPU, RAM). And apparently, neither UEC nor Eucalyptus…