Questions tagged [scalability]

The ability of a system, network, or process, to handle growing amounts of work in a graceful manner or its ability to be enlarged to accommodate that growth.

Scalability is the capability to increase resources to yield a linear (ideally) increase in service capacity. The key characteristic of a scalable application is that additional load only requires additional resources rather than extensive modification of the application itself.

Although raw performance makes a difference in determining the number of users that an application can support, scalability and performance are two separate entities. In fact, performance efforts can sometimes be opposed to scalability efforts.
/msdn/

A system whose performance improves after adding hardware, proportionally to the capacity added, is said to be a scalable system. An algorithm, design, networking protocol, program, or other system is said to scale, if it is suitably efficient and practical when applied to large situations (e.g. a large input data set or a large number of participating nodes in the case of a distributed system). If the design fails when the quantity increases, it does not scale.
/wikipedia/

Scalability is a general quality that holds when the system continues to satisfy its requirements when various usage parameters are increased.

E.g., a file server might be scalable to a high number of users, or to very large files or very high capacity disks.

Scalability goals:

  • Performance under load
    This is a specific type of scalability goal dealing with the performance of the system at times when it is servicing many requests from many users.
  • Large data volume
    This is a specific type of scalability goal dealing with the ability for the system to handle large data sets. Operations should continue to be correct and efficient as data set size increases. Furthermore, the user interface should still be usable as the data presented to users increases in length.
241 questions
1
vote
2 answers

Backup strategy for dedicated LEMP stack server

We currently have an application running on a dedicated server which utilizes a LEMP (Linux, Nginx, MariaDB, PHP) stack. Right now we are only doing backups at a set interval (every x hours). I have been researching how we should go about having a…
1
vote
3 answers

Should I start hosting my web server in more that one single server machine?

I'm developing an advertising site for the real estate business. The thing is that it is a startup business and I'm not too positive in thinking that I will get a lot of users very quickly. So, my concern is if it's okay to host all the applications…
demian
1
vote
2 answers

Where could I find some network architecture courses or good books?

The best source that I found is not really a course, is most like a blog with short stories about succed cases of architecture strategies in highscalability.com My concern is if is there any good course or book about IT architecture strategies that…
denica001
1
vote
1 answer

how to scale a high traffic server?

I'm very confused on techniques for scaling servers Say you had one high traffic server running on one computer with one 12 core CPU, and one server for a database. For a while that would work, but what about if the number of concurrent users…
Jamal H
  • 119
  • 4
1
vote
0 answers

Multiple application instances and Docker usage

I have a classical web application (CRM tool) which requires nginx, python (flask), postgresql and redis to work. I plan to sell this application to different companies and host them on my powerful dedicated server and I plan to use Docker to…
1
vote
0 answers

Server and Database layout

MongoDB vs MySQL, Master-Master or Master-Slave? I’m currently developing a service in Laravel for online learning. Basically imagine Memrise.com. Now, my users are going to be doing lots of reads and writes. The writes are going to be small, with 4…
1
vote
2 answers

Scaling a single WordPress website via AWS/EC2

I manage a website that is essentially just a news/blog powered by WordPress. Average users on the site is somewhere between 8-15. But we occasionally break news in our niche where we'll have anywhere from 1.5-5,000 people on. Up until today we were…
1
vote
1 answer

Which requests cause a w3wp process to grow considerably?

On a production environment, how can one discover which Asp.Net http requests, whether aspx or asmx or custom, are causing the most memory pressure within a w3wp.exe process? I don't mean memory leaks here. It's a good healthy application that…
SaintNick
  • 111
  • 2
  • 9
1
vote
0 answers

Make Varnish check for html static before serving

I was thinking of writing some logics to my application so that it can write the static page content to s3 or some CDN and serve primarily from there. But am not sure if this is possible. For example is I have site.com/something, its should look…
Safwan Erooth
  • 273
  • 1
  • 6
1
vote
2 answers

Remote Desktop Services - Scale up vs scale out

I'm currently in the process of planning any required changes to an RDS infrastructure to cater for an upcoming increase in the number of users due to company expansion. Currently, the system only has a single RDS Session Host server. The upcoming…
dbr
  • 1,852
  • 3
  • 23
  • 38
1
vote
1 answer

Managing both servers and Docker containers with serf

I'm using Serf to instead of linking containers together so I can restart Docker containers without links breaking. On each server I run one container with the Serf ports exposed that every other local container links to and then uses Serf to…
1
vote
1 answer

IIS FTP: Should i create sites or folders?

I need to create a service to host several ip cameras, in the beginning 500+. The ip cameras send the files over ftp, so, to identify each camera, the files must go to separated folders. Now the question, does IIS have any issue creating several FTP…
1
vote
1 answer

Is this load balancing / horizontal scaling scheme naive?

I offer my solution to the following problem, and ask you networking and server admin professionals to validate it or poke holes in it. I am interested in any obvious attack vectors or scalability issues you may see. Thanks! Requirements: HTTPS…
drfloob
  • 143
  • 5
1
vote
2 answers

Scaling web application across multiple services

We're developing our web application and have been working on reducing our load times. When we began developing the application, we signed up with a well known hosting provider offering "dedicated solutions" on the cloud. As a result, we have one…
1
vote
1 answer

How to get approx 500request/sec in HAProxy and Tomcat7 with Apache

I have 4 intstances of Tomcat 7 server and deployed my web App on all the instances. I am using HAProxy load balancer for load balancing. In front end I am using Apche2 web server and behind Tomcat 7. HAproxy is redirecting a;; the request towards…
Kumar
  • 211
  • 3
  • 7