Server Fault Stack Exchange
Server Fault Stack Exchange

Questions tagged [high-load]

All aspects of high-loaded systems development and maintenance.

All aspects of high-loaded systems development and maintenance: design, algorithms, architecture, technologies, development, testing, databases, storage, support, hardware, hosting, management.

222 questions
2
votes
2 answers

store high amount of photos (150 million) and make available for web

For a actual project I must setup a high-available storage server who can store and publish (http) 150 million photos in 7 sizes means total 1050 million files. For every photo we need total 200 KB space to store them in all 7 sizes in total 28 TB.…
nenad007
  • 31
  • 5
2
votes
5 answers

High load on server

I have a cpanel LAMP dedicated server and I've been having load problems the last 2 days. This is what my top looks like (sorted by M): top - 14:26:04 up 1 day, 1:08, 2 users, load average: 33.10, 36.63, 38.92 Tasks: 359 total, 1 running, 355…
vassilis
  • 121
  • 4
2
votes
8 answers

Suggestions for programming language and database for a high end database querying system (>50 million queries a day)?

These requirements are sketchy at the moment, but will appreciate any insights. We are exploring what would be required to build a system that can handle 50 database million queries a day - specifiically from the programming language and database…
user36981
  • 135
  • 4
2
votes
0 answers

MariaDB high %sys load on AMD compared to Intel

we have run into a issue with MariaDB and AMD Epyc 7402. We also have much less potent Intel servers that do not suffer from this problem, using exact same configuration (we are using ansible). Under more than about 15% total cpu load in %usr, there…
Integral
  • 21
  • 2
2
votes
3 answers

MariaDB crazy at 500% cpu time

GLOBAL STATUS MariaDB [(none)]> SHOW GLOBAL STATUS; +--------------------------------------------------------------+--------------------------------------------------+ | Variable_name | Value …
Mahmoud Moussa
  • 21
  • 2
2
votes
0 answers

High Docker disk read utilization on startup

My Docker server is very slow to start up. It's in Swarm mode, and each service restart (or just server reboot) it uses 100% of disk utilization, however it takes about an hour to start up. I tried determining what takes so much disk utilization via…
Piotr Maślanka
  • 21
  • 2
2
votes
1 answer

RDS MySQL Insights: Top Query "commit"

We are trying to reduce the load on our AWS RDS instance by going through the performance insights. The top SQL statement listed in the insight is "commit": In particular, the commit statement spends most of its time in the "init" state: When…
Simon Ninon
  • 151
  • 5
1
vote
2 answers

How to make high availability web page?

When we need a high availability service (it doesn't meter what kind of service: it can be a database, a queue system, our application) we spread it info many machines to make sure when one machine is down rest of them can take this extra…
Simon
  • 109
  • 2
1
vote
5 answers

What are the tradeoffs between a VMware VM and a local machine for scientific CPU intensive computing?

I have a computing task that will probably run non-stop for several weeks with occasional restarts. My IT folks seem to feel a VMware machine set up on our corporate servers would be a better solution than purchasing a local machine (XEON 5550, 10k…
kpierce8
  • 113
  • 5
1
vote
1 answer

How do I know if my linux server can't keep up with network traffic and what to do about it?

Suppose I have a web-server serving html-pages under high load. Let's assume that for some reason the bottleneck is not cpu, not ram and not disk but rather the network itself. How can I tell that a Linux server simply either sends or receives too…
Gherman
  • 145
  • 6
1
vote
0 answers

Wordpress Cause Too Many Child Process and Very High CPU Load

I have a WordPress site with daily 25K visitor, +3K post and +22K comment. on a VPS with 2 CPU and 8 GB Ram with SSD disk, Centos installed. it was stable but from 20 days I found a very high CPU load and the website has become slow and many…
Ahmad
  • 11
  • 3
1
vote
2 answers

mysqld taking 800% CPU since traffic increased on my site, how to fix

i have centos 7 x64 64 GB RAM and 500 GB of SSD dedicated server., And recently cpu usage was really high, $ uptime 13:50:30 up 169 days, 1:53, 1 user, load average: 37.48, 37.64, 33.60 so i noticed mysqld is taking much more CPU PID USER …
user138870
1
vote
0 answers

Unexplained load on linux vm - not processor, disk io / disk sleep

I have a 2 processor server with Centos7 that's showing unexplained bursty load. top, htop report matching load averages to the graph below but processes do not show up any matching load. No Ds in the process list. iotop seems ok. None of the usual…
b1c9g76
  • 11
  • 2
1
vote
1 answer

Varnish load balancing - does all data flow through varnish making it a bottleneck

When using varnish as a load balancing server, does all data flow through the single varnish load balancer thus bottlenecked by upload speed on well optimized websites serving thousands concurrent visitors?
Bram z
  • 113
  • 5
1
vote
0 answers

High load with Nginx - with low traffic websites

Once in a while (maybe once a day?) I've got a load average of 10. That lasts for like 30 min (where I can't reach any of websites on this server) and then it's fine again. I just happened to be via SSH on the server and did a htop. It's mostly…
Chris
  • 145
  • 1
  • 2
  • 9
1 2 3
…
14 15