Questions tagged [high-load]

All aspects of high-loaded systems development and maintenance.

All aspects of high-loaded systems development and maintenance: design, algorithms, architecture, technologies, development, testing, databases, storage, support, hardware, hosting, management.

222 questions
1
vote
1 answer

Scaling Amazon EC2 instanced when traffic to my app rises

I need your help about scalability on Amazon EC2 instanced. I have developed a web application using asp.net. I have decided that for start, I want to deploy it on a Medium High-CPU Windows Server 2008 instance. I have problem understanding what is…
Liron Harel
  • 431
  • 1
  • 4
  • 13
1
vote
3 answers

How to detect the process (and mysql query) that makes high load on server?

From time to time load on my server (centos 4)jumps to 15 or more. I need to discover what process causes this high load on server. It there any script which can handle this for me ? I think its caused by mysql so even to discover the sql query…
chubbyk
  • 883
  • 2
  • 10
  • 15
1
vote
0 answers

nginx does not close loopback connections

I'm using nginx in reverse-proxy mode. Here's relevant part of config file: server { listen 80; server_name ~^web.redhelper\.ru$ ; access_log off; location /http-bind { proxy_pass …
Poma
  • 1,299
  • 6
  • 24
  • 35
1
vote
0 answers

Grab process information about high process usage

I'm looking to grab process information about processes that are using over a certain CPU limit. Ex: #!/usr/bin/env python def get_processes_over_usage(cpu_usage): #Find the processes. return processes Specifically, I'm looking for the…
xaav
  • 191
  • 1
  • 1
  • 6
1
vote
2 answers

How do I optimize a high traffic Wordpress website?

I am running a wordpress based site which is now hosted on (mt) under DV-Extreme package 2GB+256MB addon RAM. It a muti author site where people are engaged in writing posts, comments, updating status etc. According to Google Analytics this month…
mha
  • 113
  • 3
1
vote
1 answer

Find High Load Culprit (Apache) on CentOS 7

I have a CentOS 7 server on AWS w/ 4 CPU and 8 GB RAM. Starting late last week I started getting HIGH load spikes several times a day w/ Apache appearing to be the culprit. It's fully up-to-date w/ the latest packages. To try and isolate, I…
1
vote
1 answer

nginx container uses only one out of 4 cores

created an Nginx container with 4 static CPUs docker run -tid --cpus 4 --cpuset-cpus 6,7,8,9 --net=host --name mynginx nginx docker exec -ti mynginx cat /etc/nginx/nginx.conf|grep worker_processes worker_processes auto; Assigned CPUs taskset…
ananthan
  • 1,510
  • 1
  • 18
  • 28
1
vote
0 answers

High Load Average in Solaris Operating System - Due to high read I/O

In Linux OS, the load average is dependent on multiple factors like CPU utilization, number of uninterruptible sleep processes, and others. On the other hand, Solaris OS load average is dependent on the number of runnable and running processes. I…
1
vote
4 answers

What is the recommended GlusterFS configuration for a growing website?

I have a website that is tracking towards 50 million hits per day average, and within the next 3 months should be over 100 million hits per day. We are trying to use GlusterFS v 3.0.0 (with latest patches as of 1-17-2010) Currently, we have just…
montana
1
vote
2 answers

How to diagnose what Java process is doing in kernel space

We have a problem with one Spark (Java) application on our Hadoop cluster. When this workload gets scheduled on 3 machines in our cluster kernel space CPU usage gets a very high. Example recording from sar: 09:35:52 CPU %user %nice …
notaras
  • 11
  • 2
1
vote
0 answers

PHP high I/O after a DDoS attack

I've had a large scale DDoS attack on my website. After I've enabled captcha challenge through CloudFlare and the attack stopped, PHP's I/O was still loaded at 99%, and the website was working very slow. Only after a php restart things came back to…
HTMHell
  • 173
  • 4
  • 10
1
vote
0 answers

How to improve performance of Nginx for high PHP processing load?

I wonder how I could improve the performance of my server? It is configured with Ubuntu 18.04 (LTS), 4 GB RAM, 100 GB SSD, 2 CPU, with Nginx 1.14.0 and PHP 7.2-fpm to handle running and serving a site that generates dynamic pages from a database.…
C.A. Vuyk
  • 632
  • 10
  • 18
0
votes
1 answer

Is it considered "safe" to run a task with high I/O on a server for 3 days straight, or would you add pauses in it?

I want to hash the contents of 4 million JPEG files taking up 32TB of a 48TB RAID6 partition in CentOS 7. It's a Hetzner SX131 10 x 6TB box. Having run a test on 10,000 files I think the full job is going to take 72 hours. Would you just set it and…
Codemonkey
  • 1,086
  • 4
  • 19
  • 41
0
votes
1 answer

Load is 4000, CPU flatlined, remote reboot does nothing

I have a Debian 9 server and the load is over 4000. "top" claims there are 18,132 processes sleeping. Initially, I saw many "ps" processes, hundreds, so I killed them all by name. I don't see any offending processes currently, but the load remains.…
Corepuncher
  • 191
  • 1
  • 3
  • 9
0
votes
0 answers

Need to correlate ps and load average

Let's say that I have 4 CPUs. In that case, load average should not go beyond 4 for better performance, it means only 4 threads can be run at a time (i.e., only 4 should be in R status in ps output). Correct me if I'm wrong. A Java program with…
KALAI SELVAN
  • 119
  • 4