I am running an Apache web server on AWS EC2 (c4.xlarge). My site's peak hour is during 8pm - 10pm. For some reason, during the peak hour, the system load just goes off to the roof, while CPU and Memory usage is kinda OK. Also, the number of Apache workers are only hitting 40 (Configured max clients is 80).
The instance is running on AWS EBS (Magnetic drive), but I don't see much IO from the screenshot below.
Any chance the system load is caused by the network bandwidth hitting the limit?
Attached is the Apache (HTTPD) process instances count, CPU and memory usage from NewRelic:
CloudWatch for the EBS attached to the Instance (our local time is UTC+10 hours):