I've got a server with real big hardware. (32 cores, 24Go Ram, MegaSAs Raid.... ).
It's running LAMP server, with memcached. It's running a fresh and up-to-date gentoo server, with custom kernel At some "random" times (I say random because that seems to not be link to loadAvg, peaks of disk/io or number of clients) the server seems to lag.
It can make lots of seconds to deliver simple assets files like js Mysql seems to freeze, with a big lot of threads, all stoped on "Sending Data".
In seconds, all could return to normal. Lots of monitoring, but nothing Obvious here. No network errors, D.N.S. config ok, no disk bottleneck ...
In this kind of situation, what could be good suspect ?