1

We have many CentOS6.5 servers on ESXI5.5. Storages for vmdk is SAN ISCI. I have problem with bad ratio for write/read.

On storages I have about 2500 write io and e.g 200 read! For all time in day. For night is it about 1500/100e.g.

Bellow is image from munin for six servers. As you can see all have more writes.

LogVol00 is OS and MySQL. LogVol01 is webpages data and apache logs. Typically LAMP server:).

Do you have any ide why is it?

Thank you!

enter image description here

Pavel
  • 417
  • 1
  • 7
  • 17

1 Answers1

0

My first thought is: access times.

Unless you've disabled them (or your distro has, but pretty sure RHEL6/CentOS6 don't by default), Linux will by default maintain access timestamps on all files and directories. That means any time the OS reads a file, even just a stat, it will generate a write to update the timestamp.

Try mounting LogVol00 and/or LogVol01 with the "noatime" mount option.

Additionally, Apache access attempts almost surely generate writes (access_log, possibly error_log), but may not generate reads, because of the Linux VFS cache intercepting and serving those out before they hit the disk.

With MySQL, check to see if the general query log or slow query log are enabled. That's one way that things that should only be reads might end up generating unexpected writes. MySQL tuning is a big topic in itself, so I'll just add- look over your MySQL settings... internal cache hit rates, etc. Could be it's hitting disk for things like temp tables more than it should.

Failing all that, you might check that the app running on these isn't doing something unusual. For example, I've seen web apps that do things like store analytical data in the database- convenient, but can easily turn read-centric workloads into write-centric ones.

jakem
  • 26
  • 2
  • Hi Jakem, I know this possible issues. Noatime is set, slow log are off. Apache logs are on LogVol01, but many IO are on 00 too. I set tmpdir for RAM now, but without big effect for IO. Any next idea?:) – Pavel May 26 '14 at 17:59
  • Sorry, not sure where to go from there. I'd recommend checking the load caused by "locatedb", but that seems unlikely to be causing lots of *writes*. – jakem May 27 '14 at 05:30