I know, process can use disk cache as free memory as required. In my 32 bit machine I can see, disk cache can use all free memory. But in 64 bit machine can't. In 64 bit machine, I have 252GB RAM(free command), 24 cores, and 90 jbod disks. Running 45 java servers with -Xmx2000m to read/write small files form/to disks.
Every 4/8/10/13 hrs, I'm getting sudden disk cache drop also. I can see after disk cache drop, next 5-6 hrs disk cache reach to ~110 GB, but after that for next 4-5 hrs it is not crossing this ~110GB limit(but still have ~80GB free), then sudden whole disk cache getting drop.
I have no idea what is going on here. Please suggest me : is there any system configuration to solve this, or have jbod/memory problem, if so then how to solve.
Using linux OS and 64 bit JVM.
free -g
total used free shared buffers cached
Mem: 252 162 89 0 42 80
-/+ buffers/cache: 39 212
Swap: 1 0 1