Stack Overflow
Stack Overflow

Questions tagged [disk-io]

Input/Output operations involving local persistent storage.

Common topics using this tag:

  • I/O-Bounded operations
  • General interaction with local storage

Useful Links

138 questions
2
votes
1 answer

Best way to save a large binary file by chunks asynchronously in C++

I'm developing a C++ application whose output is a single big binary file (a couple of GBs, basically a large sequence of floats). The content of this file is generated asynchronoulsy by parallel processes. Each time a process finishes, its result…
mma
  • 71
  • 6
2
votes
0 answers

How to clear the hard disk cache programmatically?

Is there a method in Windows to clear the whole disk cache? I am doing benchmarks on a disk and try to measure which of my methods has the best performance in C#. The problem is though that the disk caching in Windows prevents me from from getting…
msedi
  • 1,437
  • 15
  • 25
2
votes
1 answer

Kubernetes node high disk IO and CPU usage

I run a Kubernetes cluster with version 1.5.2, setup with Kops on AWS. The setup has nothing exotic. My nodes run on m4.xlarge with 70 Gb of disk storage with 1000 iops. I have periods where some of my nodes get crazy with iops. Here is what I…
rmonjo
  • 2,675
  • 5
  • 30
  • 37
2
votes
0 answers

collectd + graphite Disk Writes Cumulative Instead Of Per Time Period

Most of the collectd stats (such as memory free/used, etc) for my hosts display in units per time period on graphite, producing jagged graphs as expected. However, when I examine metrics from the collectd disk plugin, I see an ever-rising slope of…
ezekiel68
  • 148
  • 7
2
votes
4 answers

Out of space on NTFS disk after a series of same-sized files creation/deletion

I've ran into a really weird problem while working on a large project. I write a bunch of same-size files on a partition (tried both RAM disks and virtual disks created via diskmgmt.msc). When there is not enough free space to fit another file (as…
Roman Dmitrienko
  • 3,375
  • 3
  • 37
  • 48
2
votes
2 answers

Best way to write logs to SSD

We have an application that does a LOT of logging. The medium we log to is SLC SSD drives however we are starting to see some failures in the field. We could turn logging off (we do), have log levels (we have) however sometimes an engineer turns on…
Sparers
  • 423
  • 5
  • 15
2
votes
0 answers

Per file disk usage statistics C#

Previously, a duplicate was suggested that explains per-process statistics but not per-file which I need. After days searching I can't find any specific way to get Per file disk stats. I'm writing a PerfMonitor and want it to show which file has the…
Rafael
  • 345
  • 3
  • 16
2
votes
1 answer

Saving the state of thousands of objects every 10 seconds

I have a list of about 2000 objects (in this case, Teamspeak channels) and I would like to record (to disk) whether they are empty or not, in order to determine which ones are being used. I'm having trouble solving this since I'm doing 2000 inserts…
Daniel Sorichetti
  • 1,921
  • 1
  • 20
  • 34
2
votes
3 answers

Getting iowait with top and awk

For a benchmark script, I need to extract the iowait % right after a little operation. For now, the best way I find was this: IOWAIT=top -bn2 | awk '$1~/Cpu/ {print $6}' | sed -n '2p' | tr -d '%wa,' The correct output is something like 2.1: First,…
Brice
  • 786
  • 4
  • 16
2
votes
0 answers

OS X: How to programmatically find locked CoreStorageVolumes

I have programmatically find out the status of the CoreStorage volumes. Using IOServiceXyz / IORegistryXyz / ... methods do not work for locked volumes - that means if a user did not (yet) enter the password I do not see informations about this…
user3271138
  • 21
  • 1
2
votes
2 answers

low level C++ style i/o in C# for reading FAT32

I am working on reading the FAT32 entry of the hard disk and so far have been successful in reading the entries by making use of the CreateFile, ReadFile, and SetFilePointer APIs. Here is my code (written in C#) so far. ---The DLL…
Anirudh Goel
  • 4,571
  • 19
  • 79
  • 109
1
vote
4 answers

outputing dictionary optimally

i have 4 dictionarys that contain 800k strings with 200 to 6000 characters. when i load it into memory it takes up about 11 gigs of memory. it is taking me 2 minutes to parse the data and 2 minutes to output the data. is there anyway to output the…
user1158903
1
vote
1 answer

Storing dynamic objects with growing lists on disk

Okay so I have been developing a system so far in main memory that has many different objects and each object stores lists of other objects in the system. Now I want to move this to persistent storage. I'm not looking for the obvious answer of using…
user1084563
  • 2,149
  • 17
  • 28
1
vote
4 answers

Raise I/O error while writing to an unreliable disk in C++

Imagine you have the following in C++: ofstream myfile; myfile.open (argv[1]); if (myfile.is_open()){ for(int n=0;n<=10;n++){ myfile << "index="<
madreblu
  • 373
  • 5
  • 15
1
vote
1 answer

Per-process I/O stats in Linux - TASKSTATS_CMD_ATTR_TGID not working

Linux provides /proc/[pid]/io interface to get I/O stats of a process. But in addition to the accumulated I/O of live threads, read_bytes and write_bytes fields also include the I/O of dead threads and dead children of the process (because fork()…
Irfan Latif
  • 498
  • 2
  • 9
  • 24
1 2
3
…
9 10