Questions tagged [disk-io]

Input/Output operations involving local persistent storage.

Common topics using this tag:

  • I/O-Bounded operations
  • General interaction with local storage

Useful Links

138 questions
0
votes
1 answer

How to use libevent to detect when file lock is released?

While using libevent for detecting read/write readiness of non-blocking disk file descriptors (for files gaurded by mandatory locking), I faced the following issue: When a file is locked for IO by another process, I get EAGAIN in current process…
skaur
  • 168
  • 2
  • 11
0
votes
1 answer

Windows - Prevent actual writing to directory

I use an application from a 3rd party that writes constantly (about 2k per second - about 80 megs per day) to a log file. I do not believe that the application reads from the log file, I believe that its just there for debugging purposes. This is a…
0
votes
1 answer

EC2 - High CPU and High Disk Reads - Crash

For some reason today my EC2 server keeps hitting 100% CPU and high disk reads. I've turned all of my cronjobs off, and yet it's still happening. My Database is an RDS outside the server. Any initial items I should check? I'm using PHP scripts for…
0
votes
2 answers

Why does this programs give segmentation fault?

This is a program that I wrote to check bytes between a file and a disk. #include #include #include #define BYTES_TO_READ 64 int main(int argc, char **argv) { int device = open("/dev/sdz", O_RDWR); if(device <…
vfsoraki
  • 2,186
  • 1
  • 20
  • 45
0
votes
1 answer

HDFS random read and disk IO

When we read a single byte from HDFS file, does it mean a full HDFS block gets read from the disk somewhere on the cluster (assuming no caching involved)?
Ivan Balashov
  • 1,897
  • 1
  • 23
  • 33
0
votes
2 answers

Efficient way of file logging

I have to log huge amount of data in a CSV file with each row having 5 elements. I have used a large buffer to store the rows and then flush it in one shot using fwrite(...) when it gets filled and repeat till needed. The following is a snippet of…
Bit Manipulator
  • 248
  • 1
  • 2
  • 17
0
votes
1 answer

Best Ways to reduce Disk IO On Linux Server

We have several linux servers, opensuse and centOS. Hosted at linode and namecheap. All of them, at varying frequency, warn, or crash due to high Disk IO. My question is simple. How can you reduce disk IO. This is a general question, not specific to…
alpha1
  • 157
  • 8
0
votes
1 answer

Is there any disk I/O operation done before the transaction is commited in Sqlite?

My sqlite database has only one table. This is what I am gonna do: Create the database with one table inside it, insert 10,000 records in that table, create the required indices on some columns and then close the connection to the database. I am…
B Faley
  • 17,120
  • 43
  • 133
  • 223
0
votes
1 answer

Minimizing throughput hits on disk I/O in Java?

I recently read a suggestion for using Java's BufferedOutputStream more efficiently by setting the buffer size to 8MB to "reduce throughput hits from disk seeking". I am intrigued by this last statement: reducing throughput hits from disk…
user1768830
0
votes
1 answer

Is there open source Cloud File System available?

A cloud file system is required for my current project(a cloud FTP exactly). Are there any open source implementations available? If yes, could you please give me some reference. If there is some technical report related to the implementation, that…
Summer_More_More_Tea
  • 12,740
  • 12
  • 51
  • 83
-1
votes
1 answer

Why CPU reset when no `cli`

I am trying to write a bootloader by myself, but qemu-system-i386 CPU will reset probabilistically. But bochs does not have this problem. Why? my code is mbr.s and loader.s: # cat mbr.s %include "boot.inc" SECTION MBR vstart=0x7c00 ... …
chenhao
  • 19
  • 6
-1
votes
2 answers

unexpected I/O improvement with openmp

I have 5 vectors with different sizes in a vector (levelFreqs) and I have written a sequential code and a parallel code to store these vectors on a single disk (no parallel file system). What I see is that openMP can improve the writing time 3X with…
Shan
  • 53
  • 4
-1
votes
1 answer

Trobleshooting slow writes on hpux

Could anyone offer any troubleshooting ideas or pointers on where/how to get more information on the difference between sys and real time from the output below? It is my understanding that the command finished processing in the OS in 4 seconds, but…
Cac3a
  • 117
  • 1
  • 10
-1
votes
1 answer

how to achieve disk write speed as high as fio does?

I bought a Highpoint a HBA card with 4 Samsung 960PRO in it.As the official site said this card can perform 7500MB/s in writing and 13000MB/s in reading. When I test this card with fio in my ubuntu 16.04 system,I got a writing speed of about…
-1
votes
1 answer

Python Writing a 512-byte block of zeros to /dev/sda works, but doesn't behave like it is working

Here I am trying to create a function to (eventually) support the wiping of drives using multiple specifications. The problem I am running in to, is when I try to write ZeroBlock to the disk, it gets written, but the code behaves as thou it has…
AntonTakk
  • 3
  • 2
1 2 3
9
10