While using libevent for detecting read/write readiness of non-blocking disk file descriptors (for files gaurded by mandatory locking), I faced the following issue:
When a file is locked for IO by another process, I get EAGAIN in current process…
I use an application from a 3rd party that writes constantly (about 2k per second - about 80 megs per day) to a log file. I do not believe that the application reads from the log file, I believe that its just there for debugging purposes. This is a…
For some reason today my EC2 server keeps hitting 100% CPU and high disk reads. I've turned all of my cronjobs off, and yet it's still happening. My Database is an RDS outside the server. Any initial items I should check? I'm using PHP scripts for…
This is a program that I wrote to check bytes between a file and a disk.
#include
#include
#include
#define BYTES_TO_READ 64
int main(int argc, char **argv)
{
int device = open("/dev/sdz", O_RDWR);
if(device <…
When we read a single byte from HDFS file, does it mean a full HDFS block gets read from the disk somewhere on the cluster (assuming no caching involved)?
I have to log huge amount of data in a CSV file with each row having 5 elements. I have used a large buffer to store the rows and then flush it in one shot using fwrite(...) when it gets filled and repeat till needed. The following is a snippet of…
We have several linux servers, opensuse and centOS. Hosted at linode and namecheap.
All of them, at varying frequency, warn, or crash due to high Disk IO.
My question is simple. How can you reduce disk IO.
This is a general question, not specific to…
My sqlite database has only one table. This is what I am gonna do: Create the database with one table inside it, insert 10,000 records in that table, create the required indices on some columns and then close the connection to the database. I am…
I recently read a suggestion for using Java's BufferedOutputStream more efficiently by setting the buffer size to 8MB to "reduce throughput hits from disk seeking".
I am intrigued by this last statement: reducing throughput hits from disk…
A cloud file system is required for my current project(a cloud FTP exactly).
Are there any open source implementations available? If yes, could you please give me some reference. If there is some technical report related to the implementation, that…
I am trying to write a bootloader by myself, but qemu-system-i386 CPU will reset probabilistically. But bochs does not have this problem. Why?
my code is mbr.s and loader.s:
# cat mbr.s
%include "boot.inc"
SECTION MBR vstart=0x7c00
...
…
I have 5 vectors with different sizes in a vector (levelFreqs) and I have written a sequential code and a parallel code to store these vectors on a single disk (no parallel file system). What I see is that openMP can improve the writing time 3X with…
Could anyone offer any troubleshooting ideas or pointers on where/how to get more information on the difference between sys and real time from the output below?
It is my understanding that the command finished processing in the OS in 4 seconds, but…
I bought a Highpoint a HBA card with 4 Samsung 960PRO in it.As the official site said this card can perform 7500MB/s in writing and 13000MB/s in reading.
When I test this card with fio in my ubuntu 16.04 system,I got a writing speed of about…
Here I am trying to create a function to (eventually) support the wiping of drives using multiple specifications. The problem I am running in to, is when I try to write ZeroBlock to the disk, it gets written, but the code behaves as thou it has…