Questions tagged [filesystems]

A file system (or filesystem) is a means to organize data expected to be retained after a program terminates by providing procedures to store, retrieve and update data, as well as manage the available space on the device(s) which contain it.

A file system (or filesystem) is a means to organize data expected to be retained after a program terminates by providing procedures to store, retrieve and update data, as well as manage the available space on the device(s) which contain it. A file system organizes data in an efficient manner and is tuned to the specific characteristics of the device. A tight coupling usually exists between the operating system and the file system. Some file systems provide mechanisms to control access to the data and metadata. Ensuring reliability is a major responsibility of a file system. Some file systems allow multiple programs to update the same file at nearly the same time.

1986 questions
1
vote
1 answer

Ridiculous Number of Files in a Directory

My employer acquired a company with one particular piece of software that stores a lot of PDF and PNG file files in one directory. When I first replicated it from AWS, there were about 11.5 million files. Now the number is approaching 13 millon…
1
vote
0 answers

Would a flat or tree-like file structure allow for faster fetching of files by Path?

Would a flat file structure allow for faster locating/fetching of files by Path in an NTFS (Windows 10 File System) or would it essentially be as efficient as a highly structured tree with a bunch of subfolders? I'm using node.js to fetch a few…
Lex
  • 191
  • 1
  • 1
  • 7
1
vote
0 answers

Linux Can't Detect Some Hard Drives

I have a dell R820 with an LSI 9211-8i HBA installed. I connected one hard drive, a dell with model number HUC101890CSS204, and installed ubuntu 18.04 onto it from a usb stick. I then added 3 HGST hard drives, model number HUC109090CSS600. All 4…
1
vote
0 answers

Increase EXT4 size on Debian whilst preserving Data in a VM?

I've been trying to increase the partition size on one of our servers as it was created years ago and was set too small. I've increased the size in the VM that hosts this but now I'm trying to get Linux to know we've allowed more space. The details…
Shikoki
  • 53
  • 1
  • 1
  • 3
1
vote
0 answers

Windows Linux shared file system ownership

We have a network file system shared among Linux and Windows servers. Whatever Windows writes gives ownership to root when observed from Linux. In Linux we have a tomcat user which thus, is not able to write in the directories created by Windows. We…
6nagi9
  • 119
  • 3
1
vote
1 answer

AWS EFS - file delete and recreate not detected programmatically for 25 to 30 seconds

I am observing a very large delay in EFS detecting that a file has been re-created i.e. deleted and then created again. In this simple test example, I have a single file that gets deleted and recreated around 5 seconds later. I have two EC2…
1
vote
2 answers

Selective syncronisation of two directories in UNIX (Solaris)

I'm wondering if anyone knows of a nice way to partially duplicate (hard link) files between two directory structures? My current fall back is a script invoked by cron. As background: I ask since I have two groups who both need to access a body of…
Tom Duckering
  • 235
  • 1
  • 13
1
vote
2 answers

Read only filesystem populated on demand

Basically I have a file system that is accessible both by NFS and ssh. I need a copy of this on my local. But I want to pull only those files that I need (basically cache them on demand). Since I'll be using this as a read-only fs the cache is…
Samarth S
  • 111
  • 1
1
vote
1 answer

Organizing millions of files in ftp with btrfs file system

I have FTP that should handle about 1 million files if not more. file sizes are variable between 1MB to 100Mb but the have average of 30MB. We have about 1000 resources and hundreds of thousand site users which we keep their record. Therefore I…
nima moradi
  • 113
  • 3
1
vote
1 answer

Multiple disks acting as one filesystem, while still allowing each disk to be accessed alone

I have a fairly large dataset (~160TB) that need to be delivered to a client every so often. This dataset consists of fairly large files, usually between 2Gb and 20Gb each. They exist on a BeeGFS filesisystem running on a RAID cluster with a total…
Jarmund
  • 535
  • 2
  • 6
  • 17
1
vote
1 answer

Modern Filesystems and Small Files?

Do modern file systems, such as ext4, ntfs, and apfs, always start files in a new sector, or may some files share the space in the same sector?
ivo Welch
  • 213
  • 4
  • 8
1
vote
3 answers

What does "dirty block" mean? Especially in RAID context

Just as in the title. I was unable to find reliable information about dirty blocks in software RAID, but I heard this term many times. Is it bad to have many dirty blocks? How to check the amount of dirty blocks? Why are they appearing/being created…
Learner
  • 232
  • 1
  • 10
1
vote
0 answers

Why does `du` on CentOS 7 show 1 value, but it shows a different value on CentOS 8?

I just finished migrating a mail server from CentOS 7 over to CentOS 8. The mail store was in /var/vmail. The data was migrated with rsync: rsync -rltDPH /var/vmail/* root@new-hostname:/var/vmail/ I ran du -skh inside /var/vmail on the old (CentOS 7…
David W
  • 3,453
  • 5
  • 36
  • 62
1
vote
1 answer

Should I turn indexing of a hard drive on or off on Windows Server 2019 with a HDD with millions of files on it?

Server is running Windows Server 2019 with IIS running. I have a standard spindle enterprise 8TB HHD with about 30 million JPEG image files on it. The amount of images grows daily. Each file is less than 100K in size. These files are accessed and…
1
vote
0 answers

btrfs bad tree block - cant mount filesystem

I'm hoping someone can help me, trying to recover a btrfs pool, that lost 1st drive. I tried to mount the 2nd drive and I've been having fs errors. I got the 1st drive readable again, but it appears that it lost the filesystem, but it has not been…
Kareem
  • 151
  • 4