Questions tagged [filesystems]

A file system (or filesystem) is a means to organize data expected to be retained after a program terminates by providing procedures to store, retrieve and update data, as well as manage the available space on the device(s) which contain it.

A file system (or filesystem) is a means to organize data expected to be retained after a program terminates by providing procedures to store, retrieve and update data, as well as manage the available space on the device(s) which contain it. A file system organizes data in an efficient manner and is tuned to the specific characteristics of the device. A tight coupling usually exists between the operating system and the file system. Some file systems provide mechanisms to control access to the data and metadata. Ensuring reliability is a major responsibility of a file system. Some file systems allow multiple programs to update the same file at nearly the same time.

1986 questions
10
votes
4 answers

Change filesystem encoding to UTF-8 in Ubuntu

How to find out what charset encoding is used by current file system and how to change it to UTF-8? EDIT: Here is the output of mount: /dev/sdb6 on / type ext3 (rw,relatime,errors=remount-ro) tmpfs on /lib/init/rw type tmpfs…
jack
  • 1,725
  • 5
  • 21
  • 25
10
votes
6 answers

Linux/UNIX Server Setup Practices for /tmp

Based on what you all see out there what is a recommended configuration of /tmp on a server system and why. I've had discussions on these points over the years sometimes with basic disagreements. The following are basically the questions I see. …
mdpc
  • 11,856
  • 28
  • 53
  • 67
10
votes
1 answer

Remount root RW without reboot

Today I did something stupid on production xen vm server. I mounted the external device mapper as read only to make a copy of the filesystem. This process went well but then the rootfs / become read-only inside the guest machine. /dev/xvda on / type…
posixcompliant
  • 101
  • 1
  • 1
  • 3
10
votes
3 answers

How to find out capacity for network interfaces?

I could get the capacity for the network interface by lshw, but which file in sysfs is this information stored(i.e. which file in /sys/class/net/eth0/device/ directory)? $ sudo lshw -class network *-network description:…
schemacs
  • 211
  • 1
  • 2
  • 6
10
votes
1 answer

Which block sizes for millions of small files

I have 2x 4TB Disks in hardware RAID1 (it might be a LSI MegaRaid) on Debian Wheezy. The physical block size is 4kB. I'm going to store 150-200 million of small files (between 3 and 10kB). I'm not asking for performance, but for best filesystem and…
rabudde
  • 304
  • 5
  • 22
10
votes
2 answers

Why "lsmod | wc -l" not equal "ls /sys/module | wc -l"

Why do these two commands return different results? lsmod | wc -l 100 ls /sys/module | wc -l 138
andy
  • 101
  • 2
10
votes
2 answers

How can I move s3 objects >5gb from one bucket to another?

Objects larger than 5GB are supported with multi-part uploading. We have 5gb+ files in one bucket already that I'd like to move to another, under the same AWS account. When I issue the command using s3cmd: s3cmd mv s3://BUCKET1/OBJECT1…
Ben Keating
  • 211
  • 1
  • 2
  • 5
10
votes
1 answer

EXT4 performance has become really bad on system with lots of small files

I have a small embedded device that has only 128MB of RAM attached to this device is a 2TB USB2 hard disk I've been very happy with the performance of the device up until recently when either the number of files has cross a threshold of the capacity…
stuck
  • 687
  • 2
  • 10
  • 23
10
votes
2 answers

No more diskspace on server

after some wrong php code was exceuted on one of our servers, which tried to open up a file which didn't exist, we ended up with huge apache log files which weren't configured yet to rotate. We just deleted those logfiles. After which we saw that…
latz
  • 201
  • 2
  • 6
10
votes
10 answers

How to solve linux subdirectories number limit?

I have a website which will store user profile images. Each image is stored in a directory (Linux) specific to the user. Currently I have a customer base of 30+, which means I will have 30+ folders. But my current Linux box (ext2/ext3) doesn't…
Nanda Kishore
  • 201
  • 1
  • 2
  • 6
10
votes
1 answer

What ZFS file structure to use for zfs-root linux system?

In ZFS, you can build your filesystem hiearchy to include different fs-attributes per filesystem. For insance, compression in one area, no-exec/suid in others, noatime. For example, a HOWTO for FreeBSD suggests creating the following…
glallen
  • 253
  • 2
  • 9
10
votes
5 answers

Why is /dev/urandom only readable by root since Ubuntu 12.04 and how can I "fix" it?

I used to work with Ubuntu 10.04 templates on a lot of servers. Since changing to 12.04 I have problems that I've now isolated. The /dev/urandom device is only accessible to root. This caused SSL engines, at least in PHP, for example…
The Shurrican
  • 2,240
  • 7
  • 39
  • 60
10
votes
8 answers

Best file system for external (USB) hard drives/USB memory media

Almost all external USB hard drive and USB memory media/sticks come today preformatted with FAT32. As far as I know the only advantage of the file system is the compatibility among OSes and devices. Is it reasonable to reformat it with exFAT or…
Toro
  • 766
  • 4
  • 22
  • 31
10
votes
3 answers

Linux: how many disk I/O does it take to read a file? How to minimize it?

According to this paper on Facebook's Haystack: "Because of how the NAS appliances manage directory metadata, placing thousands of files in a directory was extremely inefficient as the directory’s blockmap was too large to be cached effectively…
Continuation
10
votes
4 answers

Which filesystems offer snapshot functionality for users to recover data?

I'm working on a project that will teach linux to youth. Knowing they will have a tendency to delete or corrupt items in their home directories we are looking for a good snapshot option. We will not have access to fancy tools available from major…
Gray Race
  • 853
  • 3
  • 11
  • 22