Questions tagged [storage]

Primarily questions about disk storage, sometimes questions about application storage or cloud storage. Always questions about storing data.

Storage is a catch-all term that encompasses the areas of centralized storage (questions about SAN, NAS), local storage (questions about internal hard drives, DAS), and even sometimes questions about applications that use storage and cloud storage.

Because storage has such a wide definition, it can lead to a lot of very different questions legitimately using it. Instead of limiting the scope of questions that should use storage, please be descriptive with the rest of the tags so we know, for example, whether we're looking at an enterprise block level SAN question or a VMWare datastore on a local drive question.

There are a lot of concepts and acronyms thrown around, so here's a brief cheat-sheet:

  • SAN: Storage Area Network is often incorrectly used to refer to the Storage Subsystem but actually refers to the composition of the switches (FC, Ethernet, etc), HBAs and links that connect the initiators (consumers of the service) to the targets (providers of the service). SANs and Storage Subsystems exist primarily to provide block level storage devices to servers.
  • Fabric: A single interconnected Fibre-Channel network of switches, initiators and links is called a Fabric. There are typically two isolated Fabrics in a FC SAN.
  • Storage Subsystem: A centralized system consisting of one or more Disk Controllers and Disks, often divided into LUNs and presented to initiators.
  • NAS: Network Attached Storage is a centralized storage device that provides file level storage via CIFS, NFS, or other file-level protocols.
  • DAS: Direct Attached Storage can refer to internal storage in a server as well as external storage expansion shelves attached to a single server.
  • RAID: Redundant Array of Inexpensive Disks is a mechanism of grouping hard drives to either stripe data across all of the group, mirror data on multiple drives, use one or more parity checksums for recovering from one or more failed disks or some combination of the above.

Here are a list of commonly used storage-related tags:

1947 questions
190
votes
2 answers

What are the different widely used RAID levels and when should I consider them?

This is a Canonical Question about RAID levels. What are: the RAID levels typically used (including the RAID-Z family)? deployments are they commonly found in? benefits and pitfalls of each?
MDMarra
  • 100,734
  • 32
  • 197
  • 329
163
votes
5 answers

Are SSD drives as reliable as mechanical drives (2013)?

SSD drives have been around for several years now. But the issue of reliability still comes up. I guess this is a follow up from this question posted 4 years ago, and last updated in 2011. It's now 2013, has much changed? I guess I'm looking for…
hookenz
  • 14,472
  • 23
  • 88
  • 143
114
votes
6 answers

Why is Enterprise Storage so expensive?

This is a Canonical Question about the Cost of Enterprise Storage. See also the following question: What's the best way to explain storage issues to developers and other users Regarding general questions like: Why do I have to pay 50 bucks a…
Mark Henderson
  • 68,823
  • 31
  • 180
  • 259
82
votes
24 answers

Storing a million images in the filesystem

I have a project that will generate a huge number of images. Around 1,000,000 for start. They are not large images so I will store them all on one machine at start. How do you recommended on storing these images efficiently? (NTFS file system…
s.mihai
  • 1,511
  • 6
  • 24
  • 27
77
votes
5 answers

What is the difference between SAN, NAS and DAS?

What is the difference between SAN, NAS and DAS?
75
votes
13 answers

SSD or HDD for server

Issue I have read many discussions about storage, and whether SSDs or classic HDDs are better. I am quite confused. HDDs are still quite preferred, but why? Which is better for active storage? For example for databases, where the disk is active all…
genderbee
  • 901
  • 1
  • 7
  • 11
74
votes
13 answers

ZFS vs XFS

We're considering building a ~16TB storage server. At the moment, we're considering both ZFS and XFS as filesystem. What are the advantages, disadvantages? What do we have to look for? Is there a third, better option?
Tamas Czinege
  • 843
  • 1
  • 9
  • 6
68
votes
6 answers

How to check disk I/O utilization per process?

I'm having a problem with a Linux system and I have found sysstat and sar to report huge peaks of disk I/O, average service time as well as average wait time. How could I determine which process is causing these peaks the next time it happen? Is it…
Avada Kedavra
  • 1,294
  • 2
  • 13
  • 19
62
votes
13 answers

Windows 2008: WinSXS directory growing uncontrollably, blocking server

I run a (remotely hosted) virtual Server with Windows 2008 Server for a client. Initially, it had 10 GB of space. During the course of a few weeks - during which nothing was done on the machine except normal work using a web-basedt icket system -…
Pekka
  • 2,178
  • 3
  • 20
  • 32
62
votes
8 answers

What are the advantages of tape drives?

IBM still develop and sell tape drives today. The capacity of them seems to be on a par with today's hard drives, but the search time and transfer rate are both significantly lower than that of hard drives. So when is tape drives preferable to hard…
kba
  • 2,827
  • 1
  • 18
  • 18
53
votes
6 answers

How to move files between two S3 buckets with minimum cost?

I have millions of files in a Amazon S3 bucket and I'd like to move these files to other buckets and folders with minimum cost or no cost if possible. All buckets are in the same zone. How could I do it?
Daniel Cukier
  • 823
  • 1
  • 10
  • 18
52
votes
1 answer

Fibre channel long distance woes

I need a fresh pair of eyes. We're using a 15km fibre optic line across which fibrechannel and 10GbE is multiplexed (passive optical CWDM). For FC we have long distance lasers suitable up to 40km (Skylane SFCxx0404F0D). The multiplexer is limited by…
Marki
  • 2,854
  • 3
  • 28
  • 45
48
votes
10 answers

Linux on VMware - why use partitioning?

When installing Linux VMs in a virtualized environment (ESXi in my case), are there any compelling reasons to partition the disks (when using ext4) rather than just adding separate disks for each mount point? The only one I can see is that it makes…
savoche
  • 553
  • 1
  • 4
  • 7
48
votes
7 answers

Probability of Blade Chassis Failure

In my organisation we are thinking about buying blade servers - instead of rack servers. Of course technology vendors also make them sound very nice. A concern, that I read very often in different forums, is, that there is a theoretical possibility…
ChrisZZ
  • 737
  • 1
  • 8
  • 13
47
votes
3 answers

What are the merits of SAS vs SATA drives?

What are the merits of buying SAS drives over SATA drives, or vice versa?
username
  • 4,755
  • 19
  • 55
  • 78
1
2 3
99 100