Server Fault Stack Exchange
Server Fault Stack Exchange

Questions tagged [zfs]

ZFS is a modern file system and volume manager originally developed by Sun Microsystems and licensed under the CDDL. It is a copy-on-write file system with support for large storage arrays, protection against corruption, snapshots, clones, compression, deduplication and NFSv4 ACLs. An open-source fork of ZFS can be found at http://open-zfs.org/ , which is supported by ZFSonlinux.org, illumos.org and ZFS developers in the FreeBSD & Mac OS X communities.

ZFS is supported out of the box on a number of operating systems:

  • Solaris 10
  • Oracle Solaris 11 Express
  • FreeBSD
  • NexentaStor
  • illumos - specifically, illumos-based distributions, like:
    • Nexenta's illumian
    • Joyent's SmartOS (server OS with strong focus on virtualization)
    • OmniTI's OmniOS (general purpose server OS)
    • OpenIndiana (general purpose desktop/server OS)

Due to license incompatibilities, the CDDL licensed ZFS code cannot be distributed as part of the GPL licensed Linux kernel. Other alternatives methods are available for running ZFS on Linux:

1391 questions
21
votes
2 answers

Sanity check on 40TB server configuration

I've got 40 years in computing, but I've never had to build a server quite like this one, so this might be a n00b question. I have a client that is going to offer ultra-high def music files for download. In this case that means FLAC-compressed…
Peter Rowell
  • 343
  • 1
  • 9
21
votes
4 answers

Are ZFS clustered filesystems possible?

Is it possible to create a ZFS cluster? Or would you need to go the seemingly ugly (to me at least) route of ZFS with UFS formatted pools governed by GlusterFS? The idea is to see if it is possible to expand to Multi-Petabyte distributed store which…
SteveMustafa
  • 429
  • 1
  • 5
  • 11
21
votes
3 answers

Non-ECC memory with ZFS: a stupid idea?

I have a new server and am planning to upgrade the paltry 2 GB of memory to the maximum of 16 GB. (Theoretically 8 GB is the limit, but empirically 16 GB has been shown to work.) Some guides advise that ECC memory is not that important, but I'm not…
iconoclast
  • 1,800
  • 2
  • 18
  • 30
19
votes
6 answers

Backing up a MySQL database via ZFS snapshots

I've found a number of sites talking about doing exactly this, but I'm missing a few important details. The general steps are Run FLUSH TABLES WITH READ LOCK Take the ZFS snapshot Run UNLOCK TABLES Various sources report that InnoDB, which I'm…
Andy Shulman
  • 293
  • 3
  • 7
19
votes
2 answers

What does a permanent ZFS error indicate?

Several permanent errors were reported on my zpool today. pool: seagate3tb state: ONLINE status: One or more devices has experienced an error resulting in data corruption. Applications may be affected. action: Restore the file in…
Will Haley
  • 293
  • 2
  • 7
19
votes
14 answers

Best compression for ZFS send/recv

I'm sending incremental ZFS snapshots over a point-to-point T1 line and we're to a point where a day's worth of snapshots can barely make it over the wire before the next backup starts. Our send/recv command is: zfs send -i tank/vm@2009-10-10…
Sysadminicus
  • 596
  • 4
  • 8
  • 20
19
votes
6 answers

Need to identify disk in zpool ... how?

I need to replace a bad disk in a zpool on FreeNAS. zpool status shows gptid/5fe33556-3ff2-11e2-9437-f46d049aaeca UNAVAIL 0 0 0 cannot open How do I find the serial # of that disk? More: glabel status gives: …
Dan
  • 959
  • 5
  • 14
  • 25
18
votes
1 answer

Is RAID-Z on a single hard disk drive stupid?

Obviously, if the entire drive dies, then RAID-Z on a single disk will not help. But what about other types of errors? From my experience, I sometimes have a file that I can not read. On Mac OS X, the system will hang for a period of time and then…
pedz
  • 291
  • 2
  • 7
18
votes
1 answer

Why does `zfs list` and `zpool list` report very different sizes for my raidz2 pools?

I have a ZFS server with 8 zpools. Each pool is 12 6TB disks in a 10+2 RAIDZ configuration. So, each pool has a raw storage space of 12*6=72 TB and usable space of 10*6=60 TB. However, I see different results when I query it using zfs list vs. using…
Ketan Maheshwari
  • 333
  • 1
  • 3
  • 8
18
votes
3 answers

150 TB and growing, but how to grow?

My group currently has two largish storage servers, both NAS running debian linux. The first is an all-in-one 24-disk (SATA) server that is several years old. We have two hardware RAIDS set up on it with LVM over those. The second server is 64…
seandavi
  • 283
  • 2
  • 6
17
votes
2 answers

ZFS: re-compress existing files after change in compression algorithm

I have a pool that was created in 2011, using lzjb compression, and it wasn't until a couple of years later that an upgrade allowed me to set the compression to lz4. I estimate that at least 20% of the content (by space) on the array was created…
rowan194
  • 171
  • 1
  • 4
17
votes
0 answers

Restoring data after zfs destroy

On Debian 8.7 I had a zfs pool. (obviously using ZFS on Linux, not Oracle or Solaris zfs) It was needed to extend ZFS pool from mirror on 2 disks to raidz on 4 disks. I did backup (one copy of data - it was my first mistake) I thought that zpool…
Oleg Rudenko
  • 287
  • 1
  • 2
  • 6
17
votes
4 answers

zfs rename/move root filesystem into child

Similar question exists but the solution (using mv) is awful because in this case it works as "copy, then remove" rather than pure "move". So, I created a pool: zpool create tank /dev/loop0 and rsynced my data from another storage in there directly…
Anton
  • 171
  • 1
  • 1
  • 3
17
votes
7 answers

Disabling RAID feature on HP Smart Array P400

I'm planning to use ZFS on my system (HP ML370 G5, Smart Array P400, 8 SAS disk). I want ZFS to manage all disks individually, so it can utilize better scheduling (i.e. I want to use software RAID feature in ZFS). The problem is, I can't find a way…
Arie K
  • 1,633
  • 5
  • 19
  • 27
17
votes
5 answers

ZFS and SAN -- best practices?

Most discussions of ZFS suggest that the hardware RAID be turned off and that ZFS should directly talk to the disks and manage the RAID on the host (instead of the RAID controller). This makes sense on a computer with 2-16 or even more local disks,…
chris
  • 11,944
  • 6
  • 42
  • 51
1 2
3
…
92 93