Questions tagged [zfs]

ZFS is a modern file system and volume manager originally developed by Sun Microsystems and licensed under the CDDL. It is a copy-on-write file system with support for large storage arrays, protection against corruption, snapshots, clones, compression, deduplication and NFSv4 ACLs. An open-source fork of ZFS can be found at http://open-zfs.org/ , which is supported by ZFSonlinux.org, illumos.org and ZFS developers in the FreeBSD & Mac OS X communities.

ZFS is supported out of the box on a number of operating systems:

  • Solaris 10
  • Oracle Solaris 11 Express
  • FreeBSD
  • NexentaStor
  • illumos - specifically, illumos-based distributions, like:
    • Nexenta's illumian
    • Joyent's SmartOS (server OS with strong focus on virtualization)
    • OmniTI's OmniOS (general purpose server OS)
    • OpenIndiana (general purpose desktop/server OS)

Due to license incompatibilities, the CDDL licensed ZFS code cannot be distributed as part of the GPL licensed Linux kernel. Other alternatives methods are available for running ZFS on Linux:

1391 questions
14
votes
5 answers

ZFS: Redistribute zvol over all disks in the zpool?

Is there a way in which ZFS can be prompted to redistribute a given filesystem over the all of the disks in its zpool? I'm thinking of a scenario where I have a fixed size ZFS volume that's exported as a LUN over FC. The current zpool is small, just…
growse
  • 8,020
  • 13
  • 74
  • 115
13
votes
2 answers

How to big scale backup Gitlab?

When asking Gitlab support on how to do a 3TB backup on ones on-premise Gitlab they reply use our tool that produces a tarball. This just seams wrong to me on all levels. This tarball contains the postgres dump, docker images, repo data, GIT LFS,…
Sandra
  • 10,303
  • 38
  • 112
  • 165
13
votes
2 answers

Increase the ZFS partition to use the entire disk

I have a ZFS pool that currently occupies 100Gb. I increased the disk size to 150Gb, but I can't seem to get the ZFS use the entire disk. I have a the same exact issue yesterday with another server, and there a certain mixture of zpool set…
justadev
  • 393
  • 2
  • 4
  • 20
13
votes
6 answers

ZFS SAS/SATA controller recommendations

I've been working with OpenSolaris and ZFS for 6 months, primarily on a Sun Fire x4540 and standard Dell and HP hardware. One downside to standard Perc and HP Smart Array controllers is that they do not have a true "passthrough" JBOD mode to present…
ewwhite
  • 197,159
  • 92
  • 443
  • 809
13
votes
5 answers

Encryption with ZFS on linux

Does ZFS on Linux already support Encryption? If not, is it planned? I found tons of info for ZFS+LUKS but that's absolutely uninteresting: I want ZFS encryption so that I can do replication using zfs send to an "untrusted" backup server. I.e., zfs…
divB
  • 568
  • 1
  • 7
  • 23
13
votes
1 answer

Force update checksum on zfs?

I recently changed the checksum property on one of my non-duplicated zfs filesystems to sha256 from on (fletcher4) to better support the sending of duplicated replication steams, as in this command zfs send -DR -I _starting-snaphot_…
84104
  • 12,905
  • 6
  • 45
  • 76
13
votes
3 answers

How can you find the parent snapshot of a zfs clone?

I made a clone of zfs filesystem that has a number of snapshots. I also have several replicated copies of the filesystem. How can I find which filesystem/snapshot a clone is attached to? (Seems like something that should be in the docs/googlable…
JamesRyan
  • 8,166
  • 2
  • 25
  • 36
13
votes
1 answer

Is calculating IOPS for ZFS RAIDZ different then calculating IOPS for RAID5 & RAID6?

When calculating IOPS for traditional RAID arrays, one could use the following formula (Borrowed from Getting The Hang Of IOPS v1.3 on Symantec Connect): Ieffective = (n * Isingle) / (READ% + (F * WRITE%)) Where: Ieffective is effective number of…
Stefan Lasiewski
  • 23,667
  • 41
  • 132
  • 186
13
votes
7 answers

How to determine which disk failed in a FreeNAS / ZFS setup

I'm building out a FreeNAS based server in a Supermicro X6DHE-XB 3U enclosure with 4G of RAM, 16 SATA hot-swap bays. It comes with 2x8 port 3Ware RAID cards, but I'm planning on just using the ZFS capabilities instead of the hardware RAID. My…
John P
  • 1,679
  • 6
  • 38
  • 59
13
votes
7 answers

ZFS alternative for Linux?

I'm running OpenSolaris with ZFS for my main fileserver. I originally went with ZFS because I heard so many awesome things about it: Automatic disk spanning (zpools) Software RAID (RAID-Z) Automatic pool resizing by replacing RAIDZ'd…
Maelstrom
  • 233
  • 1
  • 2
  • 5
12
votes
8 answers

Tuning NFS client/server stack

I have a CentOS 5 VMWare server connecting to an OpenSolaris 2009.06 machine over NFS that holds the disk images. My virtual machines seem to be bound by slow IO so I'd like to do everything I can to optimize the connection. I'm not sure of the…
Sysadminicus
  • 596
  • 4
  • 8
  • 20
12
votes
2 answers

Why is ZFS so much slower than ext4 and btrfs?

Problem I recently installed a new disk and created a zpool on it: /# zpool create morez /dev/sdb After using it for a while, I noticed it was quite slow: /morez# fio --name rw --rw rw --size 10G read: IOPS=19.6k, BW=76.6MiB/s…
Snowball
  • 1,503
  • 1
  • 12
  • 13
12
votes
1 answer

ZFS on Linux (ZoL) and realtime replication

I would like to understand what is the best solution for realtime replication between two ZFS on Linux (ZoL) boxes connected by a 10 GbE link. The goal is to use them for virtual machines; only one box at a time will run the virtual machines and the…
shodanshok
  • 47,711
  • 7
  • 111
  • 180
12
votes
3 answers

Why is ZFS on Linux unable to fully utilize 8x SSDs on AWS i2.8xlarge instance?

I'm completely new to ZFS, so to start with I thought I'd do some simple benchmarks on it to get a feel for how it behaves. I wanted to push the limits of its performance so I provisioned an Amazon EC2 i2.8xlarge instance (almost $7/hr, time really…
anelson
  • 305
  • 2
  • 10
12
votes
3 answers

ZFS pool slow sequential read

I have a related question about this problem, but it got too complicated and too big, so I decided I should split up the issue into NFS and local issues. I have also tried asking about this on the zfs-discuss mailing list without much success. Slow…
Ryan Babchishin
  • 6,260
  • 2
  • 17
  • 37