Stack Overflow
Stack Overflow

Questions tagged [zarr]

Zarr is a Python package providing an implementation of compressed, chunked, N-dimensional arrays, designed for use in parallel computing.

Zarr is a Python package providing an implementation of compressed, chunked, N-dimensional arrays (like NetCDF4, HDF5), designed for use in parallel computing and on the Cloud. See http://zarr.readthedocs.io/en/stable/ for more information.

93 questions
0
votes
1 answer

Problems with chunksize (Dask, xarray, zarr)

I want to save an xarray.dataset as a .zarr file, but I cannot configure my chunks to be uniform and it will not save. I have tried: changing chunk size when using xarray.open_mfdataset -> it still uses auto chunks which do not work. changing chunk…
UpperEastSide
  • 117
  • 1
  • 16
0
votes
1 answer

How many files does zarr generate?

I am searching for a thread-safe alternative to hdf5 to read from in a multiprocessing environment and stumbled across zarr, which according to benchmarks is said to be basically a drop-in replacement for h5py in a python envrionment. I tried it…
CD86
  • 979
  • 10
  • 27
0
votes
2 answers

What's an intelligent way of loading a compressed array completely from disk into memory - also (indentically) compressed?

I am experimenting with a 3-dimensional zarr-array, stored on disk: Name: /data Type: zarr.core.Array Data type: int16 Shape: (102174, 1100, 900) Chunk shape: (12, 220, 180) Order: C Read-only: True Compressor: Blosc(cname='zstd', clevel=3,…
s-m-e
  • 3,433
  • 2
  • 34
  • 71
1 2 3 4 5 6
7