Stack Overflow
Stack Overflow

Questions tagged [hdf]

Hierarchical Data Format (HDF, HDF4, or HDF5) is a set of file formats and libraries designed to store and organize large amounts of numerical data.

Hierarchical Data Format (HDF, HDF4, or HDF5) is a set of file formats and libraries designed to store and organize large amounts of numerical data.

Originally developed at the National Center for Supercomputing Applications, it is supported by the non-profit HDF Group, whose mission is to ensure continued development of HDF5 technologies, and the continued accessibility of data stored in HDF.

In keeping with this goal, the HDF format, libraries and associated tools are available under a liberal, BSD-like license for general use. HDF is supported by many commercial and non-commercial software platforms, including Java, MATLAB/Scilab, Octave, IDL, Python, and R. The freely available HDF distribution consists of the library, command-line utilities, test suite source, Java interface, and the Java-based HDF Viewer (HDFView).

There are two major versions of HDF; HDF4 and HDF5, which differ significantly in design and API.

Wikipedia: http://en.wikipedia.org/wiki/Hierarchical_Data_Format

344 questions
1
vote
1 answer

How to resolve 'ValueError: invalid literal for int() with base 10: '5,3,2'' while reading hdf5 file using pandas?

I am trying to read a hdf5 file using Pandas, but getting this error: ValueError: invalid literal for int() with base 10: '5,3,2' I am only calling data = pd.read_hdf(path), so I have like no idea what can I change. The file should be ok, it can be…
Galedon
  • 21
  • 3
1
vote
1 answer

I am trying to find a way to convert numpy array to hdf5 format

I am trying to convert Numpy arrays that are 2D grids varying in time in a HDF5 format for several cases so for example the Numpy array has the following aspects: Case Number (0-100), Time (0-200years), X-grid point location (0-100m), y-grid point…
Dream1
  • 11
  • 3
1
vote
1 answer

Append Data in HDF5 file

I want to append new date to my already created HDF5 file but I don't how to append more data to it, I don't know the actual syntax for appending I have created an HDF5 file to save my data in HDF format as with…
Saran Zeb
  • 311
  • 3
  • 7
1
vote
0 answers

rioxarray.open_rasterio() not recognizing .hdf files

Apologies if this has been asked before. I tried to find an answer elsewhere, but couldn't find a response that resolved my issue. I inherited some code for downloading and processing satellite data without a lot of explanation and I am required to…
TCKnight8
  • 21
  • 1
1
vote
0 answers

pd.HDFStore : Missing optional dependency 'pytables'

I am encoutering the error "ImportError: Missing optional dependency 'pytables'. Use pip or conda to install pytables" when runing the following code import pandas as pd data = pd.HDFStore(data + ".h5") Im using conda, on windows 10 with python…
Ketchup
  • 150
  • 11
1
vote
1 answer

How to completely complie and install mathGL on Mac?

Please let me know if there is anyway I can get MathGL working on my computer. If there's any mistake in the following tests, pls kindly let me know. Thank you. Ok, I've been struggling this issue for quite a long time. Here's what happens when I…
Tippsie
  • 39
  • 6
1
vote
0 answers

Error reading netcdf and hdf files using python

I have the following code that would allow me to open .nc or .h5 files, and would supposidly open its contents. import gdal import glob import os import numpy as np import pandas def nch5read(fn, ncmaskscale=True): import netCDF4 as nc …
Jay Antonio Oliver
  • 31
  • 4
1
vote
1 answer

Why do I have to call MPI.Finalize() inside the destructor?

I'm currently trying to understand mpi4py. I set mpi4py.rc.initialize = False and mpi4py.rc.finalize = False because I can't see why we would want initialization and finalization automatically. The default behavior is that MPI.Init() gets called…
xotix
  • 494
  • 1
  • 13
  • 41
1
vote
0 answers

Reading variable length array in HDF5 C++

I am trying to read an hdf5 file containing variable-length vectors of doubles in C++. I used the following code to create the hdf5 file. It contains one dataset called "test" containing 100 rows of varying lengths. I had to make a couple of changes…
Nate Bartlett
  • 13
  • 3
1
vote
1 answer

How can I retrieve HDF5 dataset that is storing strings

I'm using the command below to create an H5 dataset that stores an array of strings using dtype as S10 . create_dataset(dset_name, (0,) , dtype='S10', maxshape=None, chunks=True) It stores the data correctly in the hdf5 file's group. I can even see…
Supratik Chaudhuri
  • 99
  • 1
  • 1
  • 7
1
vote
1 answer

What is the difference between saving Keras model with extension .h5 and extension .hdf5?

Is there a difference between saving the Keras model with the extension .h5 and extension .hdf5? In other words, is there a difference between those two lines of code model.save('model.h5') and model.save('model.hdf5') assuming that I have a Keras…
Osama El-Ghonimy
  • 335
  • 2
  • 12
1
vote
2 answers

Extracting a variable from multiple hdf files

I have these 3 files here. Trying to stack them and extract a variable called "OzoneTropColumn". I am able to extract data for single file but unable to extract for multiple files. library(raster) library(ncdf4) list_col1 <- list.files("E:/TES",…
Dipu
  • 123
  • 2
  • 14
1
vote
0 answers

Run query on AWS Redshift and export the result to remote server

I'm connected to a read-only Redshift instance from data vendor (through JDBC and no other AWS tools available) that houses a few hundreds of different tables. Now I need to derive a few tables from them and, because the Redshift is read-only, load…
Socap
  • 11
  • 2
1
vote
2 answers

Error "class path contains multiple slf4J bindings" when opening newly installed HDFViewer on windows 10

I have problem opening HDFViewer on win10. I installed HDFView-3.1.2-win10_64-vs16.zip from this link: enter link description here, Visual C++ Redistributable Packages from this link: enter link description here and have added HDFViewer to…
Simin Maleki
  • 1,311
  • 1
  • 8
  • 11
1
vote
0 answers

How to make a HDF-3.4.1.1-centos7-rpm.tar.gz file?

I have a HDP 3.1.4 cluster with local repository. I want to install HDF mpack but it needs the file HDF-3.4.1.1-centos7-rpm.tar.gz. You know, from now on, without valid account, you cannot download the file from Cloudera at…
Giang Duong
  • 11
  • 3
1 2 3
…
22 23