Stack Overflow
Stack Overflow

Questions tagged [hdf5storage]

This is the hdf5storage package, a Python package to read and write python data types to HDF5 (Heirarchal Data Format) files beyond just Numpy types.

11 questions
1
vote
3 answers

Reading Large HDF5 Files

I am new to using HDF5 files and I am trying to read files with shapes of (20670, 224, 224, 3). Whenever I try to store the results from the hdf5 into a list or another data structure, it takes either takes so long that I abort the execution or it…
David
  • 153
  • 1
  • 14
1
vote
1 answer

Python hdf5storage is transposing my data?

Python Code: import h5py import hdf5storage from functools import reduce import numpy as np from operator import mul sz = 128,256,512 a = np.random.normal(size=reduce(mul,sz)).reshape(sz) save_dict = {'data':a} spath =…
wolfblade87
  • 173
  • 10
1
vote
0 answers

Python pandas read_hdf WHERE term not functioning as expected

I'm trying to do a simple filter on an HDF5-formatted table, using Python pandas. Works fine when I query by the 'subject' column alone: > df_test = pd.read_hdf(result_file, where=['subject==andrew']) > print(df_test) Which gives the output: …
Andrew Reid
  • 173
  • 1
  • 1
  • 7
1
vote
1 answer

how to import .mat-v7.3 file using h5py

I have .mat file which have 3 matrixes A, B, C. Actually I used scipy.io to import this mat file as below. data = sio.loadmat('/data.mat') A = data['A'] B = data['B'] C = data['C'] But, v7.3 file cannot import using this way. So, I tried to import…
Tom
  • 531
  • 4
  • 7
  • 19
1
vote
2 answers

load .mat file from python

I am trying to run from Python a script in Matlab that run a Simulink mode, save a variable as Power.mat and read this variable in Python. I am using Python 2.7 on Windows. I've tried to use the library hdf5storage to read the file: import…
Alessandra Cuneo
  • 11
  • 1
  • 2
1
vote
0 answers

load .mat file in simulink from python hdf5storage library

I am trying to load/read some random data in simulink I created using the Python module hdf5storage. I created .mat file in Python (simulink supports version 7.3 only) using this code: # get code on…
Chandy Alex
  • 153
  • 1
  • 1
  • 7
0
votes
1 answer

Understand python hdf5storage functions

Is there anyone explain exact difference between hdf5storage.write() and hdf5storage.writes() functions. I've read documents but I did not understand it.
Oguz Ery
  • 3
  • 1
0
votes
1 answer

Deleting hdf5 dataset using C#

I using HDF5 database and wanted to delete and update dataset , using below code I am creating group structure and created one dataset but now stuck on deleting dataset. code below: public void DeleteDataset() { string filename =…
SAGAR AUTE
  • 1
  • 1
0
votes
1 answer

How to compare multiple hdf5 files

I have multiple h5py files(pixel-level annotations) for one image. Image Masks are stored in hdf5 files as key-value pairs with the key being the id of some class. The masks (hdf5 files) all match the dimension of their corresponding image and…
user5570383
0
votes
3 answers

Memory Error : Training large dataset

memory error My dataset have 70k images which i want to train through Conv2D but it is throwing memory error when i tried to load the dataset. I just have 4GB RAM, how i can resolve this issue through HDF5 matrix by creating a dataset in HDF5?…
user9456630
  • 3
  • 1
  • 3
0
votes
2 answers

Adding a new variable to a .mat file using the Python package hdf5storage

Is it possible to add a new variable to a .mat file (v7.3) using the Python package hdf5storage? Example: I wrote in Matlab: test = {'Hello', 'world!'; 'Good', 'morning'; 'See', 'you!'}; save('data.mat', 'test', '-v7.3') % v7.3 so that it is…
Franck Dernoncourt
  • 77,520
  • 72
  • 342
  • 501