I have two variables data
and meta
, which I am saving in a compressed .mat file (version '-v7'
). The data
variable is usually 800mb uncompressed, while meta
might not even be 1mb. I have lots of these .mat files and sometimes I just need to loop through all the meta
variables. However, since the file is compressed, it still takes lots of time to load the meta
variable alone , i.e. same time as if I were to load both variables.
Is it possible to selectively compress specific variables in a .mat file (in order to speed up the loading) ? Alternative data designs?
Note : I already have an overall single meta
which is basically the concatenation of the smaller ones. However, I will need to abandon this approach because it does not scale well size-wise and performance-wise.