Questions tagged [vaex]

Vaex is a python library for lazy Out-of-Core DataFrames (similar to Pandas)

Vaex is a python library for lazy Out-of-Core DataFrames (similar to Pandas), to visualize and explore big tabular datasets. It can calculate statistics such as mean, sum, count, standard deviation etc, on an N-dimensional grid for more than a billion (10^9) objects/rows per second. Visualization is done using histograms, density plots and 3d volume rendering, allowing interactive exploration of big data. Vaex uses memory mapping, zero memory copy policy and lazy computations for best performance (no memory wasted).

181 questions
-1
votes
1 answer

How to convert larger size dataset (20GB csv file) into hdf5 format using python and R?

I want to convert csv file with larger size into hdf5 format. I am working with vaex library and it only accepts hdf5 extension to load the dataset. I also need the solution for the above problem in R.
1 2 3
12
13