We are evaluating embedding duckdb in our applications. We deal with a lot of tables where the columns will be around 60-70 % sparse most of the time. Does duckdb fill them with default null values or does it support sparsity internally?
Asked
Active
Viewed 380 times
1 Answers
2
At the moment, DuckDB does not support sparsity internally. But its something that we are considering.
Update, 2023:
We have compression now that efficiently suppresses NULL storage using only a single bit. So this should now be greatly improved. –

Hannes Mühleisen
- 2,542
- 11
- 13
-
This response is more than a year old. Any updates on this? – Manuel Mar 14 '21 at 14:38
-
We are working on compressed storage which should address this right now. No ETA though. – Hannes Mühleisen Mar 15 '21 at 15:02
-
more years have passed, this question pops up a lot. Any updates? – Dmitriy Lezhnev Jul 20 '23 at 12:47
-
We have compression now that efficiently suppresses NULL storage using only a single bit. So this should now be greatly improved. – Hannes Mühleisen Jul 31 '23 at 13:15