0

Does Azure Databricks use the query acceleration functions in Azure Data Lake Storage gen2? In documentation we can see that spark can benefit from this functionality.

I'm wondering if, in the case where I only use the delta format, I'm profiting from this functionality and whether to include it in the pricing in Azure Calculator under the Storage Account section?

enter image description here

repcak
  • 113
  • 8

1 Answers1

2

From the docs

Query acceleration supports CSV and JSON formatted data as input to each request.

So it doesn't work with Parquet or Delta - because it is fundamentally a row based accelerator, and Parquet is a columnar format.

Kyle Hale
  • 7,912
  • 1
  • 37
  • 58