0

Databricks has just released a public preview of Delta Lake and Presto integration. I'm new to Azure, and the link has multiple mentions of EMR and Athena but lack Azure keywords. So I have to ask a stupid question:

Am I right that Presto integration is only for AWS since Azure doesn't have Presto PaaS?

P.S. Have Databricks any plans for Delta Lake and Synapse/Polybase integration in nearest future?

VB_
  • 45,112
  • 42
  • 145
  • 293

1 Answers1

3

Delta Lake Presto integration is based on "symlinks" and they are supported in Presto since long. On Azure, you can conveniently provision Presto using

Bear in mind, however, that "symlinks"-based integration has certain limits. Here, at Starburst, we're working on native Delta Lake support, without need to create "symlinks".

Piotr Findeisen
  • 19,480
  • 2
  • 52
  • 82
  • thank you for the answer! Why did you say that HDInsight Presto is a "legacy" option? The first option link "Presto on Microsoft Azure" is focused on HDInsight – VB_ Jan 10 '20 at 18:30
  • I think we don't provide the latest Presto version for HDInsights, but I may be wrong. Anyway, Kubernetes based solution is likely to provide more elasticity. – Piotr Findeisen Jan 10 '20 at 21:54