0

I want to add libraries in Azure Databricks for connecting to Event Hubs. I will be writing notebooks in python. So which library should I add for connecting to Event Hubs?

As per my search till now I got a spark connecting library in Maven coordinates. But I don't think I will be able to import it in python.

CHEEKATLAPRADEEP
  • 12,191
  • 1
  • 19
  • 42
AnanR
  • 29
  • 1
  • 7

1 Answers1

0

Structured streaming integration for Azure Event Hubs is ultimately run on the JVM, so you'll need to import the libraries from the Maven coordinate below:

 groupId = com.microsoft.azure
  artifactId = azure-eventhubs-spark_2.11
  version = 2.3.10

Note: For Python applications, you need to add this above library and its dependencies when deploying your application.

For more details, refer "Structured streaming + Event Hubs Integration Guide for PySpark" and "Attach libraries to Spark Cluster".

And also, you may refer SO thread, which addresses a similar issue.

Hope this helps.

CHEEKATLAPRADEEP
  • 12,191
  • 1
  • 19
  • 42