1

I'm trying to read the secondary gen2 account in DataBricks, but I get the following error:

java.io.FileNotFoundException: Operation failed: "The specified resource does not exist.", 404

follow the way I'm making the connection:

spark.conf.set(
"fs.azure.account.key.<storage-account-secondary>.dfs.core.windows.net",
"acess_key")

What is the correct way to log into a gen2 secondary account?

Vincent Doba
  • 4,343
  • 3
  • 22
  • 42

1 Answers1

0

You can access gen2 account databricks based on the following configuration .

spark.conf.set(
"fs.azure.account.key.<storage-account-name>.dfs.core.windows.net",
dbutils.secrets.get(scope="<scope-name>",key="<storage-account-access-key-name>"))

You can refer here.

NOTE : Accessing any storage container through access key is highly not recommended.