I have an Azure HDInsight Spark Cluster in WEST US and I want to enable a Geo-Recovery to handle the Disaster Recovery. I don't see any options to the Geo-Recovery for Azure HDInsight Spark Cluster, how do I do it?
Asked
Active
Viewed 49 times
0
-
1Geo-Recovery is mostly for Storage not for job execution platform. Because you can always retry the failed jobs. You can create an identical cluster as a DR – Subash Feb 21 '21 at 02:54
-
Does it mean that we could use the same Storage account for both the actual & passive HDInsight clusters? – One Developer Feb 22 '21 at 09:54
-
Yes but with a different containers – Subash Feb 23 '21 at 02:24
-
What does the different container means? How to setup this? – One Developer Feb 26 '21 at 03:40
-
As per the Microsoft documentation, if you have enabled Read Geo Redundant on storage account, It only have read access. We need read write access to create the cluster. It is not supported to create a cluster with a storage account which is in different region. We do not have any other way to create the cluster in east with storage account in West. – One Developer Feb 26 '21 at 03:41
-
In this case we need to create two storage accounts in each region. It is not easy to synch so what you will recommend to have two storage account and both can sync without any maintenance work. – One Developer Feb 26 '21 at 03:42
-
You can check this-https://learn.microsoft.com/en-us/azure/storage/common/storage-disaster-recovery-guidance – Subash Feb 26 '21 at 07:21