I want to enable the spark ui for my glue jobs. I followed Enabling the Spark UI for Jobs and Launching the Spark History Server, which I used default yml file provided by this guide to launch stack on cloudformation. After the stack was CREATE_COMPLETE, I got the SparkUiPublicUrl from the Outputs of the stack, but I couldn't open this url, which means I couldn't view the spark ui. The thing I have tried was to modify the inbound rules of security group, which is as following, but still not working. Have I missed something here?
Asked
Active
Viewed 290 times
1
-
did you find the solution. I am also facing the same issue? – Amit Joshi May 13 '22 at 11:02