0

Looking to interact with the traditional Spark Web GUI on default clusters in Dataproc.

deepelement
  • 2,457
  • 1
  • 25
  • 25

1 Answers1

3

This can be done by creating a SSH tunnel to the Dataproc master node. By using a SOCKS proxy you can then access all the applications running on YARN including your Spark sessions.

This guide will walk you through in detail: Dataproc Cluster web interfaces

O. Gindele
  • 376
  • 3
  • 6