I'm using a tool in which I have to point out the master node (link format is spark://<some-spark-master>:7077
) of the Cloudera Spark Cluster. Also as I learned, Spark has "Master Node", "Driver Node" and "Worker Nodes".
So I decided to go to the Cloudera Web Manager and checked the Configuration Tab of the Spark service, but all I found are "Gateway instance" and "History Server instance". I can't find the "Driver instance" and "Worker instance", I think it's because we run Spark in Yarn mode.
My guess is that it's in the Yarn service configuration, but I can't find anything related to "Master", "Driver" or "Worker" either
So what is the link/port of "Spark Master" that ends with 7077 (what is the Node)? I can't find it anywhere in the Configuration tab. Does "Spark Master Node" ~ "Yarn Resources Manager Node"?