0

Running Spark 1.4.1 on a Mesos cluster using GCE. I can get Spark up and running, but cannot access the UI for either Mesos or Spark.

I have tried:

  • MesosMasterExternalIP:4040
  • MesosMasterExternalIP:5050
  • MesosMasterExternalIP:7070
  • MesosMasterExternalIP:7077

I also tried stopping Spark, ran "ps ax | grep spark-shell" and killed all processes, restarted Spark. No success.

I was trying to follow the instructions in Paco Nathan's post Section 5, but keep getting a "This webpage is not available" error when ever I try to get to the UI via my laptop browser. (Chrome on ubuntu 14.04)

Any suggestions on how to proceed?

Jacek Laskowski
  • 72,696
  • 27
  • 242
  • 420
Thom Rogers
  • 1,385
  • 2
  • 20
  • 33
  • 3
    Even if you've configured the firewall in GCE, did you also make sure that the local one on your instance isn't blocking incoming traffic? For example, with Ubuntu /etc/init.d/iptables save && /etc/init.d/iptables stop – Michael Hausenblas Aug 31 '15 at 13:01
  • hey @thom-rogers any updates on this? – Michael Hausenblas Sep 03 '15 at 11:26
  • Michael, I checked and confirmed that ports 4040 and 5050 were both available on my laptop which is the local machine trying to comunicate with the cluster, However, no change in access. – Thom Rogers Sep 03 '15 at 21:44
  • Michael, I checked and confirmed that ports 4040 and 5050 were both available on my laptop which is the local machine trying to communicate with the cluster, However, no change in access. I did find an env var that I forgot to export (export MESOS_MASTER=xx.xxx.xxx.xxx) and after exporting that, I could access the Mesos console at 5050. Still couldn't access Spark at 4040 though. – Thom Rogers Sep 03 '15 at 22:43
  • Oddly the IP of the address for MESOS_MASTER is the *internal* IP address of the master. Yet the browser communicates thru the external IP. So I don't know why the address of the internal master ID would matter(even tho its the same machine) – Thom Rogers Sep 04 '15 at 05:05
  • I meant the local firewall on the GCE instance. – Michael Hausenblas Sep 04 '15 at 09:47

0 Answers0