2

The nodes in my Spark cluster have two network interfaces each, one public and one private. Using the SPARK_MASTER_IP environment variable, I can configure Spark to listen on port 7077 on one or the other ip address.

For example:

netstat -tulpn
Active Internet connections (only servers)
Proto Recv-Q Send-Q Local Address           Foreign Address         State       PID/Program name
tcp6       0      0 10.x.x.x:7077           :::*                    LISTEN      43403/java

Is there any way to configure Spark to listen on port 7077 on both the public and private interface at the same time?

030
  • 5,901
  • 13
  • 68
  • 110
Leo
  • 983
  • 7
  • 21
  • 39

0 Answers0