You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Andy Davidson <An...@SantaCruzIntegration.com> on 2016/07/11 21:49:37 UTC
/spark-ec2 script: trouble using ganglia web ui spark 1.6.1

I created a cluster using spark-1.6.1-bin-hadoop2.6/ec2/spark-ec2 script.
The shows ganglia started how ever I am not able to access
http://ec2-54-215-230-73.us-west-1.compute.amazonaws.com:5080/ganglia. I
have tried using the private ip from with in my data center.



I d not see anything listing on port 5080.



Is there some additional step or configuration? (my AWS firewall knowledge
is limited)



Thanks



Andy





$ grep ganglia src/main/resources/scripts/launchCluster.sh.out

Initializing ganglia

[timing] ganglia init:  00h 00m 01s

Configuring /etc/ganglia/gmond.conf

Configuring /etc/ganglia/gmetad.conf

Configuring /etc/httpd/conf.d/ganglia.conf

Setting up ganglia

RSYNC'ing /etc/ganglia to slaves...

[timing] ganglia setup:  00h 00m 03s

Ganglia started at 
http://ec2-xxx.us-west-1.compute.amazonaws.com:5080/ganglia

$ 


bash-4.2# netstat -tulpn

Active Internet connections (only servers)

Proto Recv-Q Send-Q Local Address               Foreign Address
State       PID/Program name

tcp        0      0 0.0.0.0:8652                0.0.0.0:*
LISTEN      3832/gmetad

tcp        0      0 0.0.0.0:8787                0.0.0.0:*
LISTEN      2584/rserver

tcp        0      0 0.0.0.0:36757               0.0.0.0:*
LISTEN      2905/java

tcp        0      0 0.0.0.0:50070               0.0.0.0:*
LISTEN      2905/java

tcp        0      0 0.0.0.0:22                  0.0.0.0:*
LISTEN      2144/sshd

tcp        0      0 127.0.0.1:631               0.0.0.0:*
LISTEN      2095/cupsd

tcp        0      0 127.0.0.1:7000              0.0.0.0:*
LISTEN      6512/python3.4

tcp        0      0 127.0.0.1:25                0.0.0.0:*
LISTEN      2183/sendmail

tcp        0      0 0.0.0.0:43813               0.0.0.0:*
LISTEN      3093/java

tcp        0      0 172.31.22.140:9000          0.0.0.0:*
LISTEN      2905/java

tcp        0      0 0.0.0.0:8649                0.0.0.0:*
LISTEN      3810/gmond

tcp        0      0 0.0.0.0:50090               0.0.0.0:*
LISTEN      3093/java

tcp        0      0 0.0.0.0:8651                0.0.0.0:*
LISTEN      3832/gmetad

tcp        0      0 :::8080                     :::*
LISTEN      23719/java

tcp        0      0 :::8081                     :::*
LISTEN      5588/java

tcp        0      0 ::ffff:172.31.22.140:6066   :::*
LISTEN      23719/java

tcp        0      0 ::ffff:172.31.22.140:6067   :::*
LISTEN      5588/java

tcp        0      0 :::22                       :::*
LISTEN      2144/sshd

tcp        0      0 ::1:631                     :::*
LISTEN      2095/cupsd

tcp        0      0 :::19998                    :::*
LISTEN      3709/java

tcp        0      0 :::19999                    :::*
LISTEN      3709/java

tcp        0      0 ::ffff:172.31.22.140:7077   :::*
LISTEN      23719/java

tcp        0      0 ::ffff:172.31.22.140:7078   :::*
LISTEN      5588/java

udp        0      0 0.0.0.0:8649                0.0.0.0:*
3810/gmond         

udp        0      0 0.0.0.0:631                 0.0.0.0:*
2095/cupsd         

udp        0      0 0.0.0.0:38546               0.0.0.0:*
2905/java          

udp        0      0 0.0.0.0:68                  0.0.0.0:*
1142/dhclient      

udp        0      0 172.31.22.140:123           0.0.0.0:*
2168/ntpd          

udp        0      0 127.0.0.1:123               0.0.0.0:*
2168/ntpd          

udp        0      0 0.0.0.0:123                 0.0.0.0:*
2168/ntpd