You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by KhajaAsmath Mohammed <md...@gmail.com> on 2016/07/20 20:09:13 UTC
SparkWebUI and Master URL on EC2
Hi,
I got an access to spark cluser and have intstatiated spark-shell on aws
using command
$spark-shell.
Spark shell is started successfully but I am looking to access WebUI and
Master URL. does anyone know how to access that in AWS.
I tried http://IPMaster:4040 and http://IpMaster:8080 but it didnt show up
anything.
Thanks,
Asmath.
Re: SparkWebUI and Master URL on EC2
Posted by Ismaël Mejía <ie...@gmail.com>.
Hello,
If you are using EMR you probably need to create a SSH tunnel so you can
access the web ports of the master instance.
https://docs.aws.amazon.com/ElasticMapReduce/latest/DeveloperGuide/emr-ssh-tunnel.html
Also verify that your EMR cluster is not behind a private VPC, in this case
you must verify also that you can correctly access the VPC and create the
tunnel or forwards to do so.
Hope it helps,
Ismaël Mejía
On Thu, Jul 21, 2016 at 10:33 PM, Jacek Laskowski <ja...@japila.pl> wrote:
> Hi,
>
> What's in the logs of spark-shell? There should be the host and port
> of web UI. what the public IP of the host where you execute
> spark-shell? Use it for 4040. I don't think you use Spark Standalone
> cluster (the other address with 8080) if you simply spark-shell
> (unless you've got spark.master in conf/spark-defaults.conf).
>
> When you're inside spark-shell, can you sc.master? Use this for Spark
> Standalone's web UI (replacing 7077 to 8080).
>
> Pozdrawiam,
> Jacek Laskowski
> ----
> https://medium.com/@jaceklaskowski/
> Mastering Apache Spark http://bit.ly/mastering-apache-spark
> Follow me at https://twitter.com/jaceklaskowski
>
>
> On Wed, Jul 20, 2016 at 10:09 PM, KhajaAsmath Mohammed
> <md...@gmail.com> wrote:
> > Hi,
> >
> > I got an access to spark cluser and have intstatiated spark-shell on aws
> > using command
> > $spark-shell.
> >
> > Spark shell is started successfully but I am looking to access WebUI and
> > Master URL. does anyone know how to access that in AWS.
> >
> > I tried http://IPMaster:4040 and http://IpMaster:8080 but it didnt show
> up
> > anything.
> >
> > Thanks,
> > Asmath.
>
> ---------------------------------------------------------------------
> To unsubscribe e-mail: user-unsubscribe@spark.apache.org
>
>
Re: SparkWebUI and Master URL on EC2
Posted by Jacek Laskowski <ja...@japila.pl>.
Hi,
What's in the logs of spark-shell? There should be the host and port
of web UI. what the public IP of the host where you execute
spark-shell? Use it for 4040. I don't think you use Spark Standalone
cluster (the other address with 8080) if you simply spark-shell
(unless you've got spark.master in conf/spark-defaults.conf).
When you're inside spark-shell, can you sc.master? Use this for Spark
Standalone's web UI (replacing 7077 to 8080).
Pozdrawiam,
Jacek Laskowski
----
https://medium.com/@jaceklaskowski/
Mastering Apache Spark http://bit.ly/mastering-apache-spark
Follow me at https://twitter.com/jaceklaskowski
On Wed, Jul 20, 2016 at 10:09 PM, KhajaAsmath Mohammed
<md...@gmail.com> wrote:
> Hi,
>
> I got an access to spark cluser and have intstatiated spark-shell on aws
> using command
> $spark-shell.
>
> Spark shell is started successfully but I am looking to access WebUI and
> Master URL. does anyone know how to access that in AWS.
>
> I tried http://IPMaster:4040 and http://IpMaster:8080 but it didnt show up
> anything.
>
> Thanks,
> Asmath.
---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org