You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by carlilek <ca...@janelia.hhmi.org> on 2015/10/29 13:45:20 UTC
spark-1.5.1 application detail ui url
I administer an HPC cluster that runs Spark clusters as jobs. We run Spark
over the backend network (typically used for MPI), which is not accessible
outside the cluster. Until we upgraded to 1.5.1 (from 1.3.1), this did not
present a problem. Now the Application Detail UI link is returning the IP
address of the backend network of the driver machine rather than that
machine's hostname. Consequentially, users cannot access that page. I am
unsure what might have changed or how I might change the behavior back.
--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/spark-1-5-1-application-detail-ui-url-tp25226.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org
Re: spark-1.5.1 application detail ui url
Posted by Rastan Boroujerdi <ra...@gmail.com>.
I'm having the same issue after upgrading to 1.5.1. This is just an issue
with the link on the master UI and I can still access the running
application fine via the hostname of the driver.
Thanks,
Rastan
On Thu, Oct 29, 2015 at 7:16 AM, Jean-Baptiste Onofré <jb...@nanthrax.net>
wrote:
> Hi,
>
> The running application UI should be available on the worker IP (on 4040
> default port), right ?
>
> So, basically, the problem is on the link of the master UI, correct ?
>
> Regards
> JB
>
>
> On 10/29/2015 01:45 PM, carlilek wrote:
>
>> I administer an HPC cluster that runs Spark clusters as jobs. We run Spark
>> over the backend network (typically used for MPI), which is not accessible
>> outside the cluster. Until we upgraded to 1.5.1 (from 1.3.1), this did not
>> present a problem. Now the Application Detail UI link is returning the IP
>> address of the backend network of the driver machine rather than that
>> machine's hostname. Consequentially, users cannot access that page. I am
>> unsure what might have changed or how I might change the behavior back.
>>
>>
>>
>> --
>> View this message in context:
>> http://apache-spark-user-list.1001560.n3.nabble.com/spark-1-5-1-application-detail-ui-url-tp25226.html
>> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
>> For additional commands, e-mail: user-help@spark.apache.org
>>
>>
> --
> Jean-Baptiste Onofré
> jbonofre@apache.org
> http://blog.nanthrax.net
> Talend - http://www.talend.com
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> For additional commands, e-mail: user-help@spark.apache.org
>
>
Re: spark-1.5.1 application detail ui url
Posted by Jean-Baptiste Onofré <jb...@nanthrax.net>.
Hi,
The running application UI should be available on the worker IP (on 4040
default port), right ?
So, basically, the problem is on the link of the master UI, correct ?
Regards
JB
On 10/29/2015 01:45 PM, carlilek wrote:
> I administer an HPC cluster that runs Spark clusters as jobs. We run Spark
> over the backend network (typically used for MPI), which is not accessible
> outside the cluster. Until we upgraded to 1.5.1 (from 1.3.1), this did not
> present a problem. Now the Application Detail UI link is returning the IP
> address of the backend network of the driver machine rather than that
> machine's hostname. Consequentially, users cannot access that page. I am
> unsure what might have changed or how I might change the behavior back.
>
>
>
> --
> View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/spark-1-5-1-application-detail-ui-url-tp25226.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> For additional commands, e-mail: user-help@spark.apache.org
>
--
Jean-Baptiste Onofré
jbonofre@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org