You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@zeppelin.apache.org by Ruslan Dautkhanov <da...@gmail.com> on 2016/12/01 00:57:20 UTC

sparkContext to get Spark Driver's URL

Any easy way to get Spark Driver's URL (i.e. from sparkContext )?
I always have to go to CM -> YARN applications -> choose my Spark job ->
click Application Master etc. to get Spark's Driver UI.

Any way we could derive driver's URL programmatically from SparkContext
variable?


ps. Long haul - it would be super awesome to get a link staright in
Zeppelin notebook (when SparkContext is instatiated).


Thank you,
Ruslan

Re: sparkContext to get Spark Driver's URL

Posted by Ruslan Dautkhanov <da...@gmail.com>.

Thanks Jeff.

ZEPPELIN-1692 will be very helpful.



-- 
Ruslan Dautkhanov

On Wed, Nov 30, 2016 at 6:56 PM, Jeff Zhang <zj...@gmail.com> wrote:

> You can get ui by
>
> sc.uiWebUrl
>
> And community is working on to display it in paragraph.
> https://github.com/apache/zeppelin/pull/1663
>
>
> Ruslan Dautkhanov <da...@gmail.com>于2016年12月1日周四 上午8:58写道：
>
>> Any easy way to get Spark Driver's URL (i.e. from sparkContext )?
>> I always have to go to CM -> YARN applications -> choose my Spark job ->
>> click Application Master etc. to get Spark's Driver UI.
>>
>> Any way we could derive driver's URL programmatically from SparkContext
>> variable?
>>
>>
>> ps. Long haul - it would be super awesome to get a link staright in
>> Zeppelin notebook (when SparkContext is instatiated).
>>
>>
>> Thank you,
>> Ruslan
>>
>>

Re: sparkContext to get Spark Driver's URL

Posted by Jeff Zhang <zj...@gmail.com>.

You can get ui by

sc.uiWebUrl

And community is working on to display it in paragraph.
https://github.com/apache/zeppelin/pull/1663


Ruslan Dautkhanov <da...@gmail.com>于2016年12月1日周四 上午8:58写道：

> Any easy way to get Spark Driver's URL (i.e. from sparkContext )?
> I always have to go to CM -> YARN applications -> choose my Spark job ->
> click Application Master etc. to get Spark's Driver UI.
>
> Any way we could derive driver's URL programmatically from SparkContext
> variable?
>
>
> ps. Long haul - it would be super awesome to get a link staright in
> Zeppelin notebook (when SparkContext is instatiated).
>
>
> Thank you,
> Ruslan
>
>

Re: sparkContext to get Spark Driver's URL

Posted by Jeff Zhang <zj...@gmail.com>.

You can get ui by

sc.uiWebUrl

And community is working on to display it in paragraph.
https://github.com/apache/zeppelin/pull/1663


Ruslan Dautkhanov <da...@gmail.com>于2016年12月1日周四 上午8:58写道：

> Any easy way to get Spark Driver's URL (i.e. from sparkContext )?
> I always have to go to CM -> YARN applications -> choose my Spark job ->
> click Application Master etc. to get Spark's Driver UI.
>
> Any way we could derive driver's URL programmatically from SparkContext
> variable?
>
>
> ps. Long haul - it would be super awesome to get a link staright in
> Zeppelin notebook (when SparkContext is instatiated).
>
>
> Thank you,
> Ruslan
>
>