[jira] [Updated] (SPARK-18486) Access of SparkUI after task completion

["Sean Owen (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SPARK-18486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sean Owen updated SPARK-18486:
------------------------------
    Priority: Minor  (was: Blocker)

Please read https://cwiki.apache.org/confluence/display/SPARK/Contributing+to+Spark and direct questions to the user@ list.

You seem to be looking for the History server but otherwise I'm not clear what you're expecting. Your app UI is not running after the app finishes. 

> Access of SparkUI after task completion
> ---------------------------------------
>
>                 Key: SPARK-18486
>                 URL: https://issues.apache.org/jira/browse/SPARK-18486
>             Project: Spark
>          Issue Type: Question
>          Components: Optimizer, Structured Streaming, Web UI
>    Affects Versions: 2.0.1
>         Environment: Windows server 2008 R2
> Spark Version: 2.0.1
> Running locally and accessing sparkUI on por 4040
>            Reporter: Bhanuday Birla
>            Priority: Minor
>              Labels: newbie, performance
>             Fix For: 2.0.1
>
>   Original Estimate: 168h
>  Remaining Estimate: 168h
>
> Hi, 
> I am running spark scripts in on local machine. In order to see completion times of different jobs, I want to access SparkUI on port 4040. But i can access it while the script is running. After completion of the script, it's not accessible. To resolve this I have set spark.eventLog.enabled property to true inside my application. 
> conf =SparkConf().setMaster("local[4]").setAppName("IAP").set("spark.eventLog.enabled", 'true')
> Also I have created a folder named "spark-events" storing history logs which can be picked up by SparkUI. But still no luck. I am working on a project in my firm and get stuck here. Please help me in any possible way.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org