You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Irina Easterling (JIRA)" <ji...@apache.org> on 2015/06/15 22:32:02 UTC
[jira] [Commented] (SPARK-8383) Spark History Server shows Last
Updated as 1969/12/31 when SparkPI application completed
[ https://issues.apache.org/jira/browse/SPARK-8383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14586648#comment-14586648 ]
Irina Easterling commented on SPARK-8383:
-----------------------------------------
Spark History Server shows Last Updated as 1969/12/31 when SparkPI application completed
Steps to reproduce:
1. Install Spark thru Ambari Wizard
2. After installation run the Spark Pi Example
3. Navigate to your Spark directory:
baron1:~ # cd /usr/hdp/current/spark-client/
baron1:/usr/hdp/current/spark-client # su spark
spark@baron1:/usr/hdp/current/spark-client> spark-submit --verbose --class org.apache.spark.examples.SparkPi --master yarn-cluster
--num-executors 3 --driver-memory 512m --executor-memory 512m --executor-cores 1 lib/spark-examples*.jar 10
4. When job completed.
5. Access to the Ambari > Spark> Spark History Server UI
6. Click on 'Show incomplete applications' link
7. View the result for completed job
//Results
Last Updated column shows date/time as 1969/12/31 19:00:00 (screenshot attacked)
8. Verify that Spark job completed in YARN. (screenshot attached)
There also discrepancy between SparkHistory Server WebUI and YARN/ResourceManager WebUI. Spark job completed and it is shown in the YARN/Resource Manager WebUI. In the SparkHistroyServer WebUI it shows as Uncompleted.
See attached screenshots.
> Spark History Server shows Last Updated as 1969/12/31 when SparkPI application completed
> -----------------------------------------------------------------------------------------
>
> Key: SPARK-8383
> URL: https://issues.apache.org/jira/browse/SPARK-8383
> Project: Spark
> Issue Type: Bug
> Components: Spark Core, Web UI
> Affects Versions: 1.3.1
> Environment: Spark 1.3.1.2.3
> Reporter: Irina Easterling
> Attachments: Spark_WrongLastUpdatedDate.png, YARN_SparkJobCompleted.PNG
>
>
> Spark History Server shows Last Updated as 1969/12/31 when SparkPI application completed and Started Date is 2015/06/10
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org