You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Aditya Rao (JIRA)" <ji...@apache.org> on 2015/05/29 00:43:17 UTC
[jira] [Updated] (SPARK-7928) Yarn App Master Logs are not
displayed in the spark historyserver UI
[ https://issues.apache.org/jira/browse/SPARK-7928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Aditya Rao updated SPARK-7928:
------------------------------
Description:
in hadoop 2.7.0 the link to App Master Log has been disabled as the YARN Job History Server would show the app master logs in the Resource Manager UI, but Spark Historyserver doesn't show the app master logs.
So anyone who is running a spark job in yarn-cluster mode has no way to know the results other than checking the userlogs manually.
was:
in hadoop 2.7.0 the link to App Master Log has been disabled as the YARN Job History Server would show the app master logs, but Spark Historyserver doesn't show the app master logs.
So anyone who is running a spark job in yarn-cluster mode has no way to know the results other than checking the userlogs manually.
> Yarn App Master Logs are not displayed in the spark historyserver UI
> --------------------------------------------------------------------
>
> Key: SPARK-7928
> URL: https://issues.apache.org/jira/browse/SPARK-7928
> Project: Spark
> Issue Type: Bug
> Components: YARN
> Affects Versions: 1.2.1, 1.3.1
> Environment: yarn hadoop 2.7.0
> Reporter: Aditya Rao
>
> in hadoop 2.7.0 the link to App Master Log has been disabled as the YARN Job History Server would show the app master logs in the Resource Manager UI, but Spark Historyserver doesn't show the app master logs.
> So anyone who is running a spark job in yarn-cluster mode has no way to know the results other than checking the userlogs manually.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org