You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Steve Loughran (JIRA)" <ji...@apache.org> on 2015/10/06 17:13:28 UTC
[jira] [Commented] (SPARK-10950) ApplicationHistoryInfo to include
spark version; History Server to report incompatibility with later versions
[ https://issues.apache.org/jira/browse/SPARK-10950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945161#comment-14945161 ]
Steve Loughran commented on SPARK-10950:
----------------------------------------
There's a less elegant solution which wouldn't address the home page display, but could handle the stack-trace-on-parse problem: have a specific {{incompatibleSparkVersionException}} exception which {{ApplicationHistoryProvider.getAppUI()}} could raise if it wanted to report this; the history server would catch this and present a specific error page
> ApplicationHistoryInfo to include spark version; History Server to report incompatibility with later versions
> -------------------------------------------------------------------------------------------------------------
>
> Key: SPARK-10950
> URL: https://issues.apache.org/jira/browse/SPARK-10950
> Project: Spark
> Issue Type: Improvement
> Components: Web UI
> Affects Versions: 1.5.1
> Reporter: Steve Loughran
> Priority: Minor
>
> The history server cannot provide guarantees of forward compatibility -it's unrealistic. What happens today is that the user gets to see a stack trace, perhaps when attempting to unmarshall a JSON-formatted event which isn't known about.
> If {{ApplicationHistoryInfo}} included a version field, and history providers included and later retrieved version information in their histories, then the UI could recognise incompatible histories and present them differently. In the main UI, somehow indicating that they weren't readable; perhaps with the URL being bonded to a page saying "incompatible version".
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org