You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Andrey Ivanov (JIRA)" <ji...@apache.org> on 2016/08/02 18:23:20 UTC

[jira] [Created] (SPARK-16859) History Server storage information is missing

Andrey Ivanov created SPARK-16859:
-------------------------------------

             Summary: History Server storage information is missing
                 Key: SPARK-16859
                 URL: https://issues.apache.org/jira/browse/SPARK-16859
             Project: Spark
          Issue Type: Bug
          Components: Spark Core
    Affects Versions: 2.0.0, 1.6.2
            Reporter: Andrey Ivanov


It looks like job history storage tab in history server is broken for completed jobs since *1.6.2*. 
More specifically it's broken since [SPARK-13845|https://issues.apache.org/jira/browse/SPARK-13845].

I've fixed for my installation by effectively reverting the above patch ([see|https://github.com/EinsamHauer/spark/commit/3af62ea09af8bb350c8c8a9117149c09b8feba08]).

IMHO, the most straightforward fix would be to implement _SparkListenerBlockUpdated_ serialization to JSON in _JsonProtocol_ and making sure it works from _ReplayListenerBus_.

The downside will be that it will still work incorrectly with pre patch job histories. But then, it doesn't work since *1.6.2* anyhow.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org