You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Sean Owen (JIRA)" <ji...@apache.org> on 2015/04/04 18:35:33 UTC
[jira] [Updated] (SPARK-2698) RDD pages shows negative bytes
remaining for some executors
[ https://issues.apache.org/jira/browse/SPARK-2698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sean Owen updated SPARK-2698:
-----------------------------
Priority: Minor (was: Major)
This might have been fixed at some point since 1.0 though I don't see an obvious candidate. The problem is that "memUsed" exceeds "maxMem" in {{StorageStatus}}. It doesn't look like mere rounding error since the difference is >700MB out of 9.6GB.
It's easy to make {{memRemaining}} never return a negative value, which is on the one hand good defensive programming but might be hiding a race condition or other logic error.
Any thoughts on whether that is more good than harm?
> RDD pages shows negative bytes remaining for some executors
> -----------------------------------------------------------
>
> Key: SPARK-2698
> URL: https://issues.apache.org/jira/browse/SPARK-2698
> Project: Spark
> Issue Type: Bug
> Components: Web UI
> Affects Versions: 1.0.0
> Reporter: Hossein Falaki
> Priority: Minor
> Attachments: spark ui.png
>
>
> The RDD page shows negative bytes remaining for some executors.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org