You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/12/07 20:50:00 UTC
[jira] [Assigned] (SPARK-25696) The storage memory displayed on
spark Application UI is incorrect.
[ https://issues.apache.org/jira/browse/SPARK-25696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sean Owen reassigned SPARK-25696:
---------------------------------
Docs Text: In Spark 3.0, the web UI and log statements now consistently report units in KiB, MiB, etc, (i.e. multiples of 1024) rather than KB and MB (i.e. multiples of 1000). For example, 1024000 bytes is now displayed as 1000 KiB rather than 1024 KB.
Assignee: hantiantian
Target Version/s: 3.0.0
Labels: release-notes (was: )
Component/s: Web UI
Issue Type: Improvement (was: Bug)
(I'm marking this much more of an improvement than fix, as I believe the displays were correct, but just in inconsistent units. There were a few log statements that were incorrect, but nothing functional, it appears.)
> The storage memory displayed on spark Application UI is incorrect.
> ------------------------------------------------------------------
>
> Key: SPARK-25696
> URL: https://issues.apache.org/jira/browse/SPARK-25696
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core, Web UI
> Affects Versions: 2.3.2
> Reporter: hantiantian
> Assignee: hantiantian
> Priority: Major
> Labels: release-notes
>
> In the reported heartbeat information, the unit of the memory data is bytes, which is converted by the formatBytes() function in the utils.js file before being displayed in the interface. The cardinality of the unit conversion in the formatBytes function is 1000, which should be 1024.
> function formatBytes(bytes, type)
> { if (type !== 'display') return bytes; if (bytes == 0) return '0.0 B'; var k = 1000; var dm = 1; var sizes = ['B', 'KB', 'MB', 'GB', 'TB', 'PB', 'EB', 'ZB', 'YB']; var i = Math.floor(Math.log(bytes) / Math.log(k)); return parseFloat((bytes / Math.pow(k, i)).toFixed(dm)) + ' ' + sizes[i]; }
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org