You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2020/10/13 16:30:00 UTC
[jira] [Resolved] (SPARK-33132) The 'Shuffle Read Size / Records'
field in Stage Summary metrics was shown as 'NaN Undefined'
[ https://issues.apache.org/jira/browse/SPARK-33132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dongjoon Hyun resolved SPARK-33132.
-----------------------------------
Fix Version/s: 3.1.0
Resolution: Fixed
Issue resolved by pull request 30030
[https://github.com/apache/spark/pull/30030]
> The 'Shuffle Read Size / Records' field in Stage Summary metrics was shown as 'NaN Undefined'
> ---------------------------------------------------------------------------------------------
>
> Key: SPARK-33132
> URL: https://issues.apache.org/jira/browse/SPARK-33132
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core
> Affects Versions: 3.0.1
> Reporter: akiyamaneko
> Assignee: akiyamaneko
> Priority: Minor
> Fix For: 3.1.0
>
> Attachments: Stage Summary shows NaN undefined.png
>
>
> Spark Version: 3.0.1
> Description: The 'Shuffle Read Size / Records' field in Stage Summary metrics was shown as '*NaN Undefind*' when the *readBytes* value is negative, as the attachment shows.
> *curl http:/hadoop001:18081/api/v1/applications/application_1601774913550_0225/stages/2/0/taskSummary*
> {
> "quantiles" : [ 0.05, 0.25, 0.5, 0.75, 0.95 ],
> "executorDeserializeTime" : [ 7.0, 357.0, 390.0, 484.0, 492.0 ],
> ...
> "shuffleReadMetrics" :
> { {color:#de350b}"*readBytes*"{color} : [ {color:#de350b}*-2.0*{color}, 1775984.0, 1779759.0, 1781727.0, 1788426.0 ], "readRecords" : [ 2001.0, 2002.0, 2002.0, 2002.0, 2002.0 ], ... }
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org