[jira] [Created] (SPARK-33132) The 'Shuffle Read Size / Records' field in Stage Summary metrics was shown as 'NaN Undefind'

["echohlne (Jira)" <ji...@apache.org>]

echohlne created SPARK-33132:
--------------------------------

             Summary: The 'Shuffle Read Size / Records' field in Stage Summary metrics was shown as 'NaN Undefind'
                 Key: SPARK-33132
                 URL: https://issues.apache.org/jira/browse/SPARK-33132
             Project: Spark
          Issue Type: Improvement
          Components: Spark Core
    Affects Versions: 3.0.1
            Reporter: echohlne
             Fix For: 3.0.2


Spark Version: 3.0.1

Description: The 'Shuffle Read Size / Records' field in Stage Summary metrics was shown as '*NaN Undefind*'  when the *readBytes* value is negative,  as the attachment shows.

*curl http:/hadoop001:18081/api/v1/applications/application_1601774913550_0225/stages/2/0/taskSummary*

{
 "quantiles" : [ 0.05, 0.25, 0.5, 0.75, 0.95 ],
 "executorDeserializeTime" : [ 7.0, 357.0, 390.0, 484.0, 492.0 ],
  ...
 "shuffleReadMetrics" :

{ "*readBytes*" : [ *-2.0*, 1775984.0, 1779759.0, 1781727.0, 1788426.0 ], "readRecords" : [ 2001.0, 2002.0, 2002.0, 2002.0, 2002.0 ],  ... }



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org