You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Apache Spark (JIRA)" <ji...@apache.org> on 2016/05/10 22:32:12 UTC

[jira] [Commented] (SPARK-15259) Sort time metric should not include spill and record insertion time

    [ https://issues.apache.org/jira/browse/SPARK-15259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15279131#comment-15279131 ] 

Apache Spark commented on SPARK-15259:
--------------------------------------

User 'ericl' has created a pull request for this issue:
https://github.com/apache/spark/pull/13035

> Sort time metric should not include spill and record insertion time
> -------------------------------------------------------------------
>
>                 Key: SPARK-15259
>                 URL: https://issues.apache.org/jira/browse/SPARK-15259
>             Project: Spark
>          Issue Type: Bug
>          Components: SQL
>            Reporter: Eric Liang
>            Priority: Minor
>
> After SPARK-14669 it seems the sort time metric includes both spill and record insertion time. This makes it not very useful since the metric becomes close to the total execution time of the node.
> We should track just the time spent for in-memory sort, as before.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org