You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Reynold Xin (JIRA)" <ji...@apache.org> on 2017/03/31 06:10:41 UTC

[jira] [Resolved] (SPARK-20151) Account for partition pruning in scan metadataTime metrics

     [ https://issues.apache.org/jira/browse/SPARK-20151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Reynold Xin resolved SPARK-20151.
---------------------------------
       Resolution: Fixed
    Fix Version/s: 2.2.0

> Account for partition pruning in scan metadataTime metrics
> ----------------------------------------------------------
>
>                 Key: SPARK-20151
>                 URL: https://issues.apache.org/jira/browse/SPARK-20151
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>    Affects Versions: 2.1.0
>            Reporter: Reynold Xin
>            Assignee: Reynold Xin
>             Fix For: 2.2.0
>
>
> After SPARK-20136, we report metadata timing metrics in scan operator. However, that timing metric doesn't include one of the most important part of metadata, which is partition pruning. This patch adds that time measurement to the scan metrics.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org