[jira] [Closed] (DRILL-4857) When no partition pruning occurs with metadata caching there's a performance regression

["Dechang Gu (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/DRILL-4857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Dechang Gu closed DRILL-4857.
-----------------------------

Verified, and added test cases to Perf Test Framework.


> When no partition pruning occurs with metadata caching there's a performance regression
> ---------------------------------------------------------------------------------------
>
>                 Key: DRILL-4857
>                 URL: https://issues.apache.org/jira/browse/DRILL-4857
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Metadata, Query Planning & Optimization
>    Affects Versions: 1.7.0
>            Reporter: Aman Sinha
>            Assignee: Aman Sinha
>             Fix For: 1.8.0
>
>
> After DRILL-4530, we see the (expected) performance improvements in planning time with metadata cache for cases where partition pruning got applied.  However, in cases where it did not get applied and for sufficiently large number of files (tested with up to 400K files),  there's performance regression.  Part of this was addressed by DRILL-4846.   This JIRA is to track some remaining fixes to address the regression.  



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)