[jira] [Created] (DRILL-4857) When no partition pruning occurs with metadata caching there's a performance regression

["Aman Sinha (JIRA)" <ji...@apache.org>]

Aman Sinha created DRILL-4857:
---------------------------------

             Summary: When no partition pruning occurs with metadata caching there's a performance regression
                 Key: DRILL-4857
                 URL: https://issues.apache.org/jira/browse/DRILL-4857
             Project: Apache Drill
          Issue Type: Bug
          Components: Metadata, Query Planning & Optimization
    Affects Versions: 1.7.0
            Reporter: Aman Sinha
            Assignee: Aman Sinha
             Fix For: 1.8.0


After DRILL-4530, we see the (expected) performance improvements in planning time with metadata cache for cases where partition pruning got applied.  However, in cases where it did not get applied and for sufficiently large number of files (tested with up to 400K files),  there's performance regression.  Part of this was addressed by DRILL-4846.   This JIRA is to track some remaining fixes to address the regression.  



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)