You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@drill.apache.org by "Aman Sinha (JIRA)" <ji...@apache.org> on 2016/08/13 02:19:22 UTC

[jira] [Created] (DRILL-4846) Eliminate extra operations during metadata cache pruning

Aman Sinha created DRILL-4846:
---------------------------------

             Summary: Eliminate extra operations during metadata cache pruning
                 Key: DRILL-4846
                 URL: https://issues.apache.org/jira/browse/DRILL-4846
             Project: Apache Drill
          Issue Type: Bug
          Components: Metadata
    Affects Versions: 1.7.0
            Reporter: Aman Sinha
            Assignee: Aman Sinha
             Fix For: 1.8.0


While doing performance testing for DRILL-4530 using a new data set and queries, we found two potential performance issues: (a) the metadata cache was being read twice in some cases and (b) the checking for directory modification time was being done twice, once as part of the first phase of directory-based pruning and subsequently after the second phase pruning.   This check gets expensive for large number of directories.   Creating this JIRA to track fixes for these issues. 




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)