You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@impala.apache.org by "Vihang Karajgaonkar (JIRA)" <ji...@apache.org> on 2019/07/03 20:45:00 UTC

[jira] [Created] (IMPALA-8739) FileMetadataLoader skips empty directories

Vihang Karajgaonkar created IMPALA-8739:
-------------------------------------------

             Summary: FileMetadataLoader skips empty directories
                 Key: IMPALA-8739
                 URL: https://issues.apache.org/jira/browse/IMPALA-8739
             Project: IMPALA
          Issue Type: Bug
            Reporter: Vihang Karajgaonkar


{{FileMetadataLoader}} has certain code paths like the one below which using {{listFiles}} API on the filesystem. This API ignores empty directories which is okay for non-transactional tables. However, in case of transactional table an empty base directory provides writeId information which is used to skip loading files which are not relevant for a given writeId. See {{AcidUtils#filterFilesForAcidState}} usage for details.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)