You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Zoltán Borók-Nagy (Jira)" <ji...@apache.org> on 2020/10/08 12:48:00 UTC
[jira] [Resolved] (IMPALA-8739) FileMetadataLoader skips empty
directories
[ https://issues.apache.org/jira/browse/IMPALA-8739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zoltán Borók-Nagy resolved IMPALA-8739.
---------------------------------------
Resolution: Not A Problem
HIVE-20137 is resolved which means Hive won't create empty ACID directories, not even for TRUNCATE.
> FileMetadataLoader skips empty directories
> ------------------------------------------
>
> Key: IMPALA-8739
> URL: https://issues.apache.org/jira/browse/IMPALA-8739
> Project: IMPALA
> Issue Type: Bug
> Reporter: Vihang Karajgaonkar
> Assignee: Zoltán Borók-Nagy
> Priority: Major
> Labels: impala-acid
>
> {{FileMetadataLoader}} has certain code paths like the one below which using {{listFiles}} API on the filesystem. This API ignores empty directories which is okay for non-transactional tables. However, in case of transactional table an empty base directory provides writeId information which is used to skip loading files which are not relevant for a given writeId. See {{AcidUtils#filterFilesForAcidState}} usage for details.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org