You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Vihang Karajgaonkar (Jira)" <ji...@apache.org> on 2020/04/27 18:51:00 UTC
[jira] [Created] (IMPALA-9698) Filemetadata loader should avoid
recursing into out of range writeId directories
Vihang Karajgaonkar created IMPALA-9698:
-------------------------------------------
Summary: Filemetadata loader should avoid recursing into out of range writeId directories
Key: IMPALA-9698
URL: https://issues.apache.org/jira/browse/IMPALA-9698
Project: IMPALA
Issue Type: Improvement
Reporter: Vihang Karajgaonkar
Assignee: Vihang Karajgaonkar
Currently by default the FileMetadataLoader in Catalogd recurses into partition directories to load the file metadata. However, in case of transactional tables, many of such directories could be out of scope for the ValidWriteList of that table when the load is happening. Avoiding to recurse in such directories could help speed up the file-metadata load on transactional tables when compaction is not being run for longer durations.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org