You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Sahil Takiar (Jira)" <ji...@apache.org> on 2020/08/28 01:18:00 UTC
[jira] [Commented] (IMPALA-9332) Investigate and use the new batch
listing API from HDFS-13616
[ https://issues.apache.org/jira/browse/IMPALA-9332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17186189#comment-17186189 ]
Sahil Takiar commented on IMPALA-9332:
--------------------------------------
FYI there is a TODO to use this in HdfsTable#preloadPermissionsCache:
{code:java}
// TODO(todd): when HDFS-13616 (batch listing of multiple directories)
// is implemented, we could likely implement this with a single round
// trip. {code}
> Investigate and use the new batch listing API from HDFS-13616
> -------------------------------------------------------------
>
> Key: IMPALA-9332
> URL: https://issues.apache.org/jira/browse/IMPALA-9332
> Project: IMPALA
> Issue Type: Improvement
> Reporter: Vihang Karajgaonkar
> Assignee: Quanlong Huang
> Priority: Critical
>
> HDFS-13616 provides a new batch listing API which can potentially speed up the file listing on HDFS tables when reloading the table file metadata. We should investigate if this API is helpful for Impala and use it if there are any performance benefits.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org