You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Vihang Karajgaonkar (Jira)" <ji...@apache.org> on 2020/10/22 18:30:00 UTC
[jira] [Resolved] (IMPALA-10219) Add a query option to simulate
catalogd HDFS listing delays
[ https://issues.apache.org/jira/browse/IMPALA-10219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vihang Karajgaonkar resolved IMPALA-10219.
------------------------------------------
Fix Version/s: Impala 4.0
Resolution: Fixed
> Add a query option to simulate catalogd HDFS listing delays
> -----------------------------------------------------------
>
> Key: IMPALA-10219
> URL: https://issues.apache.org/jira/browse/IMPALA-10219
> Project: IMPALA
> Issue Type: Sub-task
> Reporter: Vihang Karajgaonkar
> Assignee: Vihang Karajgaonkar
> Priority: Minor
> Fix For: Impala 4.0
>
>
> This parent issue (IMPALA-6671) caused serious query backlog on large setups where namenode response times are slower for whatever reasons. While you can tune the namenode to some extent it is still problematic that Impala HDFS operations which happen while holding the table lock block other unrelated queries.
> In order to simulate such problems in the product it would be nice to introduce a query option which adds a artificial delay in the RPCs to namenode when the table is being loaded. A query option is preferred over service level configuration since, that way it is easier to model a slow blocking query and a unrelated fast query in the test suite.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org