You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@impala.apache.org by "Sahil Takiar (JIRA)" <ji...@apache.org> on 2019/02/20 16:09:00 UTC

[jira] [Created] (IMPALA-8232) Custom cluster tests should allow setting dfs.client settings for impalads

Sahil Takiar created IMPALA-8232:
------------------------------------

             Summary: Custom cluster tests should allow setting dfs.client settings for impalads
                 Key: IMPALA-8232
                 URL: https://issues.apache.org/jira/browse/IMPALA-8232
             Project: IMPALA
          Issue Type: Improvement
          Components: Backend
            Reporter: Sahil Takiar
            Assignee: Sahil Takiar


Right now, custom cluster tests only allow specifying impalad startup options, however, it would be nice if the tests could specify arbitrary HDFS client configs as well (e.g. {{dfs.client}} options). This would allow us to increase our test integration coverage with different HDFS client setups such as (1) disabling short-circuit reads (thus triggering the code path for a remote read) (requires setting {{dfs.client.read.shortcircuit}} to false), (2) enabling hedged reads (requires setting {{dfs.client.hedged.read.threadpool.size}} to a value greater than 0).



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)